Jun 02 03:09:41 devstack cinder-volume[75573]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75573) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 02 03:09:41 devstack cinder-volume[75573]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75573) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 02 03:09:41 devstack cinder-volume[75573]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75573) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 02 03:09:42 devstack cinder-volume[75573]: INFO dbcounter [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] Registered counter for database cinder Jun 02 03:09:42 devstack cinder-volume[75573]: DEBUG oslo_db.sqlalchemy.engines [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75573) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 03:09:42 devstack cinder-volume[75573]: DEBUG dbcounter [-] [75573] Writer thread running {{(pid=75573) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 02 03:09:42 devstack cinder-volume[75573]: INFO cinder.rpc [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 02 03:09:42 devstack cinder-volume[75573]: INFO cinder.rpc [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 02 03:09:42 devstack cinder-volume[75573]: DEBUG oslo_db.sqlalchemy.engines [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75573) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 03:09:42 devstack cinder-volume[75573]: INFO cinder.volume.manager [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] Determined volume DB was empty at startup. Jun 02 03:09:42 devstack cinder-volume[75573]: DEBUG cinder.volume.manager [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75573) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 02 03:09:42 devstack cinder-volume[75573]: INFO cinder.volume.manager [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 02 03:09:42 devstack cinder-volume[75573]: WARNING stevedore.named [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 02 03:09:42 devstack cinder-volume[75573]: WARNING castellan.key_manager [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 02 03:09:42 devstack cinder-volume[75573]: WARNING cinder.keymgr.conf_key_mgr [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 02 03:09:42 devstack cinder-volume[75573]: DEBUG cinder.volume.drivers.lvm [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75573) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 02 03:09:42 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_concurrency.processutils [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] CMD "cinder-rtstool verify" returned: 0 in 0.389s {{(pid=75573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_db.sqlalchemy.engines [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75573) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 03:09:43 devstack cinder-volume[75573]: INFO cinder.rpc [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 02 03:09:43 devstack cinder-volume[75573]: INFO cinder.rpc [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 02 03:09:43 devstack cinder-volume[75573]: WARNING stevedore.named [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 02 03:09:43 devstack cinder-volume[75573]: WARNING castellan.key_manager [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 02 03:09:43 devstack cinder-volume[75573]: INFO cinder.volume.manager [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_db.sqlalchemy.engines [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75573) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 03:09:43 devstack cinder-volume[75573]: INFO oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] Starting 1 workers Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] Started child 75763 {{(pid=75573) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] Full set of CONF: {{(pid=75573) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] ******************************************************************************** {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] Configuration options gathered from: {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] ================================================================================ {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] allow_availability_zone_fallback = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] allow_compression_on_image_upload = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] allowed_direct_url_schemes = [] {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] api_rate_limit = True {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] auth_strategy = keystone {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75763]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] az_cache_duration = 3600 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_availability_zone = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_host = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_name = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_stats_polling_interval = 60 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backup_api_class = cinder.backup.api.API {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backup_name_template = backup-%s {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backup_use_same_host = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backup_use_temp_snapshot = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] chap_password = **** {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] chap_username = {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cinder_internal_tenant_project_id = 8af4d4b0459943c2a887a5e63954d990 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cinder_internal_tenant_user_id = 3b99c609f909486ea73958d33a877273 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cloned_volume_same_az = True {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cluster = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] compression_format = gzip {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] compute_api_class = cinder.compute.nova.API {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] config_dir = [] {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] config_source = [] {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] control_exchange = openstack {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] debug = True {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] default_availability_zone = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] default_group_type = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] default_volume_type = lvmdriver-1 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] disk_geometry = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] driver_client_cert = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] driver_client_cert_key = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] driver_data_namespace = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] driver_ssl_cert_path = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] driver_ssl_cert_verify = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] driver_use_ssl = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] enable_force_upload = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] enable_new_services = True {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] enable_unsupported_driver = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] enforce_multipath_for_image_xfer = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] filter_function = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] glance_api_insecure = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] glance_api_servers = ['http://192.168.122.71/image'] {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] glance_api_ssl_compression = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] glance_ca_certificates_file = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] glance_catalog_info = image:glance:publicURL {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] glance_certfile = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] glance_keyfile = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] glance_num_retries = 3 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] glance_request_timeout = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] goodness_function = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] graceful_shutdown_timeout = 5 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] group_api_class = cinder.group.api.API {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] host = devstack {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] image_compress_on_upload = True {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] image_conversion_address_space_limit = 1 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] image_conversion_cpu_limit = 60 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] image_conversion_disable = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] image_upload_use_cinder_backend = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] image_upload_use_internal_tenant = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] image_volume_cache_enabled = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] image_volume_cache_max_count = 0 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] image_volume_cache_max_size_gb = 0 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] init_host_max_objects_retrieval = 0 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] instance_format = [instance: %(uuid)s] {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] iscsi_target_flags = {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] iscsi_write_cache = on {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] iser_helper = tgtadm {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] iser_ip_address = 192.168.122.71 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] iser_port = 3260 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] log_color = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] log_config_append = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack sudo[75767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] log_dir = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] log_file = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] log_options = True {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] log_rotate_interval = 1 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack sudo[75767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:09:43 devstack cinder-volume[75763]: INFO cinder.volume.manager [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 02 03:09:43 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] log_rotate_interval_type = days {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] log_rotation_type = none {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] max_age = 0 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] max_logfile_count = 30 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] max_logfile_size_mb = 200 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] max_over_subscription_ratio = 20.0 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] message_reap_interval = 86400 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] message_ttl = 2592000 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] migration_create_volume_timeout_secs = 300 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] monkey_patch = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] monkey_patch_modules = [] {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] my_ip = 192.168.122.71 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] no_snapshot_gb_quota = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] num_iser_scan_tries = 3 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] num_shell_tries = 3 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] num_volume_device_scan_tries = 3 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] nvmeof_conn_info_version = 1 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] nvmet_ns_id = 10 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] nvmet_port_id = 1 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] osapi_max_limit = 1000 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] osapi_volume_ext_list = [] {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] osapi_volume_listen_port = 8776 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] osapi_volume_use_ssl = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] osapi_volume_workers = 2 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] per_volume_size_limit = -1 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] periodic_fuzzy_delay = 60 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] periodic_interval = 60 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] public_endpoint = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] publish_errors = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] quota_backup_gigabytes = 1000 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] quota_backups = 10 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] quota_gigabytes = 1000 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] quota_groups = 10 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] quota_snapshots = 10 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] quota_volumes = 10 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] rate_limit_burst = 0 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] rate_limit_except_level = CRITICAL {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] rate_limit_interval = 0 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] reinit_driver_count = 3 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] replication_device = **** {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] report_discard_supported = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] report_interval = 120 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] reservation_clean_interval = 86400 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] reservation_expire = 86400 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] reserved_image_namespaces = [] {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] reserved_percentage = 0 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] rpc_response_timeout = 120 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] run_external_periodic_tasks = True {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] scst_target_driver = iscsi {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] scst_target_iqn_name = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] service_down_time = 720 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] shell_completion = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] snapshot_name_template = snapshot-%s {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] snapshot_same_host = True {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] split_loggers = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] state_path = /opt/stack/data/cinder {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] storage_availability_zone = nova {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] storage_protocol = iSCSI {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] syslog_log_facility = LOG_USER {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] target_helper = lioadm {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] target_ip_address = 192.168.122.71 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] target_port = 3260 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] target_protocol = iscsi {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] target_secondary_ip_addresses = [] {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] trace_flags = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] transport_url = **** {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] until_refresh = 0 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] use_chap_auth = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] use_default_quota_class = True {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] use_journal = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] use_json = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] use_multipath_for_image_xfer = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] use_stderr = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] use_syslog = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] verify_glance_signatures = enabled {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] volume_api_class = cinder.volume.api.API {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] volume_backend_name = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] volume_clear = zero {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] volume_clear_ionice = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] volume_clear_size = 0 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] volume_copy_bps_limit = 0 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] volume_dd_blocksize = 1M {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] volume_name_template = volume-%s {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] volume_service_inithost_offload = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] volume_usage_audit_period = month {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] zoning_mode = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_concurrency.disable_process_locking = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.admin_password = **** {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.admin_token = **** {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.admin_user = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.auth_admin_prefix = {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.auth_port = 35357 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.auth_protocol = https {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.auth_section = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.auth_type = password {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.auth_uri = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.auth_version = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.cache = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.certfile = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.identity_uri = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.include_service_catalog = True {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.insecure = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.interface = public {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.keyfile = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.memcache_password = {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.memcache_username = {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.region_name = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.service_token_roles_required = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.service_type = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.71/identity {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.backend = dogpile.cache.null {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.backend_argument = **** {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.backend_expiration_time = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.config_prefix = cache.oslo {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.debug_cache_backend = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.enable_retry_client = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.enable_socket_keepalive = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.enabled = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.enforce_fips_mode = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.expiration_time = 600 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.hashclient_retry_attempts = 2 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.memcache_dead_retry = 300 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.memcache_pool_maxsize = 10 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.memcache_sasl_enabled = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.password = **** {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.proxies = [] {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.redis_db = 0 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.redis_server = localhost:6379 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.retry_attempts = 2 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.retry_delay = 0.0 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.socket_keepalive_count = 1 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.socket_keepalive_idle = 1 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.socket_keepalive_interval = 1 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.socket_timeout = 1.0 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.tls_allowed_ciphers = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.tls_cafile = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.tls_certfile = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.tls_enabled = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.tls_keyfile = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:43 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cache.username = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] database.asyncio_connection = **** {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] database.asyncio_slave_connection = **** {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] database.backend = sqlalchemy {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] database.connection = **** {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] database.connection_debug = 0 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] database.connection_parameters = {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] database.connection_recycle_time = 3600 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] database.connection_trace = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] database.db_inc_retry_interval = True {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] database.db_max_retries = 20 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] database.db_max_retry_interval = 10 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] database.db_retry_interval = 1 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] database.max_overflow = 50 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] database.max_pool_size = 5 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] database.max_retries = 10 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] database.mysql_wsrep_sync_wait = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] database.pool_timeout = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] database.retry_interval = 10 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] database.slave_connection = **** {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] database.sqlite_synchronous = True {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] database.synchronous_reader = True {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] database.use_db_reconnect = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] profiler.connection_string = messaging:// {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] profiler.enabled = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] profiler.es_doc_type = notification {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] profiler.es_scroll_size = 10000 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] profiler.es_scroll_time = 2m {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] profiler.filter_error_trace = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] profiler.hmac_keys = **** {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] profiler.sentinel_service_name = mymaster {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] profiler.socket_timeout = 0.1 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] profiler.trace_requests = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] profiler.trace_sqlalchemy = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] profiler_jaeger.process_tags = {} {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] profiler_jaeger.service_name_prefix = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] profiler_otlp.service_name_prefix = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_policy.enforce_new_defaults = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: WARNING oslo_config.cfg [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_policy.enforce_scope = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_policy.policy_default_rule = default {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_policy.policy_file = policy.yaml {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] coordination.backend_url = **** {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] privsep_osbrick.group = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] privsep_osbrick.helper_command = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] privsep_osbrick.user = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cinder_sys_admin.group = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cinder_sys_admin.helper_command = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] cinder_sys_admin.user = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] service_user.auth_section = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] service_user.auth_type = password {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] service_user.cafile = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] service_user.certfile = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] service_user.collect_timing = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] service_user.insecure = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] service_user.keyfile = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:09:44 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] service_user.send_service_user_token = True {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] service_user.split_loggers = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] service_user.timeout = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] glance.auth_section = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] glance.auth_type = password {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] glance.certfile = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] glance.collect_timing = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] glance.insecure = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] glance.keyfile = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] glance.region_name = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] glance.split_loggers = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] glance.timeout = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.backend_availability_zone = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.chap_password = **** {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.chap_username = {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.disk_geometry = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.driver_client_cert = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.driver_client_cert_key = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.driver_data_namespace = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.driver_use_ssl = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.extra_capabilities = {} {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.filter_function = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.goodness_function = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.iscsi_target_flags = {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.iscsi_write_cache = on {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.iser_helper = tgtadm {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.iser_ip_address = 192.168.122.71 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.iser_port = 3260 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.lvm_share_target = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.lvm_type = auto {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.num_shell_tries = 3 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.replication_device = **** {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.report_discard_supported = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.reserved_percentage = 0 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.target_helper = tgtadm {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.target_ip_address = 192.168.122.71 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.target_port = 3260 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.target_protocol = iscsi {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.trace_flags = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.unique_fqdn_network = True {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.use_chap_auth = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.volume_backend_name = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.volume_clear = zero {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.volume_clear_ionice = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.volume_clear_size = 0 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_reports.file_event_handler = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_reports.log_dir = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.backend_host = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.chap_password = **** {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.chap_username = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.disk_geometry = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.driver_client_cert = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.extra_capabilities = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.filter_function = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.goodness_function = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.iser_helper = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.iser_ip_address = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.iser_port = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.lvm_share_target = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.lvm_type = auto {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.num_shell_tries = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.replication_device = **** {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.report_discard_supported = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.reserved_percentage = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.scst_target_driver = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.storage_protocol = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.target_helper = lioadm {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.target_ip_address = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.target_port = 3260 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.trace_flags = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.use_chap_auth = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.volume_clear = zero {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.volume_clear_size = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] lvmdriver-1.volumes_dir = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.ssl = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_notifications.driver = [] {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_notifications.retry = -1 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] key_manager.fixed_key = **** {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] barbican.barbican_api_version = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] barbican.barbican_endpoint = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] barbican.barbican_endpoint_type = public {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] barbican.barbican_region_name = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] barbican.cafile = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] barbican.certfile = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] barbican.collect_timing = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] barbican.insecure = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] barbican.keyfile = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] barbican.number_of_retries = 60 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] barbican.retry_delay = 1 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] barbican.send_service_user_token = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] barbican.split_loggers = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] barbican.timeout = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] barbican.verify_ssl = True {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] barbican.verify_ssl_path = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] barbican_service_user.auth_section = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] barbican_service_user.auth_type = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] barbican_service_user.cafile = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] barbican_service_user.certfile = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] barbican_service_user.collect_timing = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] barbican_service_user.insecure = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] barbican_service_user.keyfile = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] barbican_service_user.split_loggers = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] barbican_service_user.timeout = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] vault.approle_role_id = **** {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] vault.approle_secret_id = **** {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] vault.kv_mountpoint = secret {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] vault.kv_path = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] vault.kv_version = 2 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] vault.namespace = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] vault.root_token_id = **** {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] vault.ssl_ca_crt_file = None {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] vault.timeout = 60.0 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] vault.use_ssl = False {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:09:44 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] ******************************************************************************** {{(pid=75573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 02 03:09:44 devstack sudo[75767]: pam_unix(sudo:session): session closed for user root Jun 02 03:09:44 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.788s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:09:44 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:09:44 devstack sudo[75963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 03:09:44 devstack sudo[75963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:09:44 devstack sudo[75963]: pam_unix(sudo:session): session closed for user root Jun 02 03:09:44 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.604s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:09:44 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:09:44 devstack cinder-volume[75763]: INFO cinder.brick.local_dev.lvm [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 02 03:09:44 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:09:44 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:09:44 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:09:44 devstack sudo[76172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 02 03:09:44 devstack sudo[76172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:09:45 devstack sudo[76172]: pam_unix(sudo:session): session closed for user root Jun 02 03:09:45 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.665s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:09:45 devstack cinder-volume[75763]: DEBUG cinder.brick.local_dev.lvm [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75763) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 02 03:09:45 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:09:45 devstack sudo[76326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 03:09:45 devstack sudo[76326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:09:46 devstack sudo[76326]: pam_unix(sudo:session): session closed for user root Jun 02 03:09:46 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.116s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:09:46 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:09:46 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:09:46 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:09:46 devstack sudo[76531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 03:09:46 devstack sudo[76531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:09:47 devstack sudo[76531]: pam_unix(sudo:session): session closed for user root Jun 02 03:09:47 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.832s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:09:47 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:09:47 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:09:47 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:09:47 devstack sudo[76541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 02 03:09:47 devstack sudo[76541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:09:48 devstack sudo[76541]: pam_unix(sudo:session): session closed for user root Jun 02 03:09:48 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.755s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:09:48 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:09:48 devstack sudo[76545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 02 03:09:48 devstack sudo[76545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:09:48 devstack sudo[76545]: pam_unix(sudo:session): session closed for user root Jun 02 03:09:48 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.604s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:09:48 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:09:48 devstack sudo[76550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 02 03:09:48 devstack sudo[76550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:09:49 devstack sudo[76550]: pam_unix(sudo:session): session closed for user root Jun 02 03:09:49 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.623s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:09:49 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:09:49 devstack sudo[76553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 03:09:49 devstack sudo[76553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:09:50 devstack sudo[76553]: pam_unix(sudo:session): session closed for user root Jun 02 03:09:50 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.616s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:09:50 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:09:50 devstack sudo[76558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 03:09:50 devstack sudo[76558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:09:50 devstack sudo[76558]: pam_unix(sudo:session): session closed for user root Jun 02 03:09:50 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.630s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:09:50 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:09:50 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:09:50 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:09:50 devstack sudo[76565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 03:09:50 devstack sudo[76565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:09:51 devstack sudo[76565]: pam_unix(sudo:session): session closed for user root Jun 02 03:09:51 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.798s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:09:51 devstack cinder-volume[75763]: INFO cinder.volume.drivers.lvm [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 02 03:09:51 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:09:51 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:09:51 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:09:51 devstack sudo[76576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 03:09:51 devstack sudo[76576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:09:52 devstack sudo[76576]: pam_unix(sudo:session): session closed for user root Jun 02 03:09:52 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.754s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:09:52 devstack cinder-volume[75763]: DEBUG cinder.volume.drivers.lvm [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Updating volume stats {{(pid=75763) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 02 03:09:52 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:09:52 devstack sudo[76673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 02 03:09:52 devstack sudo[76673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:09:53 devstack sudo[76673]: pam_unix(sudo:session): session closed for user root Jun 02 03:09:53 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:09:53 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:09:53 devstack sudo[76692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 03:09:53 devstack sudo[76692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:09:53 devstack cinder-volume[75573]: DEBUG dbcounter [-] [75573] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75573) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:09:53 devstack sudo[76692]: pam_unix(sudo:session): session closed for user root Jun 02 03:09:53 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.676s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:09:53 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:09:53 devstack sudo[76837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 03:09:53 devstack sudo[76837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:09:54 devstack sudo[76837]: pam_unix(sudo:session): session closed for user root Jun 02 03:09:54 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.595s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:09:54 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:09:54 devstack sudo[76840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 03:09:54 devstack sudo[76840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:09:54 devstack sudo[76840]: pam_unix(sudo:session): session closed for user root Jun 02 03:09:54 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.600s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:09:54 devstack cinder-volume[75763]: INFO cinder.volume.driver [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Driver hasn't implemented _init_vendor_properties() Jun 02 03:09:54 devstack cinder-volume[75763]: DEBUG cinder.volume.driver [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75763) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 02 03:09:54 devstack cinder-volume[75763]: DEBUG oslo_db.sqlalchemy.engines [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75763) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 03:09:54 devstack cinder-volume[75763]: DEBUG dbcounter [-] [75763] Writer thread running {{(pid=75763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 02 03:09:54 devstack cinder-volume[75763]: DEBUG cinder.db.sqlalchemy.api [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Building query based on filter {{(pid=75763) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3944}} Jun 02 03:09:54 devstack cinder-volume[75763]: DEBUG cinder.image.image_utils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75763) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 02 03:09:54 devstack cinder-volume[75763]: INFO cinder.keymgr.migration [None req-44364eeb-d119-484f-bb4a-530b8a0360c5 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 02 03:09:55 devstack cinder-volume[75763]: DEBUG cinder.volume.drivers.lvm [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Updating volume stats {{(pid=75763) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 02 03:09:55 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:09:55 devstack sudo[76844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 02 03:09:55 devstack sudo[76844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:09:55 devstack sudo[76844]: pam_unix(sudo:session): session closed for user root Jun 02 03:09:55 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.585s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:09:55 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:09:55 devstack sudo[76847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 03:09:55 devstack sudo[76847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:09:56 devstack sudo[76847]: pam_unix(sudo:session): session closed for user root Jun 02 03:09:56 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.585s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:09:56 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:09:56 devstack sudo[76851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 03:09:56 devstack sudo[76851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:09:56 devstack sudo[76851]: pam_unix(sudo:session): session closed for user root Jun 02 03:09:56 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.616s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:09:56 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:09:56 devstack sudo[76855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 03:09:56 devstack sudo[76855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:09:57 devstack sudo[76855]: pam_unix(sudo:session): session closed for user root Jun 02 03:09:57 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.585s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:09:57 devstack cinder-volume[75763]: DEBUG cinder.manager [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Notifying Schedulers of capabilities ... {{(pid=75763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:09:57 devstack cinder-volume[75763]: INFO cinder.volume.manager [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Driver initialization completed successfully. Jun 02 03:09:57 devstack cinder-volume[75763]: INFO cinder.manager [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Initiating service 2 cleanup Jun 02 03:09:57 devstack cinder-volume[75763]: INFO cinder.manager [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Service 2 cleanup completed. Jun 02 03:09:57 devstack cinder-volume[75763]: DEBUG cinder.service [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Creating RPC server for service cinder-volume {{(pid=75763) start /opt/stack/cinder/cinder/service.py:231}} Jun 02 03:09:57 devstack cinder-volume[75763]: DEBUG cinder.service [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75763) start /opt/stack/cinder/cinder/service.py:237}} Jun 02 03:09:57 devstack cinder-volume[75763]: INFO cinder.volume.manager [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 02 03:09:57 devstack cinder-volume[75763]: DEBUG cinder.volume.drivers.lvm [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Updating volume stats {{(pid=75763) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 02 03:09:57 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:09:57 devstack sudo[76861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 02 03:09:57 devstack sudo[76861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:09:58 devstack sudo[76861]: pam_unix(sudo:session): session closed for user root Jun 02 03:09:58 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.620s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:09:58 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:09:58 devstack sudo[76864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 03:09:58 devstack sudo[76864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:09:58 devstack sudo[76864]: pam_unix(sudo:session): session closed for user root Jun 02 03:09:58 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:09:58 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:09:58 devstack sudo[76868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 03:09:58 devstack sudo[76868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:09:59 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.651s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:09:59 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:09:59 devstack sudo[76868]: pam_unix(sudo:session): session closed for user root Jun 02 03:09:59 devstack sudo[76871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 03:09:59 devstack sudo[76871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:10:00 devstack sudo[76871]: pam_unix(sudo:session): session closed for user root Jun 02 03:10:00 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.589s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:10:00 devstack cinder-volume[75763]: INFO cinder.volume.manager [None req-06c3a4f3-9b6f-4da5-b0f0-1507bac0bc08 None None] Driver post RPC initialization completed successfully. Jun 02 03:10:10 devstack cinder-volume[75763]: DEBUG dbcounter [-] [75763] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:10:10 devstack cinder-volume[75763]: DEBUG dbcounter [-] [75763] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=75763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:10:36 devstack cinder-volume[75763]: DEBUG oslo_service.periodic_task [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] Running periodic task VolumeManager._thread_info {{(pid=75763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:10:36 devstack cinder-volume[75763]: DEBUG cinder.volume.manager [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] thread count: 6 {{(pid=75763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 02 03:10:36 devstack cinder-volume[75763]: DEBUG cinder.volume.manager [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] thread info: [<_MainThread(MainThread, started 133097593188480)>, , , , , ] {{(pid=75763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 02 03:11:36 devstack cinder-volume[75763]: DEBUG oslo_service.periodic_task [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:11:36 devstack cinder-volume[75763]: DEBUG cinder.volume.drivers.lvm [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] Updating volume stats {{(pid=75763) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 02 03:11:36 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:11:36 devstack sudo[81669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 02 03:11:36 devstack sudo[81669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:11:36 devstack sudo[81669]: pam_unix(sudo:session): session closed for user root Jun 02 03:11:36 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.580s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:11:36 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:11:36 devstack sudo[81688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 03:11:36 devstack sudo[81688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:11:37 devstack sudo[81688]: pam_unix(sudo:session): session closed for user root Jun 02 03:11:37 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.612s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:11:37 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:11:37 devstack sudo[81693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 03:11:37 devstack sudo[81693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:11:37 devstack sudo[81693]: pam_unix(sudo:session): session closed for user root Jun 02 03:11:37 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.584s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:11:37 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:11:37 devstack sudo[81697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 03:11:37 devstack sudo[81697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:11:38 devstack sudo[81697]: pam_unix(sudo:session): session closed for user root Jun 02 03:11:38 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.612s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:11:38 devstack cinder-volume[75763]: DEBUG cinder.manager [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] Notifying Schedulers of capabilities ... {{(pid=75763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:11:38 devstack cinder-volume[75763]: DEBUG oslo_service.periodic_task [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] Running periodic task VolumeManager._thread_info {{(pid=75763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:11:38 devstack cinder-volume[75763]: DEBUG cinder.volume.manager [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] thread count: 6 {{(pid=75763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 02 03:11:38 devstack cinder-volume[75763]: DEBUG cinder.volume.manager [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] thread info: [<_MainThread(MainThread, started 133097593188480)>, , , , , ] {{(pid=75763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 02 03:12:10 devstack cinder-volume[75763]: DEBUG dbcounter [-] [75763] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:12:36 devstack cinder-volume[75763]: DEBUG oslo_service.periodic_task [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:12:36 devstack cinder-volume[75763]: DEBUG cinder.volume.drivers.lvm [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] Updating volume stats {{(pid=75763) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 02 03:12:36 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:12:36 devstack sudo[82860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 02 03:12:36 devstack sudo[82860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:12:36 devstack sudo[82860]: pam_unix(sudo:session): session closed for user root Jun 02 03:12:36 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.584s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:12:36 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:12:36 devstack sudo[82903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 03:12:36 devstack sudo[82903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:12:37 devstack sudo[82903]: pam_unix(sudo:session): session closed for user root Jun 02 03:12:37 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.592s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:12:37 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:12:37 devstack sudo[82958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 03:12:37 devstack sudo[82958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:12:37 devstack sudo[82958]: pam_unix(sudo:session): session closed for user root Jun 02 03:12:37 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.590s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:12:37 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:12:37 devstack sudo[82979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 03:12:37 devstack sudo[82979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:12:38 devstack sudo[82979]: pam_unix(sudo:session): session closed for user root Jun 02 03:12:38 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.624s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:12:38 devstack cinder-volume[75763]: DEBUG cinder.manager [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] Notifying Schedulers of capabilities ... {{(pid=75763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:12:38 devstack cinder-volume[75763]: DEBUG oslo_service.periodic_task [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] Running periodic task VolumeManager._thread_info {{(pid=75763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:12:38 devstack cinder-volume[75763]: DEBUG cinder.volume.manager [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] thread count: 6 {{(pid=75763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 02 03:12:38 devstack cinder-volume[75763]: DEBUG cinder.volume.manager [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] thread info: [<_MainThread(MainThread, started 133097593188480)>, , , , , ] {{(pid=75763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 02 03:13:36 devstack cinder-volume[75763]: DEBUG oslo_service.periodic_task [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:13:36 devstack cinder-volume[75763]: DEBUG cinder.volume.drivers.lvm [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] Updating volume stats {{(pid=75763) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 02 03:13:36 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:13:36 devstack sudo[84463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 02 03:13:36 devstack sudo[84463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:13:36 devstack sudo[84463]: pam_unix(sudo:session): session closed for user root Jun 02 03:13:36 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.599s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:13:36 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:13:36 devstack sudo[84468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 03:13:36 devstack sudo[84468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:13:37 devstack sudo[84468]: pam_unix(sudo:session): session closed for user root Jun 02 03:13:37 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.590s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:13:37 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:13:37 devstack sudo[84471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 02 03:13:37 devstack sudo[84471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:13:37 devstack sudo[84471]: pam_unix(sudo:session): session closed for user root Jun 02 03:13:37 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.589s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:13:37 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:13:37 devstack sudo[84477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 02 03:13:37 devstack sudo[84477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:13:38 devstack sudo[84477]: pam_unix(sudo:session): session closed for user root Jun 02 03:13:38 devstack cinder-volume[75763]: DEBUG oslo_concurrency.processutils [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.592s {{(pid=75763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:13:38 devstack cinder-volume[75763]: DEBUG cinder.manager [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] Notifying Schedulers of capabilities ... {{(pid=75763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:13:38 devstack cinder-volume[75763]: DEBUG oslo_service.periodic_task [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] Running periodic task VolumeManager._thread_info {{(pid=75763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:13:38 devstack cinder-volume[75763]: DEBUG cinder.volume.manager [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] thread count: 6 {{(pid=75763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 02 03:13:38 devstack cinder-volume[75763]: DEBUG cinder.volume.manager [None req-3db24cac-4cf6-4dd5-ba13-349f2ea0ff04 None None] thread info: [<_MainThread(MainThread, started 133097593188480)>, , , , , ] {{(pid=75763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 02 03:14:10 devstack cinder-volume[75763]: DEBUG dbcounter [-] [75763] Writing DB stats cinder:SELECT=1 {{(pid=75763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:14:10 devstack cinder-volume[75763]: DEBUG dbcounter [-] [75763] Writing DB stats cinder:UPDATE=1 {{(pid=75763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:14:24 devstack cinder-volume[75573]: INFO oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] Caught SIGTERM, stopping children Jun 02 03:14:24 devstack cinder-volume[75573]: DEBUG oslo_concurrency.lockutils [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] Acquiring lock "singleton_lock" {{(pid=75573) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 02 03:14:24 devstack cinder-volume[75573]: DEBUG oslo_concurrency.lockutils [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] Acquired lock "singleton_lock" {{(pid=75573) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 02 03:14:24 devstack cinder-volume[75573]: DEBUG oslo_concurrency.lockutils [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] Releasing lock "singleton_lock" {{(pid=75573) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 02 03:14:24 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] Stop services. {{(pid=75573) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 02 03:14:24 devstack cinder-volume[75573]: DEBUG oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] Killing children. {{(pid=75573) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 02 03:14:24 devstack cinder-volume[75573]: INFO oslo_service.backend._eventlet.service [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] Waiting on 1 children to exit Jun 02 03:14:29 devstack cinder-volume[75763]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jun 02 03:14:32 devstack cinder-volume[85464]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85464) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 02 03:14:32 devstack cinder-volume[85464]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85464) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 02 03:14:32 devstack cinder-volume[85464]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85464) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 02 03:14:32 devstack cinder-volume[75763]: DEBUG oslo_concurrency.lockutils [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] Acquiring lock "singleton_lock" {{(pid=75763) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 02 03:14:32 devstack cinder-volume[75763]: DEBUG oslo_concurrency.lockutils [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] Acquired lock "singleton_lock" {{(pid=75763) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 02 03:14:32 devstack cinder-volume[75763]: DEBUG oslo_concurrency.lockutils [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] Releasing lock "singleton_lock" {{(pid=75763) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 02 03:14:32 devstack cinder-volume[75763]: WARNING amqp [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 02 03:14:32 devstack cinder-volume[75763]: WARNING amqp [None req-794227cd-fbcc-4d3d-ae64-4698542ef338 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 02 03:14:33 devstack cinder-volume[85464]: INFO dbcounter [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] Registered counter for database cinder Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_db.sqlalchemy.engines [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85464) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG dbcounter [-] [85464] Writer thread running {{(pid=85464) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 02 03:14:33 devstack cinder-volume[85464]: INFO cinder.rpc [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 02 03:14:33 devstack cinder-volume[85464]: INFO cinder.rpc [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_db.sqlalchemy.engines [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85464) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 03:14:33 devstack cinder-volume[85464]: INFO cinder.volume.manager [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] Determined volume DB was empty at startup. Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG cinder.volume.manager [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85464) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 02 03:14:33 devstack cinder-volume[85464]: INFO cinder.volume.manager [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 02 03:14:33 devstack cinder-volume[85464]: WARNING stevedore.named [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 02 03:14:33 devstack cinder-volume[85464]: WARNING castellan.key_manager [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 02 03:14:33 devstack cinder-volume[85464]: WARNING cinder.keymgr.conf_key_mgr [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 02 03:14:33 devstack cinder-volume[85464]: INFO cinder.volume.manager [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_db.sqlalchemy.engines [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85464) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 03:14:33 devstack cinder-volume[85464]: INFO oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] Starting 1 workers Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] Started child 85722 {{(pid=85464) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] Full set of CONF: {{(pid=85464) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] ******************************************************************************** {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] Configuration options gathered from: {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] ================================================================================ {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] allow_availability_zone_fallback = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] allow_compression_on_image_upload = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] allowed_direct_url_schemes = [] {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] api_rate_limit = True {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] auth_strategy = keystone {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_availability_zone = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_host = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_name = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_stats_polling_interval = 60 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backup_api_class = cinder.backup.api.API {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backup_name_template = backup-%s {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backup_use_same_host = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backup_use_temp_snapshot = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] chap_password = **** {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] chap_username = {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cinder_internal_tenant_project_id = 8af4d4b0459943c2a887a5e63954d990 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cinder_internal_tenant_user_id = 3b99c609f909486ea73958d33a877273 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cluster = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] compression_format = gzip {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] compute_api_class = cinder.compute.nova.API {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] config_dir = [] {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] config_source = [] {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] control_exchange = openstack {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] debug = True {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] default_availability_zone = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] default_group_type = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] default_volume_type = QuobyteHD {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] disk_geometry = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] driver_client_cert = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85722]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] driver_client_cert_key = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] driver_data_namespace = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] driver_ssl_cert_path = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] driver_ssl_cert_verify = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] driver_use_ssl = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] enable_new_services = True {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] enable_unsupported_driver = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] enabled_backends = ['QuobyteHD'] {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] enforce_multipath_for_image_xfer = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] filter_function = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] glance_api_insecure = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] glance_api_servers = ['http://192.168.122.71/image'] {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] glance_api_ssl_compression = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] glance_ca_certificates_file = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] glance_catalog_info = image:glance:publicURL {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] glance_certfile = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] glance_keyfile = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] glance_num_retries = 3 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] glance_request_timeout = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] goodness_function = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] graceful_shutdown_timeout = 5 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] group_api_class = cinder.group.api.API {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] host = devstack {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] image_compress_on_upload = True {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] image_conversion_address_space_limit = 1 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] image_conversion_cpu_limit = 60 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] image_conversion_disable = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] image_upload_use_cinder_backend = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] image_upload_use_internal_tenant = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] image_volume_cache_enabled = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] image_volume_cache_max_count = 0 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] image_volume_cache_max_size_gb = 0 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] init_host_max_objects_retrieval = 0 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] instance_format = [instance: %(uuid)s] {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] iscsi_target_flags = {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] iscsi_write_cache = on {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] iser_helper = tgtadm {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] iser_ip_address = 192.168.122.71 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] iser_port = 3260 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] log_color = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] log_config_append = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] log_dir = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] log_file = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] log_options = True {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] log_rotate_interval = 1 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] log_rotate_interval_type = days {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] log_rotation_type = none {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] max_age = 0 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] max_logfile_count = 30 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] max_logfile_size_mb = 200 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] max_over_subscription_ratio = 20.0 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] message_reap_interval = 86400 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] message_ttl = 2592000 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] migration_create_volume_timeout_secs = 300 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] monkey_patch = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] monkey_patch_modules = [] {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] my_ip = 192.168.122.71 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] no_snapshot_gb_quota = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] num_iser_scan_tries = 3 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] num_shell_tries = 3 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] num_volume_device_scan_tries = 3 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] nvmeof_conn_info_version = 1 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] nvmet_ns_id = 10 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] nvmet_port_id = 1 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] osapi_max_limit = 1000 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] osapi_volume_ext_list = [] {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] osapi_volume_listen_port = 8776 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] osapi_volume_use_ssl = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] osapi_volume_workers = 2 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] per_volume_size_limit = -1 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] periodic_fuzzy_delay = 60 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] periodic_interval = 60 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] public_endpoint = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] publish_errors = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] quota_backup_gigabytes = 1000 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] quota_backups = 10 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] quota_gigabytes = 1000 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] quota_groups = 10 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] quota_snapshots = 10 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] quota_volumes = 10 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] rate_limit_burst = 0 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] rate_limit_except_level = CRITICAL {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] rate_limit_interval = 0 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] reinit_driver_count = 3 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] replication_device = **** {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] report_discard_supported = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] report_interval = 120 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] reservation_clean_interval = 86400 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] reservation_expire = 86400 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] reserved_image_namespaces = [] {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] reserved_percentage = 0 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] rpc_response_timeout = 120 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] run_external_periodic_tasks = True {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] scst_target_driver = iscsi {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] scst_target_iqn_name = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] service_down_time = 720 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] shell_completion = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] snapshot_name_template = snapshot-%s {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] split_loggers = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] state_path = /opt/stack/data/cinder {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] storage_availability_zone = nova {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] storage_protocol = iSCSI {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] syslog_log_facility = LOG_USER {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] target_helper = lioadm {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] target_ip_address = 192.168.122.71 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] target_port = 3260 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] target_protocol = iscsi {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] target_secondary_ip_addresses = [] {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] trace_flags = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] transport_url = **** {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] until_refresh = 0 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] use_chap_auth = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] use_default_quota_class = True {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] use_journal = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] use_json = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] use_multipath_for_image_xfer = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] use_stderr = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] use_syslog = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] verify_glance_signatures = enabled {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] volume_api_class = cinder.volume.api.API {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] volume_backend_name = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] volume_clear = zero {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] volume_clear_ionice = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] volume_clear_size = 0 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] volume_copy_bps_limit = 0 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] volume_dd_blocksize = 1M {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] volume_name_template = volume-%s {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] volume_service_inithost_offload = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] volume_usage_audit_period = month {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] zoning_mode = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_concurrency.disable_process_locking = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.admin_password = **** {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.admin_token = **** {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.admin_user = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.auth_admin_prefix = {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.auth_port = 35357 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.auth_protocol = https {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.auth_section = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.auth_type = password {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.auth_uri = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.auth_version = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.cache = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.certfile = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.identity_uri = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.include_service_catalog = True {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.insecure = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.interface = public {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.keyfile = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.memcache_password = {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.memcache_username = {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.region_name = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.service_token_roles_required = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.service_type = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.71/identity {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.backend = dogpile.cache.null {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.backend_argument = **** {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.backend_expiration_time = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.config_prefix = cache.oslo {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.debug_cache_backend = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.enable_retry_client = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.enable_socket_keepalive = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.enabled = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.enforce_fips_mode = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.expiration_time = 600 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.hashclient_retry_attempts = 2 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.memcache_dead_retry = 300 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.memcache_pool_maxsize = 10 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.memcache_sasl_enabled = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.password = **** {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.proxies = [] {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.redis_db = 0 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.redis_server = localhost:6379 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.retry_attempts = 2 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.retry_delay = 0.0 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.socket_keepalive_count = 1 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.socket_keepalive_idle = 1 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.socket_keepalive_interval = 1 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.socket_timeout = 1.0 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.tls_allowed_ciphers = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.tls_cafile = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.tls_certfile = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.tls_enabled = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.tls_keyfile = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cache.username = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] database.asyncio_connection = **** {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] database.asyncio_slave_connection = **** {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] database.backend = sqlalchemy {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] database.connection = **** {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] database.connection_debug = 0 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] database.connection_parameters = {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] database.connection_recycle_time = 3600 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] database.connection_trace = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] database.db_inc_retry_interval = True {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] database.db_max_retries = 20 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] database.db_max_retry_interval = 10 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] database.db_retry_interval = 1 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] database.max_overflow = 50 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] database.max_pool_size = 5 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] database.max_retries = 10 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] database.mysql_wsrep_sync_wait = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] database.pool_timeout = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] database.retry_interval = 10 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] database.slave_connection = **** {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] database.sqlite_synchronous = True {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] database.synchronous_reader = True {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] database.use_db_reconnect = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] profiler.connection_string = messaging:// {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] profiler.enabled = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] profiler.es_doc_type = notification {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] profiler.es_scroll_size = 10000 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] profiler.es_scroll_time = 2m {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] profiler.filter_error_trace = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] profiler.hmac_keys = **** {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] profiler.sentinel_service_name = mymaster {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] profiler.socket_timeout = 0.1 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] profiler.trace_requests = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] profiler.trace_sqlalchemy = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85722]: INFO cinder.volume.manager [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] profiler_jaeger.process_tags = {} {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85722]: DEBUG cinder.volume.drivers.remotefs [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85722) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] profiler_jaeger.service_name_prefix = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] profiler_otlp.service_name_prefix = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_policy.enforce_new_defaults = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: WARNING oslo_config.cfg [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_policy.enforce_scope = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_policy.policy_default_rule = default {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_policy.policy_file = policy.yaml {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] coordination.backend_url = **** {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] privsep_osbrick.group = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] privsep_osbrick.helper_command = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] privsep_osbrick.user = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cinder_sys_admin.group = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cinder_sys_admin.helper_command = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] cinder_sys_admin.user = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] service_user.auth_section = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] service_user.auth_type = password {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] service_user.cafile = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] service_user.certfile = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] service_user.collect_timing = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] service_user.insecure = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] service_user.keyfile = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] service_user.send_service_user_token = True {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] service_user.split_loggers = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] service_user.timeout = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] glance.auth_section = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] glance.auth_type = password {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] glance.certfile = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] glance.collect_timing = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] glance.insecure = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] glance.keyfile = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] glance.region_name = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] glance.split_loggers = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] glance.timeout = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.backend_availability_zone = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.chap_password = **** {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.chap_username = {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.disk_geometry = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.driver_client_cert = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.driver_client_cert_key = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.driver_data_namespace = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.driver_use_ssl = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.extra_capabilities = {} {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.filter_function = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.goodness_function = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.iscsi_target_flags = {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.iscsi_write_cache = on {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.iser_helper = tgtadm {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.iser_ip_address = 192.168.122.71 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.iser_port = 3260 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.nas_host = {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.nas_login = admin {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.nas_mount_options = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.nas_password = **** {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.nas_private_key = {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.nas_share_path = {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.num_shell_tries = 3 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.quobyte_volume_url = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.replication_device = **** {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.report_discard_supported = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.reserved_percentage = 0 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.target_helper = tgtadm {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.target_ip_address = 192.168.122.71 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.target_port = 3260 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.target_protocol = iscsi {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.trace_flags = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.unique_fqdn_network = True {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.use_chap_auth = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.volume_backend_name = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.volume_clear = zero {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.volume_clear_ionice = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.volume_clear_size = 0 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_reports.file_event_handler = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_reports.log_dir = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.backend_availability_zone = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.backend_host = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.chap_password = **** {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.chap_username = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.chiscsi_conf = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.disk_geometry = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.driver_client_cert = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.driver_data_namespace = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.driver_use_ssl = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.extra_capabilities = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.filter_function = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.goodness_function = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.iser_helper = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.iser_ip_address = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.iser_port = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.iser_target_prefix = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.nas_host = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.nas_login = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.nas_mount_options = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.nas_password = **** {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.nas_private_key = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.nas_share_path = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.nas_ssh_port = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.num_shell_tries = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.nvmet_port_id = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.replication_device = **** {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.report_discard_supported = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.reserved_percentage = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.scst_target_driver = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.storage_protocol = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.target_helper = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.target_ip_address = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.target_port = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.target_prefix = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.target_protocol = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.trace_flags = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.use_chap_auth = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.volume_clear = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.volume_clear_size = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] QuobyteHD.volumes_dir = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.ssl = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_notifications.driver = [] {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_notifications.retry = -1 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] key_manager.fixed_key = **** {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] barbican.barbican_api_version = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] barbican.barbican_endpoint = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] barbican.barbican_endpoint_type = public {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] barbican.barbican_region_name = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] barbican.cafile = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] barbican.certfile = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] barbican.collect_timing = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] barbican.insecure = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] barbican.keyfile = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] barbican.number_of_retries = 60 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] barbican.retry_delay = 1 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] barbican.send_service_user_token = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] barbican.split_loggers = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] barbican.timeout = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] barbican.verify_ssl = True {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] barbican.verify_ssl_path = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] barbican_service_user.auth_section = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] barbican_service_user.auth_type = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] barbican_service_user.cafile = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] barbican_service_user.certfile = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] barbican_service_user.collect_timing = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] barbican_service_user.insecure = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] barbican_service_user.keyfile = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] barbican_service_user.split_loggers = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] barbican_service_user.timeout = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] vault.approle_role_id = **** {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] vault.approle_secret_id = **** {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] vault.kv_mountpoint = secret {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] vault.kv_path = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] vault.kv_version = 2 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] vault.namespace = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] vault.root_token_id = **** {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] vault.ssl_ca_crt_file = None {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] vault.timeout = 60.0 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] vault.use_ssl = False {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:33 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] ******************************************************************************** {{(pid=85464) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 02 03:14:33 devstack cinder-volume[85722]: DEBUG cinder.volume.drivers.quobyte [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85722) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 02 03:14:33 devstack cinder-volume[85722]: WARNING cinder.volume.drivers.quobyte [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 02 03:14:33 devstack cinder-volume[85722]: WARNING cinder.volume.drivers.quobyte [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 02 03:14:33 devstack cinder-volume[85722]: DEBUG oslo_concurrency.processutils [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] Running cmd (subprocess): mount.quobyte {{(pid=85722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:14:34 devstack quobyte-client[85723]: Reading configuration file: /etc/quobyte/client.cfg Jun 02 03:14:34 devstack quobyte-client[85723]: Invalid parameters found, error: missing mount point. Jun 02 03:14:34 devstack quobyte-client[85723]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 02 03:14:34 devstack quobyte-client[85723]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 02 03:14:34 devstack cinder-volume[85722]: DEBUG oslo_concurrency.processutils [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] CMD "mount.quobyte" returned: 1 in 0.130s {{(pid=85722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:14:34 devstack cinder-volume[85722]: DEBUG oslo_concurrency.lockutils [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:14:34 devstack cinder-volume[85722]: DEBUG oslo_concurrency.lockutils [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:14:34 devstack cinder-volume[85722]: DEBUG cinder.volume.drivers.quobyte [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=85722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:14:34 devstack cinder-volume[85722]: INFO cinder.volume.drivers.quobyte [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 ... Jun 02 03:14:34 devstack cinder-volume[85722]: DEBUG oslo_concurrency.processutils [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f -c /etc/quobyte/client-cinder.cfg {{(pid=85722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:14:34 devstack sudo[85736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f -c /etc/quobyte/client-cinder.cfg Jun 02 03:14:34 devstack sudo[85736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:14:34 devstack sudo[85736]: pam_unix(sudo:session): session closed for user root Jun 02 03:14:34 devstack cinder-volume[85722]: DEBUG oslo_concurrency.processutils [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.736s {{(pid=85722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:14:34 devstack cinder-volume[85722]: INFO cinder.volume.drivers.quobyte [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 succeeded Jun 02 03:14:34 devstack cinder-volume[85722]: DEBUG cinder.volume.drivers.quobyte [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=85722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:14:34 devstack cinder-volume[85722]: DEBUG oslo_concurrency.lockutils [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.749s {{(pid=85722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:14:34 devstack cinder-volume[85722]: DEBUG oslo_concurrency.processutils [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=85722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:14:34 devstack sudo[85812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:14:34 devstack sudo[85812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:14:35 devstack sudo[85812]: pam_unix(sudo:session): session closed for user root Jun 02 03:14:35 devstack cinder-volume[85722]: DEBUG oslo_concurrency.processutils [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.626s {{(pid=85722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:14:35 devstack cinder-volume[85722]: INFO cinder.volume.driver [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] Driver hasn't implemented _init_vendor_properties() Jun 02 03:14:35 devstack cinder-volume[85722]: DEBUG cinder.volume.driver [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579956054688, 'free_capacity_gb': 1775.7579956054688, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85722) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 02 03:14:35 devstack cinder-volume[85722]: DEBUG oslo_db.sqlalchemy.engines [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85722) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 03:14:35 devstack cinder-volume[85722]: DEBUG dbcounter [-] [85722] Writer thread running {{(pid=85722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 02 03:14:35 devstack cinder-volume[85722]: DEBUG cinder.db.sqlalchemy.api [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] Building query based on filter {{(pid=85722) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3944}} Jun 02 03:14:35 devstack cinder-volume[85722]: DEBUG cinder.image.image_utils [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85722) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 02 03:14:35 devstack cinder-volume[85722]: INFO cinder.keymgr.migration [None req-d229f582-639d-4274-bf37-8d47edb35310 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 02 03:14:35 devstack cinder-volume[85722]: DEBUG oslo_concurrency.lockutils [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:14:35 devstack cinder-volume[85722]: DEBUG oslo_concurrency.lockutils [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:14:35 devstack cinder-volume[85722]: DEBUG cinder.volume.drivers.quobyte [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=85722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:14:35 devstack cinder-volume[85722]: DEBUG cinder.volume.drivers.quobyte [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=85722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:14:35 devstack cinder-volume[85722]: DEBUG oslo_concurrency.lockutils [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:14:35 devstack cinder-volume[85722]: DEBUG oslo_concurrency.processutils [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=85722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:14:35 devstack sudo[85832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:14:35 devstack sudo[85832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:14:36 devstack sudo[85832]: pam_unix(sudo:session): session closed for user root Jun 02 03:14:36 devstack cinder-volume[85722]: DEBUG oslo_concurrency.processutils [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.677s {{(pid=85722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:14:36 devstack cinder-volume[85722]: DEBUG cinder.manager [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] Notifying Schedulers of capabilities ... {{(pid=85722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:14:36 devstack cinder-volume[85722]: INFO cinder.volume.manager [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] Driver initialization completed successfully. Jun 02 03:14:36 devstack cinder-volume[85722]: INFO cinder.manager [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] Initiating service 3 cleanup Jun 02 03:14:36 devstack cinder-volume[85722]: INFO cinder.manager [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] Service 3 cleanup completed. Jun 02 03:14:36 devstack cinder-volume[85722]: DEBUG cinder.service [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] Creating RPC server for service cinder-volume {{(pid=85722) start /opt/stack/cinder/cinder/service.py:231}} Jun 02 03:14:36 devstack cinder-volume[85722]: DEBUG cinder.service [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85722) start /opt/stack/cinder/cinder/service.py:237}} Jun 02 03:14:36 devstack cinder-volume[85722]: INFO cinder.volume.manager [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 02 03:14:36 devstack cinder-volume[85722]: DEBUG oslo_concurrency.lockutils [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:14:36 devstack cinder-volume[85722]: DEBUG oslo_concurrency.lockutils [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:14:36 devstack cinder-volume[85722]: DEBUG cinder.volume.drivers.quobyte [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=85722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:14:36 devstack cinder-volume[85722]: DEBUG cinder.volume.drivers.quobyte [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=85722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:14:36 devstack cinder-volume[85722]: DEBUG oslo_concurrency.lockutils [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:14:36 devstack cinder-volume[85722]: DEBUG oslo_concurrency.processutils [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=85722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:14:36 devstack sudo[85854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:14:36 devstack sudo[85854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:14:37 devstack sudo[85854]: pam_unix(sudo:session): session closed for user root Jun 02 03:14:37 devstack cinder-volume[85722]: DEBUG oslo_concurrency.processutils [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.801s {{(pid=85722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:14:37 devstack cinder-volume[85722]: INFO cinder.volume.manager [None req-01cee1b8-dd09-4682-bf8e-61ad1381d1d8 None None] Driver post RPC initialization completed successfully. Jun 02 03:14:40 devstack cinder-volume[85722]: DEBUG oslo_concurrency.lockutils [None req-8f6235ea-760f-407f-abff-067ce74ed0c8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:14:40 devstack cinder-volume[85722]: DEBUG oslo_concurrency.lockutils [None req-8f6235ea-760f-407f-abff-067ce74ed0c8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:14:40 devstack cinder-volume[85722]: DEBUG cinder.volume.drivers.quobyte [None req-8f6235ea-760f-407f-abff-067ce74ed0c8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=85722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:14:40 devstack cinder-volume[85722]: DEBUG cinder.volume.drivers.quobyte [None req-8f6235ea-760f-407f-abff-067ce74ed0c8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=85722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:14:40 devstack cinder-volume[85722]: DEBUG oslo_concurrency.lockutils [None req-8f6235ea-760f-407f-abff-067ce74ed0c8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:14:40 devstack cinder-volume[85722]: DEBUG oslo_concurrency.processutils [None req-8f6235ea-760f-407f-abff-067ce74ed0c8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=85722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:14:40 devstack sudo[86041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:14:40 devstack sudo[86041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:14:41 devstack sudo[86041]: pam_unix(sudo:session): session closed for user root Jun 02 03:14:41 devstack cinder-volume[85722]: DEBUG oslo_concurrency.processutils [None req-8f6235ea-760f-407f-abff-067ce74ed0c8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.574s {{(pid=85722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:14:41 devstack cinder-volume[85722]: DEBUG cinder.manager [None req-8f6235ea-760f-407f-abff-067ce74ed0c8 None None] Notifying Schedulers of capabilities ... {{(pid=85722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:14:43 devstack cinder-volume[85464]: DEBUG dbcounter [-] [85464] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=85464) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:14:44 devstack cinder-volume[85464]: INFO oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] Caught SIGTERM, stopping children Jun 02 03:14:44 devstack cinder-volume[85464]: DEBUG oslo_concurrency.lockutils [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] Acquiring lock "singleton_lock" {{(pid=85464) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 02 03:14:44 devstack cinder-volume[85464]: DEBUG oslo_concurrency.lockutils [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] Acquired lock "singleton_lock" {{(pid=85464) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 02 03:14:44 devstack cinder-volume[85464]: DEBUG oslo_concurrency.lockutils [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] Releasing lock "singleton_lock" {{(pid=85464) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 02 03:14:44 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] Stop services. {{(pid=85464) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 02 03:14:44 devstack cinder-volume[85464]: DEBUG oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] Killing children. {{(pid=85464) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 02 03:14:44 devstack cinder-volume[85464]: INFO oslo_service.backend._eventlet.service [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] Waiting on 1 children to exit Jun 02 03:14:47 devstack cinder-volume[85722]: DEBUG dbcounter [-] [85722] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=85722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:14:47 devstack cinder-volume[85722]: DEBUG dbcounter [-] [85722] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=85722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:14:48 devstack cinder-volume[85722]: DEBUG oslo_service.periodic_task [None req-eebb71e8-a0bd-4c02-af53-3ca83a3e30e7 None None] Running periodic task VolumeManager._thread_info {{(pid=85722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:14:48 devstack cinder-volume[85722]: DEBUG cinder.volume.manager [None req-eebb71e8-a0bd-4c02-af53-3ca83a3e30e7 None None] thread count: 6 {{(pid=85722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 02 03:14:48 devstack cinder-volume[85722]: DEBUG cinder.volume.manager [None req-eebb71e8-a0bd-4c02-af53-3ca83a3e30e7 None None] thread info: [<_MainThread(MainThread, started 129682517561472)>, , , , , ] {{(pid=85722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 02 03:14:49 devstack cinder-volume[85722]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jun 02 03:14:49 devstack cinder-volume[85722]: DEBUG oslo_concurrency.lockutils [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] Acquiring lock "singleton_lock" {{(pid=85722) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 02 03:14:49 devstack cinder-volume[85722]: DEBUG oslo_concurrency.lockutils [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] Acquired lock "singleton_lock" {{(pid=85722) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 02 03:14:49 devstack cinder-volume[85722]: DEBUG oslo_concurrency.lockutils [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] Releasing lock "singleton_lock" {{(pid=85722) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 02 03:14:49 devstack cinder-volume[85722]: WARNING amqp [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 02 03:14:49 devstack cinder-volume[85722]: WARNING amqp [None req-ea0dd37b-a53c-42ba-9485-a05f83604264 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 02 03:14:52 devstack cinder-volume[86186]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86186) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 02 03:14:52 devstack cinder-volume[86186]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86186) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 02 03:14:52 devstack cinder-volume[86186]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86186) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 02 03:14:52 devstack cinder-volume[86186]: INFO dbcounter [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] Registered counter for database cinder Jun 02 03:14:52 devstack cinder-volume[86186]: DEBUG oslo_db.sqlalchemy.engines [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86186) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG dbcounter [-] [86186] Writer thread running {{(pid=86186) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 02 03:14:53 devstack cinder-volume[86186]: INFO cinder.rpc [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 02 03:14:53 devstack cinder-volume[86186]: INFO cinder.rpc [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_db.sqlalchemy.engines [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86186) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 03:14:53 devstack cinder-volume[86186]: INFO cinder.volume.manager [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] Determined volume DB was empty at startup. Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG cinder.volume.manager [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86186) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 02 03:14:53 devstack cinder-volume[86186]: WARNING stevedore.named [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 02 03:14:53 devstack cinder-volume[86186]: WARNING castellan.key_manager [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 02 03:14:53 devstack cinder-volume[86186]: WARNING cinder.keymgr.conf_key_mgr [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 02 03:14:53 devstack cinder-volume[86186]: INFO cinder.volume.manager [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_db.sqlalchemy.engines [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86186) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 03:14:53 devstack cinder-volume[86186]: INFO oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] Starting 1 workers Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] Started child 86431 {{(pid=86186) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] Full set of CONF: {{(pid=86186) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] ******************************************************************************** {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] Configuration options gathered from: {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] ================================================================================ {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] allow_availability_zone_fallback = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86431]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] allow_compression_on_image_upload = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] allowed_direct_url_schemes = [] {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] api_rate_limit = True {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] auth_strategy = keystone {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_availability_zone = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_host = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_name = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_stats_polling_interval = 60 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backup_api_class = cinder.backup.api.API {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backup_name_template = backup-%s {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backup_use_same_host = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backup_use_temp_snapshot = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] chap_password = **** {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] chap_username = {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cinder_internal_tenant_project_id = 8af4d4b0459943c2a887a5e63954d990 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cinder_internal_tenant_user_id = 3b99c609f909486ea73958d33a877273 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cluster = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] compression_format = gzip {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] compute_api_class = cinder.compute.nova.API {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] config_dir = [] {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] config_source = [] {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] control_exchange = openstack {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] debug = True {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] default_availability_zone = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] default_group_type = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] default_volume_type = QuobyteHD {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] disk_geometry = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] driver_client_cert = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] driver_client_cert_key = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] driver_data_namespace = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] driver_ssl_cert_path = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] driver_ssl_cert_verify = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] driver_use_ssl = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] enable_new_services = True {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] enable_unsupported_driver = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] enabled_backends = ['QuobyteHD'] {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] enforce_multipath_for_image_xfer = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] filter_function = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] glance_api_insecure = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] glance_api_servers = ['http://192.168.122.71/image'] {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] glance_api_ssl_compression = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] glance_ca_certificates_file = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] glance_catalog_info = image:glance:publicURL {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] glance_certfile = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] glance_keyfile = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] glance_num_retries = 3 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] glance_request_timeout = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] goodness_function = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] graceful_shutdown_timeout = 5 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] group_api_class = cinder.group.api.API {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] host = devstack {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] image_compress_on_upload = True {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] image_conversion_address_space_limit = 1 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] image_conversion_cpu_limit = 60 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] image_conversion_disable = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] image_upload_use_cinder_backend = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] image_upload_use_internal_tenant = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] image_volume_cache_enabled = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] image_volume_cache_max_count = 0 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] image_volume_cache_max_size_gb = 0 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] init_host_max_objects_retrieval = 0 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] instance_format = [instance: %(uuid)s] {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] iscsi_target_flags = {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] iscsi_write_cache = on {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] iser_helper = tgtadm {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] iser_ip_address = 192.168.122.71 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] iser_port = 3260 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] log_color = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] log_config_append = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] log_dir = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] log_file = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] log_options = True {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] log_rotate_interval = 1 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] log_rotate_interval_type = days {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] log_rotation_type = none {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] max_age = 0 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] max_logfile_count = 30 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] max_logfile_size_mb = 200 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] max_over_subscription_ratio = 20.0 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] message_reap_interval = 86400 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] message_ttl = 2592000 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] migration_create_volume_timeout_secs = 300 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] monkey_patch = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] monkey_patch_modules = [] {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] Starting volume driver QuobyteDriver (1.1.14) Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] my_ip = 192.168.122.71 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86431) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] no_snapshot_gb_quota = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] num_iser_scan_tries = 3 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] num_shell_tries = 3 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] num_volume_device_scan_tries = 3 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] nvmeof_conn_info_version = 1 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] nvmet_ns_id = 10 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] nvmet_port_id = 1 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] osapi_max_limit = 1000 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] osapi_volume_ext_list = [] {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] osapi_volume_listen_port = 8776 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] osapi_volume_use_ssl = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] osapi_volume_workers = 2 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] per_volume_size_limit = -1 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] periodic_fuzzy_delay = 60 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] periodic_interval = 60 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] public_endpoint = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] publish_errors = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] quota_backup_gigabytes = 1000 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] quota_backups = 10 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] quota_gigabytes = 1000 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] quota_groups = 10 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] quota_snapshots = 10 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] quota_volumes = 10 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] rate_limit_burst = 0 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] rate_limit_except_level = CRITICAL {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] rate_limit_interval = 0 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] reinit_driver_count = 3 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] replication_device = **** {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] report_discard_supported = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] report_interval = 120 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] reservation_clean_interval = 86400 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] reservation_expire = 86400 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] reserved_image_namespaces = [] {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] reserved_percentage = 0 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] rpc_response_timeout = 120 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] run_external_periodic_tasks = True {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] scst_target_driver = iscsi {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] scst_target_iqn_name = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] service_down_time = 720 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] shell_completion = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] snapshot_name_template = snapshot-%s {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] split_loggers = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] state_path = /opt/stack/data/cinder {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] storage_availability_zone = nova {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] storage_protocol = iSCSI {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] syslog_log_facility = LOG_USER {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] target_helper = lioadm {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] target_ip_address = 192.168.122.71 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] target_port = 3260 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] target_protocol = iscsi {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] target_secondary_ip_addresses = [] {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] trace_flags = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] transport_url = **** {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] until_refresh = 0 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] use_chap_auth = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] use_default_quota_class = True {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] use_journal = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] use_json = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] use_multipath_for_image_xfer = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] use_stderr = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] use_syslog = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] verify_glance_signatures = enabled {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] volume_api_class = cinder.volume.api.API {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] volume_backend_name = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] volume_clear = zero {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] volume_clear_ionice = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] volume_clear_size = 0 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] volume_copy_bps_limit = 0 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] volume_dd_blocksize = 1M {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] volume_name_template = volume-%s {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] volume_service_inithost_offload = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] volume_usage_audit_period = month {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] zoning_mode = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_concurrency.disable_process_locking = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.admin_password = **** {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.admin_token = **** {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.admin_user = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.auth_admin_prefix = {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.auth_port = 35357 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.auth_protocol = https {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.auth_section = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.auth_type = password {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.auth_uri = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.auth_version = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.cache = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.certfile = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.identity_uri = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.include_service_catalog = True {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.insecure = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.interface = public {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.keyfile = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.memcache_password = {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.memcache_username = {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.region_name = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.service_token_roles_required = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.service_type = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.71/identity {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.backend = dogpile.cache.null {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.backend_argument = **** {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.backend_expiration_time = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.config_prefix = cache.oslo {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.debug_cache_backend = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.enable_retry_client = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.enable_socket_keepalive = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.enabled = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.enforce_fips_mode = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.expiration_time = 600 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.hashclient_retry_attempts = 2 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.memcache_dead_retry = 300 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.memcache_pool_maxsize = 10 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.memcache_sasl_enabled = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.password = **** {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.proxies = [] {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.redis_db = 0 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.redis_server = localhost:6379 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.retry_attempts = 2 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.retry_delay = 0.0 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.socket_keepalive_count = 1 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.socket_keepalive_idle = 1 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.socket_keepalive_interval = 1 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.socket_timeout = 1.0 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.tls_allowed_ciphers = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.tls_cafile = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.tls_certfile = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.tls_enabled = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.tls_keyfile = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cache.username = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] database.asyncio_connection = **** {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] database.asyncio_slave_connection = **** {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] database.backend = sqlalchemy {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] database.connection = **** {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] database.connection_debug = 0 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] database.connection_parameters = {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] database.connection_recycle_time = 3600 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] database.connection_trace = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] database.db_inc_retry_interval = True {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] database.db_max_retries = 20 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] database.db_max_retry_interval = 10 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] database.db_retry_interval = 1 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] database.max_overflow = 50 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] database.max_pool_size = 5 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] database.max_retries = 10 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] database.mysql_wsrep_sync_wait = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] database.pool_timeout = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] database.retry_interval = 10 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] database.slave_connection = **** {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] database.sqlite_synchronous = True {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] database.synchronous_reader = True {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] database.use_db_reconnect = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] profiler.connection_string = messaging:// {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] profiler.enabled = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] profiler.es_doc_type = notification {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] profiler.es_scroll_size = 10000 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] profiler.es_scroll_time = 2m {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] profiler.filter_error_trace = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] profiler.hmac_keys = **** {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86431) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 02 03:14:53 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.quobyte [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 02 03:14:53 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.quobyte [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 02 03:14:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] Running cmd (subprocess): mount.quobyte {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] profiler.sentinel_service_name = mymaster {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] profiler.socket_timeout = 0.1 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] profiler.trace_requests = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] profiler.trace_sqlalchemy = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] profiler_jaeger.process_tags = {} {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] profiler_jaeger.service_name_prefix = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] profiler_otlp.service_name_prefix = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_policy.enforce_new_defaults = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: WARNING oslo_config.cfg [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_policy.enforce_scope = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_policy.policy_default_rule = default {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_policy.policy_file = policy.yaml {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] coordination.backend_url = **** {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] privsep_osbrick.group = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] privsep_osbrick.helper_command = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] privsep_osbrick.user = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cinder_sys_admin.group = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cinder_sys_admin.helper_command = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] cinder_sys_admin.user = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] service_user.auth_section = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] service_user.auth_type = password {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] service_user.cafile = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] service_user.certfile = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] service_user.collect_timing = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] service_user.insecure = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] service_user.keyfile = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] service_user.send_service_user_token = True {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] service_user.split_loggers = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] service_user.timeout = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] glance.auth_section = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] glance.auth_type = password {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] glance.certfile = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] glance.collect_timing = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] glance.insecure = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] glance.keyfile = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] glance.region_name = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] glance.split_loggers = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] glance.timeout = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.backend_availability_zone = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.chap_password = **** {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.chap_username = {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.disk_geometry = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.driver_client_cert = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.driver_client_cert_key = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.driver_data_namespace = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.driver_use_ssl = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.extra_capabilities = {} {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.filter_function = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.goodness_function = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.iscsi_target_flags = {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.iscsi_write_cache = on {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.iser_helper = tgtadm {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.iser_ip_address = 192.168.122.71 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.iser_port = 3260 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.nas_host = {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.nas_login = admin {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.nas_mount_options = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.nas_password = **** {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.nas_private_key = {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.nas_share_path = {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.num_shell_tries = 3 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.quobyte_volume_url = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.replication_device = **** {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.report_discard_supported = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.reserved_percentage = 0 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.target_helper = tgtadm {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.target_ip_address = 192.168.122.71 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.target_port = 3260 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.target_protocol = iscsi {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.trace_flags = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.unique_fqdn_network = True {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.use_chap_auth = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.volume_backend_name = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack quobyte-client[86438]: Reading configuration file: /etc/quobyte/client.cfg Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.volume_clear = zero {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.volume_clear_ionice = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.volume_clear_size = 0 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack quobyte-client[86438]: Invalid parameters found, error: missing mount point. Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_reports.file_event_handler = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_reports.log_dir = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack quobyte-client[86438]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 02 03:14:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] CMD "mount.quobyte" returned: 1 in 0.059s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:14:53 devstack quobyte-client[86438]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.backend_availability_zone = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.backend_host = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:14:53 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.chap_password = **** {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.chap_username = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.chiscsi_conf = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.disk_geometry = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.driver_client_cert = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.driver_data_namespace = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.driver_use_ssl = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.extra_capabilities = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.filter_function = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.goodness_function = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.iser_helper = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.iser_ip_address = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.iser_port = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.iser_target_prefix = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.nas_host = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.nas_login = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.nas_mount_options = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.nas_password = **** {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.nas_private_key = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.nas_share_path = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.nas_ssh_port = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.num_shell_tries = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.nvmet_port_id = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.replication_device = **** {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.report_discard_supported = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.reserved_percentage = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.scst_target_driver = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.storage_protocol = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.target_helper = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.target_ip_address = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.target_port = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.target_prefix = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.target_protocol = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.trace_flags = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.use_chap_auth = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.volume_clear = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.volume_clear_size = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] QuobyteHD.volumes_dir = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.ssl = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_notifications.driver = [] {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_notifications.retry = -1 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] key_manager.fixed_key = **** {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] barbican.barbican_api_version = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] barbican.barbican_endpoint = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] barbican.barbican_endpoint_type = public {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] barbican.barbican_region_name = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] barbican.cafile = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] barbican.certfile = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] barbican.collect_timing = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] barbican.insecure = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] barbican.keyfile = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] barbican.number_of_retries = 60 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] barbican.retry_delay = 1 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] barbican.send_service_user_token = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] barbican.split_loggers = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] barbican.timeout = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] barbican.verify_ssl = True {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] barbican.verify_ssl_path = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] barbican_service_user.auth_section = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] barbican_service_user.auth_type = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] barbican_service_user.cafile = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] barbican_service_user.certfile = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] barbican_service_user.collect_timing = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] barbican_service_user.insecure = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] barbican_service_user.keyfile = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] barbican_service_user.split_loggers = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] barbican_service_user.timeout = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] vault.approle_role_id = **** {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] vault.approle_secret_id = **** {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] vault.kv_mountpoint = secret {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] vault.kv_path = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] vault.kv_version = 2 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] vault.namespace = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] vault.root_token_id = **** {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] vault.ssl_ca_crt_file = None {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] vault.timeout = 60.0 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] vault.use_ssl = False {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack sudo[86439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 02 03:14:53 devstack cinder-volume[86186]: DEBUG oslo_service.backend._eventlet.service [None req-ca13d72f-c90f-4b14-9549-91289ae5e045 None None] ******************************************************************************** {{(pid=86186) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 02 03:14:53 devstack sudo[86439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:14:54 devstack sudo[86439]: pam_unix(sudo:session): session closed for user root Jun 02 03:14:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.611s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:14:54 devstack cinder-volume[86431]: INFO cinder.volume.driver [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] Driver hasn't implemented _init_vendor_properties() Jun 02 03:14:54 devstack cinder-volume[86431]: DEBUG cinder.volume.driver [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579956054688, 'free_capacity_gb': 1775.7579956054688, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86431) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 02 03:14:54 devstack cinder-volume[86431]: DEBUG oslo_db.sqlalchemy.engines [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86431) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 02 03:14:54 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writer thread running {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 02 03:14:54 devstack cinder-volume[86431]: DEBUG cinder.db.sqlalchemy.api [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] Building query based on filter {{(pid=86431) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3944}} Jun 02 03:14:54 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86431) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 02 03:14:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:14:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:14:54 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:14:54 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:14:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:14:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:14:54 devstack cinder-volume[86431]: INFO cinder.keymgr.migration [None req-37a33172-4c77-4b64-9980-24bd3529da91 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 02 03:14:54 devstack sudo[86447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:14:54 devstack sudo[86447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:14:54 devstack sudo[86447]: pam_unix(sudo:session): session closed for user root Jun 02 03:14:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.599s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:14:54 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:14:54 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] Driver initialization completed successfully. Jun 02 03:14:54 devstack cinder-volume[86431]: INFO cinder.manager [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] Initiating service 3 cleanup Jun 02 03:14:54 devstack cinder-volume[86431]: INFO cinder.manager [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] Service 3 cleanup completed. Jun 02 03:14:54 devstack cinder-volume[86431]: DEBUG cinder.service [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] Creating RPC server for service cinder-volume {{(pid=86431) start /opt/stack/cinder/cinder/service.py:231}} Jun 02 03:14:54 devstack cinder-volume[86431]: DEBUG cinder.service [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86431) start /opt/stack/cinder/cinder/service.py:237}} Jun 02 03:14:54 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 02 03:14:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:14:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:14:54 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:14:54 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:14:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:14:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:14:54 devstack sudo[86478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:14:54 devstack sudo[86478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:14:55 devstack sudo[86478]: pam_unix(sudo:session): session closed for user root Jun 02 03:14:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.596s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:14:55 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-010e13c7-f081-48c5-9449-1bca38e4c35b None None] Driver post RPC initialization completed successfully. Jun 02 03:15:03 devstack cinder-volume[86186]: DEBUG dbcounter [-] [86186] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86186) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:15:04 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:15:05 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=2 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:15:09 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager._thread_info {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:15:09 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread count: 6 {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 02 03:15:09 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread info: [<_MainThread(MainThread, started 138618128814208)>, , , , , ] {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 02 03:16:09 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:16:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:16:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:16:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:16:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:16:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:16:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:16:09 devstack sudo[86849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:16:09 devstack sudo[86849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:16:10 devstack sudo[86849]: pam_unix(sudo:session): session closed for user root Jun 02 03:16:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 1.370s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:16:10 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:16:10 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager._thread_info {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:16:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread count: 6 {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 02 03:16:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread info: [<_MainThread(MainThread, started 138618128814208)>, , , , , ] {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 02 03:16:14 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-96c01207-c42a-450b-8483-c118676b712a tempest-DeleteServersTestJSON-1379900396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:16:14 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-96c01207-c42a-450b-8483-c118676b712a tempest-DeleteServersTestJSON-1379900396 None] Flow 'volume_create_manager' (48718a1e-43d1-41c5-b0f7-5578119df8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:16:14 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-96c01207-c42a-450b-8483-c118676b712a tempest-DeleteServersTestJSON-1379900396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a415e66e-c439-44dc-b5cf-fe9010c16be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:16:14 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-96c01207-c42a-450b-8483-c118676b712a tempest-DeleteServersTestJSON-1379900396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a415e66e-c439-44dc-b5cf-fe9010c16be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-70550793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92b8bbbb-4159-410a-bb8e-2e3594a8b686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62ad5572d32a4ceab7edf52b4ae43362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:16:14Z,use_quota=True,user_id='e273e842820e4b71b479a89620975ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:16:14 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-96c01207-c42a-450b-8483-c118676b712a tempest-DeleteServersTestJSON-1379900396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14b99a7c-7461-45a9-ae32-c1e08d525839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:16:14 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-96c01207-c42a-450b-8483-c118676b712a tempest-DeleteServersTestJSON-1379900396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14b99a7c-7461-45a9-ae32-c1e08d525839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:16:14 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-96c01207-c42a-450b-8483-c118676b712a tempest-DeleteServersTestJSON-1379900396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d59c14de-e41c-40cb-b499-05c5bb04e7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:16:14 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-96c01207-c42a-450b-8483-c118676b712a tempest-DeleteServersTestJSON-1379900396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d59c14de-e41c-40cb-b499-05c5bb04e7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92b8bbbb-4159-410a-bb8e-2e3594a8b686', 'volume_name': 'volume-92b8bbbb-4159-410a-bb8e-2e3594a8b686', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:16:14 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-96c01207-c42a-450b-8483-c118676b712a tempest-DeleteServersTestJSON-1379900396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb1a88c-9742-4c2e-8de7-f58b0c5cfe4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:16:14 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-96c01207-c42a-450b-8483-c118676b712a tempest-DeleteServersTestJSON-1379900396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb1a88c-9742-4c2e-8de7-f58b0c5cfe4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:16:14 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-96c01207-c42a-450b-8483-c118676b712a tempest-DeleteServersTestJSON-1379900396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be1354fe-1f0c-4ab1-9b75-2fb40a103327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:16:14 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-96c01207-c42a-450b-8483-c118676b712a tempest-DeleteServersTestJSON-1379900396 None] Volume 92b8bbbb-4159-410a-bb8e-2e3594a8b686: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92b8bbbb-4159-410a-bb8e-2e3594a8b686', 'volume_size': 1} Jun 02 03:16:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-96c01207-c42a-450b-8483-c118676b712a tempest-DeleteServersTestJSON-1379900396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:16:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-96c01207-c42a-450b-8483-c118676b712a tempest-DeleteServersTestJSON-1379900396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:16:14 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-96c01207-c42a-450b-8483-c118676b712a tempest-DeleteServersTestJSON-1379900396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:16:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-70550793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92b8bbbb-4159-410a-bb8e-2e3594a8b686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62ad5572d32a4ceab7edf52b4ae43362',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:16:14Z,use_quota=True,user_id='e273e842820e4b71b479a89620975ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:16:14 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-96c01207-c42a-450b-8483-c118676b712a tempest-DeleteServersTestJSON-1379900396 None] Creating volume 92b8bbbb-4159-410a-bb8e-2e3594a8b686 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:16:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-96c01207-c42a-450b-8483-c118676b712a tempest-DeleteServersTestJSON-1379900396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:16:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-96c01207-c42a-450b-8483-c118676b712a tempest-DeleteServersTestJSON-1379900396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:16:14 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-96c01207-c42a-450b-8483-c118676b712a tempest-DeleteServersTestJSON-1379900396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:16:14 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-96c01207-c42a-450b-8483-c118676b712a tempest-DeleteServersTestJSON-1379900396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:16:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-96c01207-c42a-450b-8483-c118676b712a tempest-DeleteServersTestJSON-1379900396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:16:14 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-96c01207-c42a-450b-8483-c118676b712a tempest-DeleteServersTestJSON-1379900396 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:16:14 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-96c01207-c42a-450b-8483-c118676b712a tempest-DeleteServersTestJSON-1379900396 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:16:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-96c01207-c42a-450b-8483-c118676b712a tempest-DeleteServersTestJSON-1379900396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-92b8bbbb-4159-410a-bb8e-2e3594a8b686 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:16:14 devstack sudo[86960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-92b8bbbb-4159-410a-bb8e-2e3594a8b686 1073741824 Jun 02 03:16:14 devstack sudo[86960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:16:16 devstack sudo[86960]: pam_unix(sudo:session): session closed for user root Jun 02 03:16:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-96c01207-c42a-450b-8483-c118676b712a tempest-DeleteServersTestJSON-1379900396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-92b8bbbb-4159-410a-bb8e-2e3594a8b686 1073741824" returned: 0 in 1.898s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:16:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-96c01207-c42a-450b-8483-c118676b712a tempest-DeleteServersTestJSON-1379900396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-92b8bbbb-4159-410a-bb8e-2e3594a8b686 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:16:16 devstack sudo[87280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-92b8bbbb-4159-410a-bb8e-2e3594a8b686 Jun 02 03:16:16 devstack sudo[87280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:16:17 devstack sudo[87280]: pam_unix(sudo:session): session closed for user root Jun 02 03:16:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-96c01207-c42a-450b-8483-c118676b712a tempest-DeleteServersTestJSON-1379900396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-92b8bbbb-4159-410a-bb8e-2e3594a8b686" returned: 0 in 1.411s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:16:17 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-96c01207-c42a-450b-8483-c118676b712a tempest-DeleteServersTestJSON-1379900396 None] <== create_volume: return (3415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:16:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-96c01207-c42a-450b-8483-c118676b712a tempest-DeleteServersTestJSON-1379900396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.422s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:16:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-96c01207-c42a-450b-8483-c118676b712a tempest-DeleteServersTestJSON-1379900396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be1354fe-1f0c-4ab1-9b75-2fb40a103327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92b8bbbb-4159-410a-bb8e-2e3594a8b686', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:16:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-96c01207-c42a-450b-8483-c118676b712a tempest-DeleteServersTestJSON-1379900396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165a63dc-5337-4e10-a3f1-c97fc65584b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:16:18 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-96c01207-c42a-450b-8483-c118676b712a tempest-DeleteServersTestJSON-1379900396 None] Volume volume-92b8bbbb-4159-410a-bb8e-2e3594a8b686 (92b8bbbb-4159-410a-bb8e-2e3594a8b686): created successfully Jun 02 03:16:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-96c01207-c42a-450b-8483-c118676b712a tempest-DeleteServersTestJSON-1379900396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165a63dc-5337-4e10-a3f1-c97fc65584b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:16:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-96c01207-c42a-450b-8483-c118676b712a tempest-DeleteServersTestJSON-1379900396 None] Flow 'volume_create_manager' (48718a1e-43d1-41c5-b0f7-5578119df8b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:16:18 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-96c01207-c42a-450b-8483-c118676b712a tempest-DeleteServersTestJSON-1379900396 None] Created volume successfully. Jun 02 03:16:20 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-098ee30e-d67c-44bf-acc5-056770862630 tempest-VolumesAdminNegativeTest-620704033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:16:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-098ee30e-d67c-44bf-acc5-056770862630 tempest-VolumesAdminNegativeTest-620704033 None] Flow 'volume_create_manager' (ad8b9ba3-bfdd-4f46-a45f-703e239b5f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:16:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-098ee30e-d67c-44bf-acc5-056770862630 tempest-VolumesAdminNegativeTest-620704033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00f31234-22a4-461f-9426-800f49ad066a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:16:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-098ee30e-d67c-44bf-acc5-056770862630 tempest-VolumesAdminNegativeTest-620704033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00f31234-22a4-461f-9426-800f49ad066a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1033333540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9964588-4b95-4484-9516-a07b8567a137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4822141f4b684969b91d1702ee8afb0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:16:20Z,use_quota=True,user_id='c6f87fb82b4f41d99979b573845a19d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:16:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-098ee30e-d67c-44bf-acc5-056770862630 tempest-VolumesAdminNegativeTest-620704033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f49c8f46-ad6a-45ad-88f8-cb2680ca4246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:16:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-098ee30e-d67c-44bf-acc5-056770862630 tempest-VolumesAdminNegativeTest-620704033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f49c8f46-ad6a-45ad-88f8-cb2680ca4246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:16:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-098ee30e-d67c-44bf-acc5-056770862630 tempest-VolumesAdminNegativeTest-620704033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8b95ecb-834d-4554-b024-c1dc36cb61e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:16:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-098ee30e-d67c-44bf-acc5-056770862630 tempest-VolumesAdminNegativeTest-620704033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8b95ecb-834d-4554-b024-c1dc36cb61e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9964588-4b95-4484-9516-a07b8567a137', 'volume_name': 'volume-f9964588-4b95-4484-9516-a07b8567a137', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:16:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-098ee30e-d67c-44bf-acc5-056770862630 tempest-VolumesAdminNegativeTest-620704033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb600682-0895-4987-8a00-cde43e629748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:16:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-098ee30e-d67c-44bf-acc5-056770862630 tempest-VolumesAdminNegativeTest-620704033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb600682-0895-4987-8a00-cde43e629748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:16:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-098ee30e-d67c-44bf-acc5-056770862630 tempest-VolumesAdminNegativeTest-620704033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c391189-2b0f-466d-8226-57eb6ef71d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:16:20 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-098ee30e-d67c-44bf-acc5-056770862630 tempest-VolumesAdminNegativeTest-620704033 None] Volume f9964588-4b95-4484-9516-a07b8567a137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9964588-4b95-4484-9516-a07b8567a137', 'volume_size': 1} Jun 02 03:16:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-098ee30e-d67c-44bf-acc5-056770862630 tempest-VolumesAdminNegativeTest-620704033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:16:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-098ee30e-d67c-44bf-acc5-056770862630 tempest-VolumesAdminNegativeTest-620704033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:16:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-098ee30e-d67c-44bf-acc5-056770862630 tempest-VolumesAdminNegativeTest-620704033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1033333540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9964588-4b95-4484-9516-a07b8567a137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4822141f4b684969b91d1702ee8afb0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:16:20Z,use_quota=True,user_id='c6f87fb82b4f41d99979b573845a19d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:16:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-098ee30e-d67c-44bf-acc5-056770862630 tempest-VolumesAdminNegativeTest-620704033 None] Creating volume f9964588-4b95-4484-9516-a07b8567a137 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:16:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-098ee30e-d67c-44bf-acc5-056770862630 tempest-VolumesAdminNegativeTest-620704033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:16:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-098ee30e-d67c-44bf-acc5-056770862630 tempest-VolumesAdminNegativeTest-620704033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:16:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-098ee30e-d67c-44bf-acc5-056770862630 tempest-VolumesAdminNegativeTest-620704033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:16:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-098ee30e-d67c-44bf-acc5-056770862630 tempest-VolumesAdminNegativeTest-620704033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:16:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-098ee30e-d67c-44bf-acc5-056770862630 tempest-VolumesAdminNegativeTest-620704033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:16:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-098ee30e-d67c-44bf-acc5-056770862630 tempest-VolumesAdminNegativeTest-620704033 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:16:20 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-098ee30e-d67c-44bf-acc5-056770862630 tempest-VolumesAdminNegativeTest-620704033 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:16:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-098ee30e-d67c-44bf-acc5-056770862630 tempest-VolumesAdminNegativeTest-620704033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f9964588-4b95-4484-9516-a07b8567a137 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:16:20 devstack sudo[87300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f9964588-4b95-4484-9516-a07b8567a137 1073741824 Jun 02 03:16:20 devstack sudo[87300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:16:22 devstack sudo[87300]: pam_unix(sudo:session): session closed for user root Jun 02 03:16:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-098ee30e-d67c-44bf-acc5-056770862630 tempest-VolumesAdminNegativeTest-620704033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f9964588-4b95-4484-9516-a07b8567a137 1073741824" returned: 0 in 2.116s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:16:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-098ee30e-d67c-44bf-acc5-056770862630 tempest-VolumesAdminNegativeTest-620704033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f9964588-4b95-4484-9516-a07b8567a137 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:16:23 devstack sudo[87342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f9964588-4b95-4484-9516-a07b8567a137 Jun 02 03:16:23 devstack sudo[87342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:16:24 devstack sudo[87342]: pam_unix(sudo:session): session closed for user root Jun 02 03:16:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-098ee30e-d67c-44bf-acc5-056770862630 tempest-VolumesAdminNegativeTest-620704033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f9964588-4b95-4484-9516-a07b8567a137" returned: 0 in 1.455s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:16:24 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-098ee30e-d67c-44bf-acc5-056770862630 tempest-VolumesAdminNegativeTest-620704033 None] <== create_volume: return (3689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:16:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-098ee30e-d67c-44bf-acc5-056770862630 tempest-VolumesAdminNegativeTest-620704033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.697s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:16:24 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-098ee30e-d67c-44bf-acc5-056770862630 tempest-VolumesAdminNegativeTest-620704033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c391189-2b0f-466d-8226-57eb6ef71d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9964588-4b95-4484-9516-a07b8567a137', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:16:24 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-098ee30e-d67c-44bf-acc5-056770862630 tempest-VolumesAdminNegativeTest-620704033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe4e345f-7eb7-4c68-ac10-32c19e4d3915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:16:24 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-098ee30e-d67c-44bf-acc5-056770862630 tempest-VolumesAdminNegativeTest-620704033 None] Volume volume-f9964588-4b95-4484-9516-a07b8567a137 (f9964588-4b95-4484-9516-a07b8567a137): created successfully Jun 02 03:16:24 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-098ee30e-d67c-44bf-acc5-056770862630 tempest-VolumesAdminNegativeTest-620704033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe4e345f-7eb7-4c68-ac10-32c19e4d3915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:16:24 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-098ee30e-d67c-44bf-acc5-056770862630 tempest-VolumesAdminNegativeTest-620704033 None] Flow 'volume_create_manager' (ad8b9ba3-bfdd-4f46-a45f-703e239b5f52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:16:24 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-098ee30e-d67c-44bf-acc5-056770862630 tempest-VolumesAdminNegativeTest-620704033 None] Created volume successfully. Jun 02 03:16:26 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6708a105-84bf-4b06-80a5-21bc8d0fa15d tempest-VolumesAdminNegativeTest-620704033 None] Acquiring lock "cinder-f9964588-4b95-4484-9516-a07b8567a137-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:16:26 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6708a105-84bf-4b06-80a5-21bc8d0fa15d tempest-VolumesAdminNegativeTest-620704033 None] Lock "cinder-f9964588-4b95-4484-9516-a07b8567a137-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:16:26 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6708a105-84bf-4b06-80a5-21bc8d0fa15d tempest-VolumesAdminNegativeTest-620704033 None] Acquiring lock "cinder-quobyte-f9964588-4b95-4484-9516-a07b8567a137" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:16:26 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6708a105-84bf-4b06-80a5-21bc8d0fa15d tempest-VolumesAdminNegativeTest-620704033 None] Lock "cinder-quobyte-f9964588-4b95-4484-9516-a07b8567a137" acquired by "delete_volume" :: waited 0.041s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:16:26 devstack cinder-volume[86431]: INFO oslo.privsep.daemon [None req-6708a105-84bf-4b06-80a5-21bc8d0fa15d tempest-VolumesAdminNegativeTest-620704033 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp4ev0ds8a/privsep.sock'] Jun 02 03:16:26 devstack sudo[87355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp4ev0ds8a/privsep.sock Jun 02 03:16:26 devstack sudo[87355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:16:28 devstack cinder-volume[86431]: WARNING py.warnings [req-89f9a0b3-0f49-4ef8-aa23-7279daed18e4 req-f092fa62-c209-4f84-ad72-2c5b360550ca tempest-DeleteServersTestJSON-1379900396 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jun 02 03:16:28 devstack cinder-volume[86431]: .first() Jun 02 03:16:28 devstack cinder-volume[86431]: Jun 02 03:16:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-89f9a0b3-0f49-4ef8-aa23-7279daed18e4 req-f092fa62-c209-4f84-ad72-2c5b360550ca tempest-DeleteServersTestJSON-1379900396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:16:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-89f9a0b3-0f49-4ef8-aa23-7279daed18e4 req-f092fa62-c209-4f84-ad72-2c5b360550ca tempest-DeleteServersTestJSON-1379900396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:16:29 devstack sudo[87355]: pam_unix(sudo:session): session closed for user root Jun 02 03:16:29 devstack cinder-volume[86431]: INFO oslo.privsep.daemon [None req-6708a105-84bf-4b06-80a5-21bc8d0fa15d tempest-VolumesAdminNegativeTest-620704033 None] Spawned new privsep daemon via rootwrap Jun 02 03:16:29 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [None req-6708a105-84bf-4b06-80a5-21bc8d0fa15d tempest-VolumesAdminNegativeTest-620704033 None] Accepted privsep connection to /tmp/tmp4ev0ds8a/privsep.sock {{(pid=86431) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}} Jun 02 03:16:29 devstack cinder-volume[86431]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 02 03:16:29 devstack cinder-volume[86431]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 02 03:16:29 devstack cinder-volume[86431]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 02 03:16:29 devstack cinder-volume[86431]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87444 Jun 02 03:16:29 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc31c67-5ce2-4bb8-9aa7-ee148dcb047f]: (2,) {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:16:29 devstack cinder-volume[86431]: WARNING oslo_privsep.priv_context [req-89f9a0b3-0f49-4ef8-aa23-7279daed18e4 req-f092fa62-c209-4f84-ad72-2c5b360550ca tempest-DeleteServersTestJSON-1379900396 None] privsep daemon already running Jun 02 03:16:29 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[16dbff8c-76f3-40fe-98bb-c16a918c4f9f]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:16:29 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0d3d46-6843-4efc-8a9d-c688f03feb94]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:16:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6708a105-84bf-4b06-80a5-21bc8d0fa15d tempest-VolumesAdminNegativeTest-620704033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f9964588-4b95-4484-9516-a07b8567a137 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:16:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-89f9a0b3-0f49-4ef8-aa23-7279daed18e4 req-f092fa62-c209-4f84-ad72-2c5b360550ca tempest-DeleteServersTestJSON-1379900396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-92b8bbbb-4159-410a-bb8e-2e3594a8b686 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:16:29 devstack sudo[87450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-92b8bbbb-4159-410a-bb8e-2e3594a8b686 Jun 02 03:16:29 devstack sudo[87450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:16:30 devstack sudo[87449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f9964588-4b95-4484-9516-a07b8567a137 Jun 02 03:16:30 devstack sudo[87449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:16:31 devstack sudo[87450]: pam_unix(sudo:session): session closed for user root Jun 02 03:16:31 devstack sudo[87449]: pam_unix(sudo:session): session closed for user root Jun 02 03:16:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-89f9a0b3-0f49-4ef8-aa23-7279daed18e4 req-f092fa62-c209-4f84-ad72-2c5b360550ca tempest-DeleteServersTestJSON-1379900396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-92b8bbbb-4159-410a-bb8e-2e3594a8b686" returned: 0 in 2.126s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:16:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-89f9a0b3-0f49-4ef8-aa23-7279daed18e4 req-f092fa62-c209-4f84-ad72-2c5b360550ca tempest-DeleteServersTestJSON-1379900396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.232s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:16:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6708a105-84bf-4b06-80a5-21bc8d0fa15d tempest-VolumesAdminNegativeTest-620704033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f9964588-4b95-4484-9516-a07b8567a137" returned: 0 in 2.150s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:16:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6708a105-84bf-4b06-80a5-21bc8d0fa15d tempest-VolumesAdminNegativeTest-620704033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f9964588-4b95-4484-9516-a07b8567a137 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:16:31 devstack sudo[87462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f9964588-4b95-4484-9516-a07b8567a137 Jun 02 03:16:31 devstack sudo[87462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:16:32 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-89f9a0b3-0f49-4ef8-aa23-7279daed18e4 req-f092fa62-c209-4f84-ad72-2c5b360550ca tempest-DeleteServersTestJSON-1379900396 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1', 'name': 'volume-92b8bbbb-4159-410a-bb8e-2e3594a8b686', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2a29117c-ce27-4123-ac87-c5cfc4cf9f8f', 'enforce_multipath': True} {{(pid=86431) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 02 03:16:32 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-89f9a0b3-0f49-4ef8-aa23-7279daed18e4 req-f092fa62-c209-4f84-ad72-2c5b360550ca tempest-DeleteServersTestJSON-1379900396 None] attachment_update completed successfully. Jun 02 03:16:32 devstack sudo[87462]: pam_unix(sudo:session): session closed for user root Jun 02 03:16:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6708a105-84bf-4b06-80a5-21bc8d0fa15d tempest-VolumesAdminNegativeTest-620704033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f9964588-4b95-4484-9516-a07b8567a137" returned: 0 in 1.022s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:16:32 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6708a105-84bf-4b06-80a5-21bc8d0fa15d tempest-VolumesAdminNegativeTest-620704033 None] Lock "cinder-quobyte-f9964588-4b95-4484-9516-a07b8567a137" released by "delete_volume" :: held 6.603s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:16:33 devstack cinder-volume[86431]: WARNING cinder.quota [None req-6708a105-84bf-4b06-80a5-21bc8d0fa15d tempest-VolumesAdminNegativeTest-620704033 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 02 03:16:33 devstack cinder-volume[86431]: WARNING cinder.quota [None req-6708a105-84bf-4b06-80a5-21bc8d0fa15d tempest-VolumesAdminNegativeTest-620704033 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 02 03:16:33 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-6708a105-84bf-4b06-80a5-21bc8d0fa15d tempest-VolumesAdminNegativeTest-620704033 None] Created reservations ['c9f1a3ec-6de9-45a8-8e1a-4938bb95ca88', 'a62b1ecc-6503-4872-8b26-83423c5d9fa0', '08149da0-6705-4287-a2a8-ff193815eb82', '4978073b-433d-4049-8e64-9d2c06c8c3cc'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:16:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6708a105-84bf-4b06-80a5-21bc8d0fa15d tempest-VolumesAdminNegativeTest-620704033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:16:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6708a105-84bf-4b06-80a5-21bc8d0fa15d tempest-VolumesAdminNegativeTest-620704033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:16:33 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6708a105-84bf-4b06-80a5-21bc8d0fa15d tempest-VolumesAdminNegativeTest-620704033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:16:33 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6708a105-84bf-4b06-80a5-21bc8d0fa15d tempest-VolumesAdminNegativeTest-620704033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:16:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6708a105-84bf-4b06-80a5-21bc8d0fa15d tempest-VolumesAdminNegativeTest-620704033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:16:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6708a105-84bf-4b06-80a5-21bc8d0fa15d tempest-VolumesAdminNegativeTest-620704033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:16:33 devstack sudo[87468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:16:33 devstack sudo[87468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:16:35 devstack sudo[87468]: pam_unix(sudo:session): session closed for user root Jun 02 03:16:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6708a105-84bf-4b06-80a5-21bc8d0fa15d tempest-VolumesAdminNegativeTest-620704033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 2.130s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:16:35 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-6708a105-84bf-4b06-80a5-21bc8d0fa15d tempest-VolumesAdminNegativeTest-620704033 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:16:35 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-6708a105-84bf-4b06-80a5-21bc8d0fa15d tempest-VolumesAdminNegativeTest-620704033 None] Deleted volume successfully. Jun 02 03:16:35 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6708a105-84bf-4b06-80a5-21bc8d0fa15d tempest-VolumesAdminNegativeTest-620704033 None] Lock "cinder-f9964588-4b95-4484-9516-a07b8567a137-delete_volume" released by "delete_volume" :: held 9.147s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:16:43 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=17,cinder:INSERT=2,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:16:44 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad305c40-a32f-48ec-896e-e827104ed0c3 tempest-ServersNegativeTestJSON-186574907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:16:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ad305c40-a32f-48ec-896e-e827104ed0c3 tempest-ServersNegativeTestJSON-186574907 None] Flow 'volume_create_manager' (c1a2c9ad-2d91-4723-ad7c-9d13a7e13076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:16:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ad305c40-a32f-48ec-896e-e827104ed0c3 tempest-ServersNegativeTestJSON-186574907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21058d6e-ec09-4ed1-874c-aba228f2839c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:16:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ad305c40-a32f-48ec-896e-e827104ed0c3 tempest-ServersNegativeTestJSON-186574907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21058d6e-ec09-4ed1-874c-aba228f2839c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-982303756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38d52145-d489-48de-8c86-fb1502e07f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcf92a6c5f044bb97c0ce3e4886fe91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:16:44Z,use_quota=True,user_id='62a3b9a734e34d1593a3d08bcdd8717b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:16:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ad305c40-a32f-48ec-896e-e827104ed0c3 tempest-ServersNegativeTestJSON-186574907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c6e3845-e312-42d2-a97b-19612544c092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:16:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ad305c40-a32f-48ec-896e-e827104ed0c3 tempest-ServersNegativeTestJSON-186574907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c6e3845-e312-42d2-a97b-19612544c092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:16:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ad305c40-a32f-48ec-896e-e827104ed0c3 tempest-ServersNegativeTestJSON-186574907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f19d5b9-a402-4bae-bbd4-fd677cad8f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:16:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ad305c40-a32f-48ec-896e-e827104ed0c3 tempest-ServersNegativeTestJSON-186574907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f19d5b9-a402-4bae-bbd4-fd677cad8f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38d52145-d489-48de-8c86-fb1502e07f7a', 'volume_name': 'volume-38d52145-d489-48de-8c86-fb1502e07f7a', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:16:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ad305c40-a32f-48ec-896e-e827104ed0c3 tempest-ServersNegativeTestJSON-186574907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ced0a9-dd18-4dc3-957b-290341990a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:16:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ad305c40-a32f-48ec-896e-e827104ed0c3 tempest-ServersNegativeTestJSON-186574907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ced0a9-dd18-4dc3-957b-290341990a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:16:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ad305c40-a32f-48ec-896e-e827104ed0c3 tempest-ServersNegativeTestJSON-186574907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a4c36b-2b24-4249-a0c6-e0817d3ecbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:16:44 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-ad305c40-a32f-48ec-896e-e827104ed0c3 tempest-ServersNegativeTestJSON-186574907 None] Volume 38d52145-d489-48de-8c86-fb1502e07f7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38d52145-d489-48de-8c86-fb1502e07f7a', 'volume_size': 1} Jun 02 03:16:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ad305c40-a32f-48ec-896e-e827104ed0c3 tempest-ServersNegativeTestJSON-186574907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:16:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ad305c40-a32f-48ec-896e-e827104ed0c3 tempest-ServersNegativeTestJSON-186574907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:16:44 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ad305c40-a32f-48ec-896e-e827104ed0c3 tempest-ServersNegativeTestJSON-186574907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-982303756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38d52145-d489-48de-8c86-fb1502e07f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcf92a6c5f044bb97c0ce3e4886fe91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:16:44Z,use_quota=True,user_id='62a3b9a734e34d1593a3d08bcdd8717b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:16:44 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-ad305c40-a32f-48ec-896e-e827104ed0c3 tempest-ServersNegativeTestJSON-186574907 None] Creating volume 38d52145-d489-48de-8c86-fb1502e07f7a {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:16:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ad305c40-a32f-48ec-896e-e827104ed0c3 tempest-ServersNegativeTestJSON-186574907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:16:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ad305c40-a32f-48ec-896e-e827104ed0c3 tempest-ServersNegativeTestJSON-186574907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:16:44 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ad305c40-a32f-48ec-896e-e827104ed0c3 tempest-ServersNegativeTestJSON-186574907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:16:44 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ad305c40-a32f-48ec-896e-e827104ed0c3 tempest-ServersNegativeTestJSON-186574907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:16:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ad305c40-a32f-48ec-896e-e827104ed0c3 tempest-ServersNegativeTestJSON-186574907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:16:44 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ad305c40-a32f-48ec-896e-e827104ed0c3 tempest-ServersNegativeTestJSON-186574907 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:16:44 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-ad305c40-a32f-48ec-896e-e827104ed0c3 tempest-ServersNegativeTestJSON-186574907 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:16:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ad305c40-a32f-48ec-896e-e827104ed0c3 tempest-ServersNegativeTestJSON-186574907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-38d52145-d489-48de-8c86-fb1502e07f7a 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:16:44 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-66185a79-266f-4268-b519-1814ee8aa1e3 req-259a9edd-5c26-4c9f-b8be-e2d3bfcbb820 tempest-DeleteServersTestJSON-1379900396 None] Terminate volume connection completed successfully. Jun 02 03:16:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-66185a79-266f-4268-b519-1814ee8aa1e3 req-259a9edd-5c26-4c9f-b8be-e2d3bfcbb820 tempest-DeleteServersTestJSON-1379900396 None] Deleting attachment 2a29117c-ce27-4123-ac87-c5cfc4cf9f8f. {{(pid=86431) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 02 03:16:44 devstack sudo[88004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-38d52145-d489-48de-8c86-fb1502e07f7a 1073741824 Jun 02 03:16:44 devstack sudo[88004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:16:45 devstack sudo[88004]: pam_unix(sudo:session): session closed for user root Jun 02 03:16:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ad305c40-a32f-48ec-896e-e827104ed0c3 tempest-ServersNegativeTestJSON-186574907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-38d52145-d489-48de-8c86-fb1502e07f7a 1073741824" returned: 0 in 0.937s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:16:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ad305c40-a32f-48ec-896e-e827104ed0c3 tempest-ServersNegativeTestJSON-186574907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-38d52145-d489-48de-8c86-fb1502e07f7a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:16:45 devstack sudo[88011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-38d52145-d489-48de-8c86-fb1502e07f7a Jun 02 03:16:45 devstack sudo[88011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:16:45 devstack sudo[88011]: pam_unix(sudo:session): session closed for user root Jun 02 03:16:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ad305c40-a32f-48ec-896e-e827104ed0c3 tempest-ServersNegativeTestJSON-186574907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-38d52145-d489-48de-8c86-fb1502e07f7a" returned: 0 in 0.668s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:16:45 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ad305c40-a32f-48ec-896e-e827104ed0c3 tempest-ServersNegativeTestJSON-186574907 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:16:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ad305c40-a32f-48ec-896e-e827104ed0c3 tempest-ServersNegativeTestJSON-186574907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:16:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ad305c40-a32f-48ec-896e-e827104ed0c3 tempest-ServersNegativeTestJSON-186574907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a4c36b-2b24-4249-a0c6-e0817d3ecbd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38d52145-d489-48de-8c86-fb1502e07f7a', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:16:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ad305c40-a32f-48ec-896e-e827104ed0c3 tempest-ServersNegativeTestJSON-186574907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a752e499-6ce5-4fd1-9092-e93f660c71a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:16:45 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-ad305c40-a32f-48ec-896e-e827104ed0c3 tempest-ServersNegativeTestJSON-186574907 None] Volume volume-38d52145-d489-48de-8c86-fb1502e07f7a (38d52145-d489-48de-8c86-fb1502e07f7a): created successfully Jun 02 03:16:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ad305c40-a32f-48ec-896e-e827104ed0c3 tempest-ServersNegativeTestJSON-186574907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a752e499-6ce5-4fd1-9092-e93f660c71a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:16:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ad305c40-a32f-48ec-896e-e827104ed0c3 tempest-ServersNegativeTestJSON-186574907 None] Flow 'volume_create_manager' (c1a2c9ad-2d91-4723-ad7c-9d13a7e13076) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:16:45 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-ad305c40-a32f-48ec-896e-e827104ed0c3 tempest-ServersNegativeTestJSON-186574907 None] Created volume successfully. Jun 02 03:16:47 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2e052f89-d808-4383-9f55-5097c58f6919 tempest-DeleteServersTestJSON-1379900396 None] Acquiring lock "cinder-92b8bbbb-4159-410a-bb8e-2e3594a8b686-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:16:47 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2e052f89-d808-4383-9f55-5097c58f6919 tempest-DeleteServersTestJSON-1379900396 None] Lock "cinder-92b8bbbb-4159-410a-bb8e-2e3594a8b686-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:16:47 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2e052f89-d808-4383-9f55-5097c58f6919 tempest-DeleteServersTestJSON-1379900396 None] Acquiring lock "cinder-quobyte-92b8bbbb-4159-410a-bb8e-2e3594a8b686" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:16:47 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2e052f89-d808-4383-9f55-5097c58f6919 tempest-DeleteServersTestJSON-1379900396 None] Lock "cinder-quobyte-92b8bbbb-4159-410a-bb8e-2e3594a8b686" acquired by "delete_volume" :: waited 0.024s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:16:47 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f102885-ee2c-4eae-8d0c-b9be29083406]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:16:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2e052f89-d808-4383-9f55-5097c58f6919 tempest-DeleteServersTestJSON-1379900396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-92b8bbbb-4159-410a-bb8e-2e3594a8b686 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:16:47 devstack sudo[88018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-92b8bbbb-4159-410a-bb8e-2e3594a8b686 Jun 02 03:16:47 devstack sudo[88018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:16:48 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-69691226-3416-4bcd-b80e-aff74325b37f tempest-ServersNegativeTestJSON-186574907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:16:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-69691226-3416-4bcd-b80e-aff74325b37f tempest-ServersNegativeTestJSON-186574907 None] Flow 'volume_create_manager' (a25459eb-6754-4dd9-a32f-2b96e6e6062c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:16:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-69691226-3416-4bcd-b80e-aff74325b37f tempest-ServersNegativeTestJSON-186574907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cc6b9cb-9aa1-4054-b69b-d1ab86f2c037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:16:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-69691226-3416-4bcd-b80e-aff74325b37f tempest-ServersNegativeTestJSON-186574907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cc6b9cb-9aa1-4054-b69b-d1ab86f2c037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1792077868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6381dab6-aa19-4e37-85ba-0582e444ae26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcf92a6c5f044bb97c0ce3e4886fe91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:16:48Z,use_quota=True,user_id='62a3b9a734e34d1593a3d08bcdd8717b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:16:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-69691226-3416-4bcd-b80e-aff74325b37f tempest-ServersNegativeTestJSON-186574907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef950e74-f347-47db-a6b1-d1122d5517ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:16:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-69691226-3416-4bcd-b80e-aff74325b37f tempest-ServersNegativeTestJSON-186574907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef950e74-f347-47db-a6b1-d1122d5517ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:16:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-69691226-3416-4bcd-b80e-aff74325b37f tempest-ServersNegativeTestJSON-186574907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5bf2bae-6fb2-4fc8-9644-d9abf528061a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:16:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-69691226-3416-4bcd-b80e-aff74325b37f tempest-ServersNegativeTestJSON-186574907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5bf2bae-6fb2-4fc8-9644-d9abf528061a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6381dab6-aa19-4e37-85ba-0582e444ae26', 'volume_name': 'volume-6381dab6-aa19-4e37-85ba-0582e444ae26', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:16:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-69691226-3416-4bcd-b80e-aff74325b37f tempest-ServersNegativeTestJSON-186574907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f5002a-3b56-4c8b-bb36-8421715d1dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:16:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-69691226-3416-4bcd-b80e-aff74325b37f tempest-ServersNegativeTestJSON-186574907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f5002a-3b56-4c8b-bb36-8421715d1dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:16:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-69691226-3416-4bcd-b80e-aff74325b37f tempest-ServersNegativeTestJSON-186574907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26399287-bc01-431a-ad09-e38c4fee3207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:16:48 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-69691226-3416-4bcd-b80e-aff74325b37f tempest-ServersNegativeTestJSON-186574907 None] Volume 6381dab6-aa19-4e37-85ba-0582e444ae26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6381dab6-aa19-4e37-85ba-0582e444ae26', 'volume_size': 1} Jun 02 03:16:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-69691226-3416-4bcd-b80e-aff74325b37f tempest-ServersNegativeTestJSON-186574907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:16:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-69691226-3416-4bcd-b80e-aff74325b37f tempest-ServersNegativeTestJSON-186574907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:16:48 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-69691226-3416-4bcd-b80e-aff74325b37f tempest-ServersNegativeTestJSON-186574907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1792077868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6381dab6-aa19-4e37-85ba-0582e444ae26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcf92a6c5f044bb97c0ce3e4886fe91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:16:48Z,use_quota=True,user_id='62a3b9a734e34d1593a3d08bcdd8717b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:16:48 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-69691226-3416-4bcd-b80e-aff74325b37f tempest-ServersNegativeTestJSON-186574907 None] Creating volume 6381dab6-aa19-4e37-85ba-0582e444ae26 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:16:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-69691226-3416-4bcd-b80e-aff74325b37f tempest-ServersNegativeTestJSON-186574907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:16:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-69691226-3416-4bcd-b80e-aff74325b37f tempest-ServersNegativeTestJSON-186574907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:16:48 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-69691226-3416-4bcd-b80e-aff74325b37f tempest-ServersNegativeTestJSON-186574907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:16:48 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-69691226-3416-4bcd-b80e-aff74325b37f tempest-ServersNegativeTestJSON-186574907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:16:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-69691226-3416-4bcd-b80e-aff74325b37f tempest-ServersNegativeTestJSON-186574907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:16:48 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-69691226-3416-4bcd-b80e-aff74325b37f tempest-ServersNegativeTestJSON-186574907 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:16:48 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-69691226-3416-4bcd-b80e-aff74325b37f tempest-ServersNegativeTestJSON-186574907 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:16:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-69691226-3416-4bcd-b80e-aff74325b37f tempest-ServersNegativeTestJSON-186574907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6381dab6-aa19-4e37-85ba-0582e444ae26 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:16:48 devstack sudo[88020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6381dab6-aa19-4e37-85ba-0582e444ae26 1073741824 Jun 02 03:16:48 devstack sudo[88020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:16:48 devstack sudo[88018]: pam_unix(sudo:session): session closed for user root Jun 02 03:16:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2e052f89-d808-4383-9f55-5097c58f6919 tempest-DeleteServersTestJSON-1379900396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-92b8bbbb-4159-410a-bb8e-2e3594a8b686" returned: 0 in 0.917s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:16:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2e052f89-d808-4383-9f55-5097c58f6919 tempest-DeleteServersTestJSON-1379900396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-92b8bbbb-4159-410a-bb8e-2e3594a8b686 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:16:48 devstack sudo[88025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-92b8bbbb-4159-410a-bb8e-2e3594a8b686 Jun 02 03:16:48 devstack sudo[88025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:16:49 devstack sudo[88020]: pam_unix(sudo:session): session closed for user root Jun 02 03:16:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-69691226-3416-4bcd-b80e-aff74325b37f tempest-ServersNegativeTestJSON-186574907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6381dab6-aa19-4e37-85ba-0582e444ae26 1073741824" returned: 0 in 0.899s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:16:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-69691226-3416-4bcd-b80e-aff74325b37f tempest-ServersNegativeTestJSON-186574907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6381dab6-aa19-4e37-85ba-0582e444ae26 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:16:49 devstack sudo[88032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6381dab6-aa19-4e37-85ba-0582e444ae26 Jun 02 03:16:49 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:16:49 devstack sudo[88025]: pam_unix(sudo:session): session closed for user root Jun 02 03:16:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2e052f89-d808-4383-9f55-5097c58f6919 tempest-DeleteServersTestJSON-1379900396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-92b8bbbb-4159-410a-bb8e-2e3594a8b686" returned: 0 in 0.768s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:16:49 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2e052f89-d808-4383-9f55-5097c58f6919 tempest-DeleteServersTestJSON-1379900396 None] Lock "cinder-quobyte-92b8bbbb-4159-410a-bb8e-2e3594a8b686" released by "delete_volume" :: held 1.740s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:16:49 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-2e052f89-d808-4383-9f55-5097c58f6919 tempest-DeleteServersTestJSON-1379900396 None] Created reservations ['47a4037e-7dd2-4887-a236-84ff38e70aec', 'b34c95b2-7757-4461-8f59-906c03d8fbcc', '80e9b977-7661-43bc-b46b-ed60472ca8e1', 'e56e014f-98dd-4f04-99c6-78594e0daf08'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:16:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2e052f89-d808-4383-9f55-5097c58f6919 tempest-DeleteServersTestJSON-1379900396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:16:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2e052f89-d808-4383-9f55-5097c58f6919 tempest-DeleteServersTestJSON-1379900396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:16:49 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-2e052f89-d808-4383-9f55-5097c58f6919 tempest-DeleteServersTestJSON-1379900396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:16:49 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-2e052f89-d808-4383-9f55-5097c58f6919 tempest-DeleteServersTestJSON-1379900396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:16:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2e052f89-d808-4383-9f55-5097c58f6919 tempest-DeleteServersTestJSON-1379900396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:16:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2e052f89-d808-4383-9f55-5097c58f6919 tempest-DeleteServersTestJSON-1379900396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:16:49 devstack sudo[88035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:16:49 devstack sudo[88035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:16:49 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root Jun 02 03:16:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-69691226-3416-4bcd-b80e-aff74325b37f tempest-ServersNegativeTestJSON-186574907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6381dab6-aa19-4e37-85ba-0582e444ae26" returned: 0 in 0.689s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:16:49 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-69691226-3416-4bcd-b80e-aff74325b37f tempest-ServersNegativeTestJSON-186574907 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:16:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-69691226-3416-4bcd-b80e-aff74325b37f tempest-ServersNegativeTestJSON-186574907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:16:49 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-69691226-3416-4bcd-b80e-aff74325b37f tempest-ServersNegativeTestJSON-186574907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26399287-bc01-431a-ad09-e38c4fee3207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6381dab6-aa19-4e37-85ba-0582e444ae26', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:16:49 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-69691226-3416-4bcd-b80e-aff74325b37f tempest-ServersNegativeTestJSON-186574907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3e1a9d2-789c-4381-9657-41474146dd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:16:49 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-69691226-3416-4bcd-b80e-aff74325b37f tempest-ServersNegativeTestJSON-186574907 None] Volume volume-6381dab6-aa19-4e37-85ba-0582e444ae26 (6381dab6-aa19-4e37-85ba-0582e444ae26): created successfully Jun 02 03:16:49 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-69691226-3416-4bcd-b80e-aff74325b37f tempest-ServersNegativeTestJSON-186574907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3e1a9d2-789c-4381-9657-41474146dd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:16:50 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-69691226-3416-4bcd-b80e-aff74325b37f tempest-ServersNegativeTestJSON-186574907 None] Flow 'volume_create_manager' (a25459eb-6754-4dd9-a32f-2b96e6e6062c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:16:50 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-69691226-3416-4bcd-b80e-aff74325b37f tempest-ServersNegativeTestJSON-186574907 None] Created volume successfully. Jun 02 03:16:50 devstack sudo[88035]: pam_unix(sudo:session): session closed for user root Jun 02 03:16:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2e052f89-d808-4383-9f55-5097c58f6919 tempest-DeleteServersTestJSON-1379900396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.752s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:16:50 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-2e052f89-d808-4383-9f55-5097c58f6919 tempest-DeleteServersTestJSON-1379900396 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:16:50 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-2e052f89-d808-4383-9f55-5097c58f6919 tempest-DeleteServersTestJSON-1379900396 None] Deleted volume successfully. Jun 02 03:16:50 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2e052f89-d808-4383-9f55-5097c58f6919 tempest-DeleteServersTestJSON-1379900396 None] Lock "cinder-92b8bbbb-4159-410a-bb8e-2e3594a8b686-delete_volume" released by "delete_volume" :: held 2.749s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:16:51 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d0393f02-42aa-402e-b8f5-2ccd4e79ba76 tempest-ServersNegativeTestJSON-186574907 None] Acquiring lock "cinder-6381dab6-aa19-4e37-85ba-0582e444ae26-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:16:51 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d0393f02-42aa-402e-b8f5-2ccd4e79ba76 tempest-ServersNegativeTestJSON-186574907 None] Lock "cinder-6381dab6-aa19-4e37-85ba-0582e444ae26-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:16:51 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d0393f02-42aa-402e-b8f5-2ccd4e79ba76 tempest-ServersNegativeTestJSON-186574907 None] Acquiring lock "cinder-quobyte-6381dab6-aa19-4e37-85ba-0582e444ae26" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:16:51 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d0393f02-42aa-402e-b8f5-2ccd4e79ba76 tempest-ServersNegativeTestJSON-186574907 None] Lock "cinder-quobyte-6381dab6-aa19-4e37-85ba-0582e444ae26" acquired by "delete_volume" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:16:51 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[977ea0ae-3fba-4839-9878-143c56299abd]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:16:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d0393f02-42aa-402e-b8f5-2ccd4e79ba76 tempest-ServersNegativeTestJSON-186574907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6381dab6-aa19-4e37-85ba-0582e444ae26 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:16:51 devstack sudo[88039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6381dab6-aa19-4e37-85ba-0582e444ae26 Jun 02 03:16:51 devstack sudo[88039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:16:52 devstack sudo[88039]: pam_unix(sudo:session): session closed for user root Jun 02 03:16:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d0393f02-42aa-402e-b8f5-2ccd4e79ba76 tempest-ServersNegativeTestJSON-186574907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6381dab6-aa19-4e37-85ba-0582e444ae26" returned: 0 in 0.823s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:16:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d0393f02-42aa-402e-b8f5-2ccd4e79ba76 tempest-ServersNegativeTestJSON-186574907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6381dab6-aa19-4e37-85ba-0582e444ae26 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:16:52 devstack sudo[88048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6381dab6-aa19-4e37-85ba-0582e444ae26 Jun 02 03:16:52 devstack sudo[88048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:16:52 devstack sudo[88048]: pam_unix(sudo:session): session closed for user root Jun 02 03:16:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d0393f02-42aa-402e-b8f5-2ccd4e79ba76 tempest-ServersNegativeTestJSON-186574907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6381dab6-aa19-4e37-85ba-0582e444ae26" returned: 0 in 0.673s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:16:52 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d0393f02-42aa-402e-b8f5-2ccd4e79ba76 tempest-ServersNegativeTestJSON-186574907 None] Lock "cinder-quobyte-6381dab6-aa19-4e37-85ba-0582e444ae26" released by "delete_volume" :: held 1.552s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:16:52 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-d0393f02-42aa-402e-b8f5-2ccd4e79ba76 tempest-ServersNegativeTestJSON-186574907 None] Created reservations ['c41919ba-406c-4acd-bbd8-cacf48ac97b9', '660e763b-245d-4bb2-8f5d-6f8a4ede7818', 'c1bf01a5-c551-46c5-ac13-23c31d58f447', '85a838da-f5ca-4f0d-a96b-175d8ca52096'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:16:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d0393f02-42aa-402e-b8f5-2ccd4e79ba76 tempest-ServersNegativeTestJSON-186574907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:16:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d0393f02-42aa-402e-b8f5-2ccd4e79ba76 tempest-ServersNegativeTestJSON-186574907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:16:53 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-d0393f02-42aa-402e-b8f5-2ccd4e79ba76 tempest-ServersNegativeTestJSON-186574907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:16:53 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-d0393f02-42aa-402e-b8f5-2ccd4e79ba76 tempest-ServersNegativeTestJSON-186574907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:16:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d0393f02-42aa-402e-b8f5-2ccd4e79ba76 tempest-ServersNegativeTestJSON-186574907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:16:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d0393f02-42aa-402e-b8f5-2ccd4e79ba76 tempest-ServersNegativeTestJSON-186574907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:16:53 devstack sudo[88051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:16:53 devstack sudo[88051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:16:53 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-26b634d6-e3e6-487e-a6ff-8153b480ccca tempest-ServersNegativeTestJSON-186574907 None] Acquiring lock "cinder-38d52145-d489-48de-8c86-fb1502e07f7a-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:16:53 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-26b634d6-e3e6-487e-a6ff-8153b480ccca tempest-ServersNegativeTestJSON-186574907 None] Lock "cinder-38d52145-d489-48de-8c86-fb1502e07f7a-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:16:53 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-26b634d6-e3e6-487e-a6ff-8153b480ccca tempest-ServersNegativeTestJSON-186574907 None] Acquiring lock "cinder-quobyte-38d52145-d489-48de-8c86-fb1502e07f7a" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:16:53 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-26b634d6-e3e6-487e-a6ff-8153b480ccca tempest-ServersNegativeTestJSON-186574907 None] Lock "cinder-quobyte-38d52145-d489-48de-8c86-fb1502e07f7a" acquired by "delete_volume" :: waited 0.034s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:16:53 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee898cab-a316-46c2-9703-11fc4504ae4c]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:16:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-26b634d6-e3e6-487e-a6ff-8153b480ccca tempest-ServersNegativeTestJSON-186574907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-38d52145-d489-48de-8c86-fb1502e07f7a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:16:53 devstack sudo[88060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-38d52145-d489-48de-8c86-fb1502e07f7a Jun 02 03:16:53 devstack sudo[88060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:16:54 devstack sudo[88051]: pam_unix(sudo:session): session closed for user root Jun 02 03:16:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d0393f02-42aa-402e-b8f5-2ccd4e79ba76 tempest-ServersNegativeTestJSON-186574907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 1.069s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:16:54 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-d0393f02-42aa-402e-b8f5-2ccd4e79ba76 tempest-ServersNegativeTestJSON-186574907 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:16:54 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-d0393f02-42aa-402e-b8f5-2ccd4e79ba76 tempest-ServersNegativeTestJSON-186574907 None] Deleted volume successfully. Jun 02 03:16:54 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d0393f02-42aa-402e-b8f5-2ccd4e79ba76 tempest-ServersNegativeTestJSON-186574907 None] Lock "cinder-6381dab6-aa19-4e37-85ba-0582e444ae26-delete_volume" released by "delete_volume" :: held 3.037s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:16:54 devstack sudo[88060]: pam_unix(sudo:session): session closed for user root Jun 02 03:16:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-26b634d6-e3e6-487e-a6ff-8153b480ccca tempest-ServersNegativeTestJSON-186574907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-38d52145-d489-48de-8c86-fb1502e07f7a" returned: 0 in 1.178s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:16:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-26b634d6-e3e6-487e-a6ff-8153b480ccca tempest-ServersNegativeTestJSON-186574907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-38d52145-d489-48de-8c86-fb1502e07f7a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:16:54 devstack sudo[88085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-38d52145-d489-48de-8c86-fb1502e07f7a Jun 02 03:16:54 devstack sudo[88085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:16:55 devstack sudo[88085]: pam_unix(sudo:session): session closed for user root Jun 02 03:16:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-26b634d6-e3e6-487e-a6ff-8153b480ccca tempest-ServersNegativeTestJSON-186574907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-38d52145-d489-48de-8c86-fb1502e07f7a" returned: 0 in 0.733s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:16:55 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-26b634d6-e3e6-487e-a6ff-8153b480ccca tempest-ServersNegativeTestJSON-186574907 None] Lock "cinder-quobyte-38d52145-d489-48de-8c86-fb1502e07f7a" released by "delete_volume" :: held 1.976s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:16:55 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-26b634d6-e3e6-487e-a6ff-8153b480ccca tempest-ServersNegativeTestJSON-186574907 None] Created reservations ['6ca40dec-b5cb-4908-aeb1-b1c37908445b', '9aa848a8-a1aa-490f-8da5-b40f6f608b57', '05da9c4a-8610-4eaf-a7a8-7d8222e4d835', 'd9fe91f9-f5c7-40b8-928e-0c5027dee50d'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:16:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-26b634d6-e3e6-487e-a6ff-8153b480ccca tempest-ServersNegativeTestJSON-186574907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:16:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-26b634d6-e3e6-487e-a6ff-8153b480ccca tempest-ServersNegativeTestJSON-186574907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:16:55 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-26b634d6-e3e6-487e-a6ff-8153b480ccca tempest-ServersNegativeTestJSON-186574907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:16:55 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-26b634d6-e3e6-487e-a6ff-8153b480ccca tempest-ServersNegativeTestJSON-186574907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:16:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-26b634d6-e3e6-487e-a6ff-8153b480ccca tempest-ServersNegativeTestJSON-186574907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:16:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-26b634d6-e3e6-487e-a6ff-8153b480ccca tempest-ServersNegativeTestJSON-186574907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:16:55 devstack sudo[88088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:16:55 devstack sudo[88088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:16:56 devstack sudo[88088]: pam_unix(sudo:session): session closed for user root Jun 02 03:16:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-26b634d6-e3e6-487e-a6ff-8153b480ccca tempest-ServersNegativeTestJSON-186574907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.759s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:16:56 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-26b634d6-e3e6-487e-a6ff-8153b480ccca tempest-ServersNegativeTestJSON-186574907 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:16:56 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-26b634d6-e3e6-487e-a6ff-8153b480ccca tempest-ServersNegativeTestJSON-186574907 None] Deleted volume successfully. Jun 02 03:16:56 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-26b634d6-e3e6-487e-a6ff-8153b480ccca tempest-ServersNegativeTestJSON-186574907 None] Lock "cinder-38d52145-d489-48de-8c86-fb1502e07f7a-delete_volume" released by "delete_volume" :: held 3.025s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:17:05 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=24,cinder:UPDATE=35,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:17:06 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=29,cinder:UPDATE=42,cinder:DELETE=6,cinder:INSERT=12 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:17:09 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:17:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:17:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:17:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:17:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:17:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:17:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:17:09 devstack sudo[88206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:17:09 devstack sudo[88206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:17:10 devstack sudo[88206]: pam_unix(sudo:session): session closed for user root Jun 02 03:17:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.874s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:17:10 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:17:35 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-e570108d-9fd6-448d-9c17-c48247e5d843 tempest-ServerActionsTestOtherA-1952099514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:17:35 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e570108d-9fd6-448d-9c17-c48247e5d843 tempest-ServerActionsTestOtherA-1952099514 None] Flow 'volume_create_manager' (203f123b-f820-49b4-a90e-e0a521376fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:17:35 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e570108d-9fd6-448d-9c17-c48247e5d843 tempest-ServerActionsTestOtherA-1952099514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75bbbdf-420a-4313-bf53-5f576d979bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:17:35 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e570108d-9fd6-448d-9c17-c48247e5d843 tempest-ServerActionsTestOtherA-1952099514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75bbbdf-420a-4313-bf53-5f576d979bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-735821050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3df71c5-91c3-4849-9d66-878c927fc84d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d9d0a5b8e664f688a61e1964b00eeab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:17:36Z,use_quota=True,user_id='af9403f44ac047be9ae6f0165cea284c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:17:35 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e570108d-9fd6-448d-9c17-c48247e5d843 tempest-ServerActionsTestOtherA-1952099514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99ebfbd5-1409-4937-a8d0-b437d60d421e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:17:35 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e570108d-9fd6-448d-9c17-c48247e5d843 tempest-ServerActionsTestOtherA-1952099514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99ebfbd5-1409-4937-a8d0-b437d60d421e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:17:35 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e570108d-9fd6-448d-9c17-c48247e5d843 tempest-ServerActionsTestOtherA-1952099514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f83e6c47-44a0-4fa5-bc49-fc00f7512043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:17:35 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e570108d-9fd6-448d-9c17-c48247e5d843 tempest-ServerActionsTestOtherA-1952099514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f83e6c47-44a0-4fa5-bc49-fc00f7512043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3df71c5-91c3-4849-9d66-878c927fc84d', 'volume_name': 'volume-f3df71c5-91c3-4849-9d66-878c927fc84d', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:17:35 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e570108d-9fd6-448d-9c17-c48247e5d843 tempest-ServerActionsTestOtherA-1952099514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a93cfd0-72da-47a1-9160-7705676776dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:17:35 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e570108d-9fd6-448d-9c17-c48247e5d843 tempest-ServerActionsTestOtherA-1952099514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a93cfd0-72da-47a1-9160-7705676776dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:17:35 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e570108d-9fd6-448d-9c17-c48247e5d843 tempest-ServerActionsTestOtherA-1952099514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d7dae3-86cd-447c-a2d3-68d83beca5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:17:35 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-e570108d-9fd6-448d-9c17-c48247e5d843 tempest-ServerActionsTestOtherA-1952099514 None] Volume f3df71c5-91c3-4849-9d66-878c927fc84d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3df71c5-91c3-4849-9d66-878c927fc84d', 'volume_size': 1} Jun 02 03:17:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e570108d-9fd6-448d-9c17-c48247e5d843 tempest-ServerActionsTestOtherA-1952099514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:17:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e570108d-9fd6-448d-9c17-c48247e5d843 tempest-ServerActionsTestOtherA-1952099514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:17:35 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e570108d-9fd6-448d-9c17-c48247e5d843 tempest-ServerActionsTestOtherA-1952099514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-735821050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3df71c5-91c3-4849-9d66-878c927fc84d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d9d0a5b8e664f688a61e1964b00eeab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:17:36Z,use_quota=True,user_id='af9403f44ac047be9ae6f0165cea284c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:17:35 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-e570108d-9fd6-448d-9c17-c48247e5d843 tempest-ServerActionsTestOtherA-1952099514 None] Creating volume f3df71c5-91c3-4849-9d66-878c927fc84d {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:17:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e570108d-9fd6-448d-9c17-c48247e5d843 tempest-ServerActionsTestOtherA-1952099514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:17:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e570108d-9fd6-448d-9c17-c48247e5d843 tempest-ServerActionsTestOtherA-1952099514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:17:35 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e570108d-9fd6-448d-9c17-c48247e5d843 tempest-ServerActionsTestOtherA-1952099514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:17:35 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e570108d-9fd6-448d-9c17-c48247e5d843 tempest-ServerActionsTestOtherA-1952099514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:17:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e570108d-9fd6-448d-9c17-c48247e5d843 tempest-ServerActionsTestOtherA-1952099514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:17:35 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e570108d-9fd6-448d-9c17-c48247e5d843 tempest-ServerActionsTestOtherA-1952099514 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:17:35 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-e570108d-9fd6-448d-9c17-c48247e5d843 tempest-ServerActionsTestOtherA-1952099514 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:17:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e570108d-9fd6-448d-9c17-c48247e5d843 tempest-ServerActionsTestOtherA-1952099514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f3df71c5-91c3-4849-9d66-878c927fc84d 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:17:35 devstack sudo[88324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f3df71c5-91c3-4849-9d66-878c927fc84d 1073741824 Jun 02 03:17:35 devstack sudo[88324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:17:36 devstack sudo[88324]: pam_unix(sudo:session): session closed for user root Jun 02 03:17:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e570108d-9fd6-448d-9c17-c48247e5d843 tempest-ServerActionsTestOtherA-1952099514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f3df71c5-91c3-4849-9d66-878c927fc84d 1073741824" returned: 0 in 0.943s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:17:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e570108d-9fd6-448d-9c17-c48247e5d843 tempest-ServerActionsTestOtherA-1952099514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f3df71c5-91c3-4849-9d66-878c927fc84d {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:17:36 devstack sudo[88332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f3df71c5-91c3-4849-9d66-878c927fc84d Jun 02 03:17:36 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:17:37 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-2902e0af-0c83-4836-9375-83a4306ba038 tempest-TaggedAttachmentsTest-1226748328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:17:37 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2902e0af-0c83-4836-9375-83a4306ba038 tempest-TaggedAttachmentsTest-1226748328 None] Flow 'volume_create_manager' (f3d4834f-788c-4626-b325-001391dfe8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:17:37 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2902e0af-0c83-4836-9375-83a4306ba038 tempest-TaggedAttachmentsTest-1226748328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e63d292-be8a-44b0-87d5-6a8238e4ba51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:17:37 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2902e0af-0c83-4836-9375-83a4306ba038 tempest-TaggedAttachmentsTest-1226748328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e63d292-be8a-44b0-87d5-6a8238e4ba51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-895454470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5eb3407-e878-4790-afdc-b7be0a453bac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce5f3d346fee4c57b14557bb072ee127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:17:37Z,use_quota=True,user_id='7b2ef5741ab24dc68f53124d4d0f60ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:17:37 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2902e0af-0c83-4836-9375-83a4306ba038 tempest-TaggedAttachmentsTest-1226748328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9110f5-1934-450d-85fc-5f0859e56547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:17:37 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2902e0af-0c83-4836-9375-83a4306ba038 tempest-TaggedAttachmentsTest-1226748328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9110f5-1934-450d-85fc-5f0859e56547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:17:37 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2902e0af-0c83-4836-9375-83a4306ba038 tempest-TaggedAttachmentsTest-1226748328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b6f9b8a-e7bc-4c36-b183-9200b463d894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:17:37 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2902e0af-0c83-4836-9375-83a4306ba038 tempest-TaggedAttachmentsTest-1226748328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b6f9b8a-e7bc-4c36-b183-9200b463d894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5eb3407-e878-4790-afdc-b7be0a453bac', 'volume_name': 'volume-d5eb3407-e878-4790-afdc-b7be0a453bac', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:17:37 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2902e0af-0c83-4836-9375-83a4306ba038 tempest-TaggedAttachmentsTest-1226748328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (595fd250-eb8f-476a-a16b-8a2a648ae508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:17:37 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2902e0af-0c83-4836-9375-83a4306ba038 tempest-TaggedAttachmentsTest-1226748328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (595fd250-eb8f-476a-a16b-8a2a648ae508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:17:37 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2902e0af-0c83-4836-9375-83a4306ba038 tempest-TaggedAttachmentsTest-1226748328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e0ca8e5-e805-4a97-a26a-6c3f802d63f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:17:37 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-2902e0af-0c83-4836-9375-83a4306ba038 tempest-TaggedAttachmentsTest-1226748328 None] Volume d5eb3407-e878-4790-afdc-b7be0a453bac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5eb3407-e878-4790-afdc-b7be0a453bac', 'volume_size': 1} Jun 02 03:17:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2902e0af-0c83-4836-9375-83a4306ba038 tempest-TaggedAttachmentsTest-1226748328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:17:37 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root Jun 02 03:17:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e570108d-9fd6-448d-9c17-c48247e5d843 tempest-ServerActionsTestOtherA-1952099514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f3df71c5-91c3-4849-9d66-878c927fc84d" returned: 0 in 0.760s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:17:37 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e570108d-9fd6-448d-9c17-c48247e5d843 tempest-ServerActionsTestOtherA-1952099514 None] <== create_volume: return (1758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:17:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e570108d-9fd6-448d-9c17-c48247e5d843 tempest-ServerActionsTestOtherA-1952099514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:17:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2902e0af-0c83-4836-9375-83a4306ba038 tempest-TaggedAttachmentsTest-1226748328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.366s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:17:37 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-2902e0af-0c83-4836-9375-83a4306ba038 tempest-TaggedAttachmentsTest-1226748328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-895454470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5eb3407-e878-4790-afdc-b7be0a453bac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce5f3d346fee4c57b14557bb072ee127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:17:37Z,use_quota=True,user_id='7b2ef5741ab24dc68f53124d4d0f60ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:17:37 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-2902e0af-0c83-4836-9375-83a4306ba038 tempest-TaggedAttachmentsTest-1226748328 None] Creating volume d5eb3407-e878-4790-afdc-b7be0a453bac {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:17:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2902e0af-0c83-4836-9375-83a4306ba038 tempest-TaggedAttachmentsTest-1226748328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:17:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2902e0af-0c83-4836-9375-83a4306ba038 tempest-TaggedAttachmentsTest-1226748328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:17:37 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-2902e0af-0c83-4836-9375-83a4306ba038 tempest-TaggedAttachmentsTest-1226748328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:17:37 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-2902e0af-0c83-4836-9375-83a4306ba038 tempest-TaggedAttachmentsTest-1226748328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:17:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2902e0af-0c83-4836-9375-83a4306ba038 tempest-TaggedAttachmentsTest-1226748328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:17:37 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-2902e0af-0c83-4836-9375-83a4306ba038 tempest-TaggedAttachmentsTest-1226748328 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:17:37 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-2902e0af-0c83-4836-9375-83a4306ba038 tempest-TaggedAttachmentsTest-1226748328 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:17:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2902e0af-0c83-4836-9375-83a4306ba038 tempest-TaggedAttachmentsTest-1226748328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d5eb3407-e878-4790-afdc-b7be0a453bac 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:17:37 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e570108d-9fd6-448d-9c17-c48247e5d843 tempest-ServerActionsTestOtherA-1952099514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d7dae3-86cd-447c-a2d3-68d83beca5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3df71c5-91c3-4849-9d66-878c927fc84d', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:17:37 devstack sudo[88335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d5eb3407-e878-4790-afdc-b7be0a453bac 1073741824 Jun 02 03:17:37 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:17:37 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e570108d-9fd6-448d-9c17-c48247e5d843 tempest-ServerActionsTestOtherA-1952099514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (429c1a8a-eb58-4fbd-b77d-bdd161b73f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:17:37 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-e570108d-9fd6-448d-9c17-c48247e5d843 tempest-ServerActionsTestOtherA-1952099514 None] Volume volume-f3df71c5-91c3-4849-9d66-878c927fc84d (f3df71c5-91c3-4849-9d66-878c927fc84d): created successfully Jun 02 03:17:37 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e570108d-9fd6-448d-9c17-c48247e5d843 tempest-ServerActionsTestOtherA-1952099514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (429c1a8a-eb58-4fbd-b77d-bdd161b73f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:17:37 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e570108d-9fd6-448d-9c17-c48247e5d843 tempest-ServerActionsTestOtherA-1952099514 None] Flow 'volume_create_manager' (203f123b-f820-49b4-a90e-e0a521376fe0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:17:37 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-e570108d-9fd6-448d-9c17-c48247e5d843 tempest-ServerActionsTestOtherA-1952099514 None] Created volume successfully. Jun 02 03:17:38 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root Jun 02 03:17:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2902e0af-0c83-4836-9375-83a4306ba038 tempest-TaggedAttachmentsTest-1226748328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d5eb3407-e878-4790-afdc-b7be0a453bac 1073741824" returned: 0 in 0.971s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:17:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2902e0af-0c83-4836-9375-83a4306ba038 tempest-TaggedAttachmentsTest-1226748328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d5eb3407-e878-4790-afdc-b7be0a453bac {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:17:38 devstack sudo[88341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d5eb3407-e878-4790-afdc-b7be0a453bac Jun 02 03:17:38 devstack sudo[88341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:17:39 devstack sudo[88341]: pam_unix(sudo:session): session closed for user root Jun 02 03:17:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2902e0af-0c83-4836-9375-83a4306ba038 tempest-TaggedAttachmentsTest-1226748328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d5eb3407-e878-4790-afdc-b7be0a453bac" returned: 0 in 0.769s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:17:39 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-2902e0af-0c83-4836-9375-83a4306ba038 tempest-TaggedAttachmentsTest-1226748328 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:17:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2902e0af-0c83-4836-9375-83a4306ba038 tempest-TaggedAttachmentsTest-1226748328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:17:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2902e0af-0c83-4836-9375-83a4306ba038 tempest-TaggedAttachmentsTest-1226748328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e0ca8e5-e805-4a97-a26a-6c3f802d63f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5eb3407-e878-4790-afdc-b7be0a453bac', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:17:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2902e0af-0c83-4836-9375-83a4306ba038 tempest-TaggedAttachmentsTest-1226748328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55118084-5c83-4098-9d9a-88967b7b5694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:17:39 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-2902e0af-0c83-4836-9375-83a4306ba038 tempest-TaggedAttachmentsTest-1226748328 None] Volume volume-d5eb3407-e878-4790-afdc-b7be0a453bac (d5eb3407-e878-4790-afdc-b7be0a453bac): created successfully Jun 02 03:17:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2902e0af-0c83-4836-9375-83a4306ba038 tempest-TaggedAttachmentsTest-1226748328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55118084-5c83-4098-9d9a-88967b7b5694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:17:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2902e0af-0c83-4836-9375-83a4306ba038 tempest-TaggedAttachmentsTest-1226748328 None] Flow 'volume_create_manager' (f3d4834f-788c-4626-b325-001391dfe8aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:17:39 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-2902e0af-0c83-4836-9375-83a4306ba038 tempest-TaggedAttachmentsTest-1226748328 None] Created volume successfully. Jun 02 03:17:49 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=7,cinder:UPDATE=5 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:17:49 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:UPDATE=7,cinder:SELECT=1,cinder:INSERT=2,cinder:DELETE=2 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:18:09 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:18:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:18:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:18:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:18:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:18:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:18:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:18:09 devstack sudo[88926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:18:09 devstack sudo[88926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:18:11 devstack sudo[88926]: pam_unix(sudo:session): session closed for user root Jun 02 03:18:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 2.030s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:18:11 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:18:11 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager._thread_info {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:18:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread count: 8 {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 02 03:18:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread info: [<_MainThread(MainThread, started 138618128814208)>, , , , , , , ] {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 02 03:18:13 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b15784a-2578-4d56-a73c-690aea8490ba tempest-ServerRescueNegativeTestJSON-1898739226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:18:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0b15784a-2578-4d56-a73c-690aea8490ba tempest-ServerRescueNegativeTestJSON-1898739226 None] Flow 'volume_create_manager' (61496f9a-bfb1-4558-ab51-7dd4dd3a5738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:18:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0b15784a-2578-4d56-a73c-690aea8490ba tempest-ServerRescueNegativeTestJSON-1898739226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45e9543d-c434-4fd8-add6-5a30f683593f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:18:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0b15784a-2578-4d56-a73c-690aea8490ba tempest-ServerRescueNegativeTestJSON-1898739226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45e9543d-c434-4fd8-add6-5a30f683593f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1450542535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06903bb5-8f3e-4a11-91cb-a5f0944457ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e056a44bbdc49b6999879ecca4bf6c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:18:13Z,use_quota=True,user_id='02e26458d4934183bd91ef3ffbbc2c0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:18:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0b15784a-2578-4d56-a73c-690aea8490ba tempest-ServerRescueNegativeTestJSON-1898739226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb70f207-8ee7-4f0a-9a59-012167ff8724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:18:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0b15784a-2578-4d56-a73c-690aea8490ba tempest-ServerRescueNegativeTestJSON-1898739226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb70f207-8ee7-4f0a-9a59-012167ff8724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:18:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0b15784a-2578-4d56-a73c-690aea8490ba tempest-ServerRescueNegativeTestJSON-1898739226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e8a7e81-cca0-494b-b8f0-d5dfa59b6036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:18:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0b15784a-2578-4d56-a73c-690aea8490ba tempest-ServerRescueNegativeTestJSON-1898739226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e8a7e81-cca0-494b-b8f0-d5dfa59b6036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06903bb5-8f3e-4a11-91cb-a5f0944457ef', 'volume_name': 'volume-06903bb5-8f3e-4a11-91cb-a5f0944457ef', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:18:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0b15784a-2578-4d56-a73c-690aea8490ba tempest-ServerRescueNegativeTestJSON-1898739226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd71af6-9d69-4435-9588-d1b348198679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:18:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0b15784a-2578-4d56-a73c-690aea8490ba tempest-ServerRescueNegativeTestJSON-1898739226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd71af6-9d69-4435-9588-d1b348198679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:18:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0b15784a-2578-4d56-a73c-690aea8490ba tempest-ServerRescueNegativeTestJSON-1898739226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0221e958-d4fb-430f-814c-e81fe8196570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:18:13 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-0b15784a-2578-4d56-a73c-690aea8490ba tempest-ServerRescueNegativeTestJSON-1898739226 None] Volume 06903bb5-8f3e-4a11-91cb-a5f0944457ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06903bb5-8f3e-4a11-91cb-a5f0944457ef', 'volume_size': 1} Jun 02 03:18:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0b15784a-2578-4d56-a73c-690aea8490ba tempest-ServerRescueNegativeTestJSON-1898739226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:18:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0b15784a-2578-4d56-a73c-690aea8490ba tempest-ServerRescueNegativeTestJSON-1898739226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:18:13 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0b15784a-2578-4d56-a73c-690aea8490ba tempest-ServerRescueNegativeTestJSON-1898739226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1450542535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06903bb5-8f3e-4a11-91cb-a5f0944457ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e056a44bbdc49b6999879ecca4bf6c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:18:13Z,use_quota=True,user_id='02e26458d4934183bd91ef3ffbbc2c0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:18:13 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-0b15784a-2578-4d56-a73c-690aea8490ba tempest-ServerRescueNegativeTestJSON-1898739226 None] Creating volume 06903bb5-8f3e-4a11-91cb-a5f0944457ef {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:18:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0b15784a-2578-4d56-a73c-690aea8490ba tempest-ServerRescueNegativeTestJSON-1898739226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:18:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0b15784a-2578-4d56-a73c-690aea8490ba tempest-ServerRescueNegativeTestJSON-1898739226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:18:13 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0b15784a-2578-4d56-a73c-690aea8490ba tempest-ServerRescueNegativeTestJSON-1898739226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:18:13 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0b15784a-2578-4d56-a73c-690aea8490ba tempest-ServerRescueNegativeTestJSON-1898739226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:18:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0b15784a-2578-4d56-a73c-690aea8490ba tempest-ServerRescueNegativeTestJSON-1898739226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:18:13 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0b15784a-2578-4d56-a73c-690aea8490ba tempest-ServerRescueNegativeTestJSON-1898739226 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:18:13 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-0b15784a-2578-4d56-a73c-690aea8490ba tempest-ServerRescueNegativeTestJSON-1898739226 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:18:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0b15784a-2578-4d56-a73c-690aea8490ba tempest-ServerRescueNegativeTestJSON-1898739226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-06903bb5-8f3e-4a11-91cb-a5f0944457ef 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:18:13 devstack sudo[88968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-06903bb5-8f3e-4a11-91cb-a5f0944457ef 1073741824 Jun 02 03:18:13 devstack sudo[88968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:18:15 devstack sudo[88968]: pam_unix(sudo:session): session closed for user root Jun 02 03:18:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0b15784a-2578-4d56-a73c-690aea8490ba tempest-ServerRescueNegativeTestJSON-1898739226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-06903bb5-8f3e-4a11-91cb-a5f0944457ef 1073741824" returned: 0 in 1.776s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:18:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0b15784a-2578-4d56-a73c-690aea8490ba tempest-ServerRescueNegativeTestJSON-1898739226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-06903bb5-8f3e-4a11-91cb-a5f0944457ef {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:18:15 devstack sudo[88978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-06903bb5-8f3e-4a11-91cb-a5f0944457ef Jun 02 03:18:15 devstack sudo[88978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:18:16 devstack sudo[88978]: pam_unix(sudo:session): session closed for user root Jun 02 03:18:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0b15784a-2578-4d56-a73c-690aea8490ba tempest-ServerRescueNegativeTestJSON-1898739226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-06903bb5-8f3e-4a11-91cb-a5f0944457ef" returned: 0 in 0.868s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:18:16 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0b15784a-2578-4d56-a73c-690aea8490ba tempest-ServerRescueNegativeTestJSON-1898739226 None] <== create_volume: return (2771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:18:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0b15784a-2578-4d56-a73c-690aea8490ba tempest-ServerRescueNegativeTestJSON-1898739226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.778s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:18:16 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0b15784a-2578-4d56-a73c-690aea8490ba tempest-ServerRescueNegativeTestJSON-1898739226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0221e958-d4fb-430f-814c-e81fe8196570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06903bb5-8f3e-4a11-91cb-a5f0944457ef', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:18:16 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0b15784a-2578-4d56-a73c-690aea8490ba tempest-ServerRescueNegativeTestJSON-1898739226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f07e401-a2d7-45cf-8b7b-bf0e0f73d98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:18:16 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-0b15784a-2578-4d56-a73c-690aea8490ba tempest-ServerRescueNegativeTestJSON-1898739226 None] Volume volume-06903bb5-8f3e-4a11-91cb-a5f0944457ef (06903bb5-8f3e-4a11-91cb-a5f0944457ef): created successfully Jun 02 03:18:16 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0b15784a-2578-4d56-a73c-690aea8490ba tempest-ServerRescueNegativeTestJSON-1898739226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f07e401-a2d7-45cf-8b7b-bf0e0f73d98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:18:16 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0b15784a-2578-4d56-a73c-690aea8490ba tempest-ServerRescueNegativeTestJSON-1898739226 None] Flow 'volume_create_manager' (61496f9a-bfb1-4558-ab51-7dd4dd3a5738) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:18:16 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-0b15784a-2578-4d56-a73c-690aea8490ba tempest-ServerRescueNegativeTestJSON-1898739226 None] Created volume successfully. Jun 02 03:18:26 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:18:26 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:18:30 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fa177d0-bf63-4174-94bf-c9c41bf98e82 tempest-AttachVolumeTestJSON-1448729226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:18:30 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0fa177d0-bf63-4174-94bf-c9c41bf98e82 tempest-AttachVolumeTestJSON-1448729226 None] Flow 'volume_create_manager' (e54c6003-e92a-41a0-9cfc-2bf15206d994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:18:30 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0fa177d0-bf63-4174-94bf-c9c41bf98e82 tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a32576-0831-4eab-b664-abd9fb74a09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:18:30 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0fa177d0-bf63-4174-94bf-c9c41bf98e82 tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a32576-0831-4eab-b664-abd9fb74a09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2108914023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eb30b29-e4be-4f59-aac3-86c634efa0eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115386977b8e4618a3fa08387dc03f78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:18:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:18:31Z,use_quota=True,user_id='f750d23b6b4b4383b904a6328bcd3208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:18:30 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0fa177d0-bf63-4174-94bf-c9c41bf98e82 tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bbfe663-8fcd-4b67-a8bd-ac3ac36781f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:18:30 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0fa177d0-bf63-4174-94bf-c9c41bf98e82 tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bbfe663-8fcd-4b67-a8bd-ac3ac36781f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:18:30 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0fa177d0-bf63-4174-94bf-c9c41bf98e82 tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (159c88fa-f625-4f9f-b01b-8b243de1f05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:18:30 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0fa177d0-bf63-4174-94bf-c9c41bf98e82 tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (159c88fa-f625-4f9f-b01b-8b243de1f05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eb30b29-e4be-4f59-aac3-86c634efa0eb', 'volume_name': 'volume-8eb30b29-e4be-4f59-aac3-86c634efa0eb', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:18:30 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0fa177d0-bf63-4174-94bf-c9c41bf98e82 tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45735f4b-1117-46b2-8601-bf0f3b73ff90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:18:30 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0fa177d0-bf63-4174-94bf-c9c41bf98e82 tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45735f4b-1117-46b2-8601-bf0f3b73ff90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:18:30 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0fa177d0-bf63-4174-94bf-c9c41bf98e82 tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f12cc6b5-eb08-4955-a9da-daba2f444d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:18:30 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-0fa177d0-bf63-4174-94bf-c9c41bf98e82 tempest-AttachVolumeTestJSON-1448729226 None] Volume 8eb30b29-e4be-4f59-aac3-86c634efa0eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eb30b29-e4be-4f59-aac3-86c634efa0eb', 'volume_size': 1} Jun 02 03:18:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0fa177d0-bf63-4174-94bf-c9c41bf98e82 tempest-AttachVolumeTestJSON-1448729226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:18:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0fa177d0-bf63-4174-94bf-c9c41bf98e82 tempest-AttachVolumeTestJSON-1448729226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:18:30 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0fa177d0-bf63-4174-94bf-c9c41bf98e82 tempest-AttachVolumeTestJSON-1448729226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2108914023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eb30b29-e4be-4f59-aac3-86c634efa0eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115386977b8e4618a3fa08387dc03f78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:18:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:18:31Z,use_quota=True,user_id='f750d23b6b4b4383b904a6328bcd3208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:18:30 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-0fa177d0-bf63-4174-94bf-c9c41bf98e82 tempest-AttachVolumeTestJSON-1448729226 None] Creating volume 8eb30b29-e4be-4f59-aac3-86c634efa0eb {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:18:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0fa177d0-bf63-4174-94bf-c9c41bf98e82 tempest-AttachVolumeTestJSON-1448729226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:18:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0fa177d0-bf63-4174-94bf-c9c41bf98e82 tempest-AttachVolumeTestJSON-1448729226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:18:30 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0fa177d0-bf63-4174-94bf-c9c41bf98e82 tempest-AttachVolumeTestJSON-1448729226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:18:30 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0fa177d0-bf63-4174-94bf-c9c41bf98e82 tempest-AttachVolumeTestJSON-1448729226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:18:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0fa177d0-bf63-4174-94bf-c9c41bf98e82 tempest-AttachVolumeTestJSON-1448729226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:18:30 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0fa177d0-bf63-4174-94bf-c9c41bf98e82 tempest-AttachVolumeTestJSON-1448729226 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:18:30 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-0fa177d0-bf63-4174-94bf-c9c41bf98e82 tempest-AttachVolumeTestJSON-1448729226 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:18:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0fa177d0-bf63-4174-94bf-c9c41bf98e82 tempest-AttachVolumeTestJSON-1448729226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8eb30b29-e4be-4f59-aac3-86c634efa0eb 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:18:30 devstack sudo[89212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8eb30b29-e4be-4f59-aac3-86c634efa0eb 1073741824 Jun 02 03:18:30 devstack sudo[89212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:18:32 devstack sudo[89212]: pam_unix(sudo:session): session closed for user root Jun 02 03:18:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0fa177d0-bf63-4174-94bf-c9c41bf98e82 tempest-AttachVolumeTestJSON-1448729226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8eb30b29-e4be-4f59-aac3-86c634efa0eb 1073741824" returned: 0 in 1.101s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:18:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0fa177d0-bf63-4174-94bf-c9c41bf98e82 tempest-AttachVolumeTestJSON-1448729226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8eb30b29-e4be-4f59-aac3-86c634efa0eb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:18:32 devstack sudo[89267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8eb30b29-e4be-4f59-aac3-86c634efa0eb Jun 02 03:18:32 devstack sudo[89267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:18:32 devstack sudo[89267]: pam_unix(sudo:session): session closed for user root Jun 02 03:18:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0fa177d0-bf63-4174-94bf-c9c41bf98e82 tempest-AttachVolumeTestJSON-1448729226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8eb30b29-e4be-4f59-aac3-86c634efa0eb" returned: 0 in 0.733s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:18:32 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0fa177d0-bf63-4174-94bf-c9c41bf98e82 tempest-AttachVolumeTestJSON-1448729226 None] <== create_volume: return (1876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:18:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0fa177d0-bf63-4174-94bf-c9c41bf98e82 tempest-AttachVolumeTestJSON-1448729226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:18:32 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0fa177d0-bf63-4174-94bf-c9c41bf98e82 tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f12cc6b5-eb08-4955-a9da-daba2f444d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eb30b29-e4be-4f59-aac3-86c634efa0eb', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:18:32 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0fa177d0-bf63-4174-94bf-c9c41bf98e82 tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0593ad31-f3cb-4d6d-82cb-42b4708533ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:18:32 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-0fa177d0-bf63-4174-94bf-c9c41bf98e82 tempest-AttachVolumeTestJSON-1448729226 None] Volume volume-8eb30b29-e4be-4f59-aac3-86c634efa0eb (8eb30b29-e4be-4f59-aac3-86c634efa0eb): created successfully Jun 02 03:18:32 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0fa177d0-bf63-4174-94bf-c9c41bf98e82 tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0593ad31-f3cb-4d6d-82cb-42b4708533ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:18:32 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0fa177d0-bf63-4174-94bf-c9c41bf98e82 tempest-AttachVolumeTestJSON-1448729226 None] Flow 'volume_create_manager' (e54c6003-e92a-41a0-9cfc-2bf15206d994) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:18:32 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-0fa177d0-bf63-4174-94bf-c9c41bf98e82 tempest-AttachVolumeTestJSON-1448729226 None] Created volume successfully. Jun 02 03:18:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-c0c6592f-52e3-4f98-a993-45ff9e6ef721 tempest-ServerRescueNegativeTestJSON-1898739226 None] Acquiring lock "cinder-06903bb5-8f3e-4a11-91cb-a5f0944457ef-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:18:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-c0c6592f-52e3-4f98-a993-45ff9e6ef721 tempest-ServerRescueNegativeTestJSON-1898739226 None] Lock "cinder-06903bb5-8f3e-4a11-91cb-a5f0944457ef-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:18:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-c0c6592f-52e3-4f98-a993-45ff9e6ef721 tempest-ServerRescueNegativeTestJSON-1898739226 None] Acquiring lock "cinder-quobyte-06903bb5-8f3e-4a11-91cb-a5f0944457ef" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:18:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-c0c6592f-52e3-4f98-a993-45ff9e6ef721 tempest-ServerRescueNegativeTestJSON-1898739226 None] Lock "cinder-quobyte-06903bb5-8f3e-4a11-91cb-a5f0944457ef" acquired by "delete_volume" :: waited 0.022s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:18:34 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[256018e1-cf38-49b3-a09d-927ae9e165f0]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:18:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c0c6592f-52e3-4f98-a993-45ff9e6ef721 tempest-ServerRescueNegativeTestJSON-1898739226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-06903bb5-8f3e-4a11-91cb-a5f0944457ef {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:18:34 devstack sudo[89311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-06903bb5-8f3e-4a11-91cb-a5f0944457ef Jun 02 03:18:34 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:18:35 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root Jun 02 03:18:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c0c6592f-52e3-4f98-a993-45ff9e6ef721 tempest-ServerRescueNegativeTestJSON-1898739226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-06903bb5-8f3e-4a11-91cb-a5f0944457ef" returned: 0 in 0.841s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:18:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c0c6592f-52e3-4f98-a993-45ff9e6ef721 tempest-ServerRescueNegativeTestJSON-1898739226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-06903bb5-8f3e-4a11-91cb-a5f0944457ef {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:18:35 devstack sudo[89316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-06903bb5-8f3e-4a11-91cb-a5f0944457ef Jun 02 03:18:35 devstack sudo[89316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:18:36 devstack sudo[89316]: pam_unix(sudo:session): session closed for user root Jun 02 03:18:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c0c6592f-52e3-4f98-a993-45ff9e6ef721 tempest-ServerRescueNegativeTestJSON-1898739226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-06903bb5-8f3e-4a11-91cb-a5f0944457ef" returned: 0 in 0.639s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:18:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-c0c6592f-52e3-4f98-a993-45ff9e6ef721 tempest-ServerRescueNegativeTestJSON-1898739226 None] Lock "cinder-quobyte-06903bb5-8f3e-4a11-91cb-a5f0944457ef" released by "delete_volume" :: held 1.529s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:18:36 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-c0c6592f-52e3-4f98-a993-45ff9e6ef721 tempest-ServerRescueNegativeTestJSON-1898739226 None] Created reservations ['3ebcb167-6f3c-4e8e-8b9b-80b6ff545a3c', '6fe349b5-c68b-479e-926d-d4b851dfc62f', '25a6f1c8-3007-4fdc-9efa-8e61c928fadb', '1757d07c-6eb5-4818-b50f-9d7a8e065e02'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:18:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c0c6592f-52e3-4f98-a993-45ff9e6ef721 tempest-ServerRescueNegativeTestJSON-1898739226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:18:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c0c6592f-52e3-4f98-a993-45ff9e6ef721 tempest-ServerRescueNegativeTestJSON-1898739226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:18:36 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-c0c6592f-52e3-4f98-a993-45ff9e6ef721 tempest-ServerRescueNegativeTestJSON-1898739226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:18:36 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-c0c6592f-52e3-4f98-a993-45ff9e6ef721 tempest-ServerRescueNegativeTestJSON-1898739226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:18:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c0c6592f-52e3-4f98-a993-45ff9e6ef721 tempest-ServerRescueNegativeTestJSON-1898739226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:18:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c0c6592f-52e3-4f98-a993-45ff9e6ef721 tempest-ServerRescueNegativeTestJSON-1898739226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:18:36 devstack sudo[89319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:18:36 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:18:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-07c3e057-4b25-4c21-b4d5-1596b1ee8f40 req-746daecb-94e3-4181-9048-19b6a78327e2 tempest-AttachVolumeTestJSON-1448729226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:18:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-07c3e057-4b25-4c21-b4d5-1596b1ee8f40 req-746daecb-94e3-4181-9048-19b6a78327e2 tempest-AttachVolumeTestJSON-1448729226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:18:37 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1cdacc-b977-4d90-b34f-f0d84e12f728]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:18:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-07c3e057-4b25-4c21-b4d5-1596b1ee8f40 req-746daecb-94e3-4181-9048-19b6a78327e2 tempest-AttachVolumeTestJSON-1448729226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8eb30b29-e4be-4f59-aac3-86c634efa0eb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:18:37 devstack sudo[89330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8eb30b29-e4be-4f59-aac3-86c634efa0eb Jun 02 03:18:37 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:18:37 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root Jun 02 03:18:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c0c6592f-52e3-4f98-a993-45ff9e6ef721 tempest-ServerRescueNegativeTestJSON-1898739226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 1.208s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:18:37 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-c0c6592f-52e3-4f98-a993-45ff9e6ef721 tempest-ServerRescueNegativeTestJSON-1898739226 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:18:37 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-c0c6592f-52e3-4f98-a993-45ff9e6ef721 tempest-ServerRescueNegativeTestJSON-1898739226 None] Deleted volume successfully. Jun 02 03:18:37 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-c0c6592f-52e3-4f98-a993-45ff9e6ef721 tempest-ServerRescueNegativeTestJSON-1898739226 None] Lock "cinder-06903bb5-8f3e-4a11-91cb-a5f0944457ef-delete_volume" released by "delete_volume" :: held 3.117s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:18:38 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root Jun 02 03:18:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-07c3e057-4b25-4c21-b4d5-1596b1ee8f40 req-746daecb-94e3-4181-9048-19b6a78327e2 tempest-AttachVolumeTestJSON-1448729226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8eb30b29-e4be-4f59-aac3-86c634efa0eb" returned: 0 in 1.326s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:18:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-07c3e057-4b25-4c21-b4d5-1596b1ee8f40 req-746daecb-94e3-4181-9048-19b6a78327e2 tempest-AttachVolumeTestJSON-1448729226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.392s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:18:38 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-07c3e057-4b25-4c21-b4d5-1596b1ee8f40 req-746daecb-94e3-4181-9048-19b6a78327e2 tempest-AttachVolumeTestJSON-1448729226 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1', 'name': 'volume-8eb30b29-e4be-4f59-aac3-86c634efa0eb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a42b130c-e5c8-4796-9414-2ef71c908ae0', 'enforce_multipath': True} {{(pid=86431) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 02 03:18:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-0b9e5f04-8927-45c7-b3c4-f3d8fa6effa5 req-28d7eaa6-c6cd-4ca7-b28f-f49ee4703329 tempest-ServerActionsTestOtherA-1952099514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:18:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-0b9e5f04-8927-45c7-b3c4-f3d8fa6effa5 req-28d7eaa6-c6cd-4ca7-b28f-f49ee4703329 tempest-ServerActionsTestOtherA-1952099514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:18:38 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-07c3e057-4b25-4c21-b4d5-1596b1ee8f40 req-746daecb-94e3-4181-9048-19b6a78327e2 tempest-AttachVolumeTestJSON-1448729226 None] attachment_update completed successfully. Jun 02 03:18:38 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e172ec8-c7c3-4769-ab20-8da9faee1721]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:18:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-0b9e5f04-8927-45c7-b3c4-f3d8fa6effa5 req-28d7eaa6-c6cd-4ca7-b28f-f49ee4703329 tempest-ServerActionsTestOtherA-1952099514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f3df71c5-91c3-4849-9d66-878c927fc84d {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:18:38 devstack sudo[89377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f3df71c5-91c3-4849-9d66-878c927fc84d Jun 02 03:18:38 devstack sudo[89377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:18:39 devstack sudo[89377]: pam_unix(sudo:session): session closed for user root Jun 02 03:18:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-0b9e5f04-8927-45c7-b3c4-f3d8fa6effa5 req-28d7eaa6-c6cd-4ca7-b28f-f49ee4703329 tempest-ServerActionsTestOtherA-1952099514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f3df71c5-91c3-4849-9d66-878c927fc84d" returned: 0 in 0.919s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:18:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-0b9e5f04-8927-45c7-b3c4-f3d8fa6effa5 req-28d7eaa6-c6cd-4ca7-b28f-f49ee4703329 tempest-ServerActionsTestOtherA-1952099514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.948s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:18:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-0b9e5f04-8927-45c7-b3c4-f3d8fa6effa5 req-28d7eaa6-c6cd-4ca7-b28f-f49ee4703329 tempest-ServerActionsTestOtherA-1952099514 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1', 'name': 'volume-f3df71c5-91c3-4849-9d66-878c927fc84d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a33f8ae9-798f-4878-8073-4fa2183f343b', 'enforce_multipath': True} {{(pid=86431) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 02 03:18:39 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-0b9e5f04-8927-45c7-b3c4-f3d8fa6effa5 req-28d7eaa6-c6cd-4ca7-b28f-f49ee4703329 tempest-ServerActionsTestOtherA-1952099514 None] attachment_update completed successfully. Jun 02 03:18:47 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-0c0fd84a-2991-4558-b706-c96ea551119d req-cb2931bf-ed07-4b73-8ba9-cf317b6afef8 tempest-ServerActionsTestOtherA-1952099514 None] Terminate volume connection completed successfully. Jun 02 03:18:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-0c0fd84a-2991-4558-b706-c96ea551119d req-cb2931bf-ed07-4b73-8ba9-cf317b6afef8 tempest-ServerActionsTestOtherA-1952099514 None] Deleting attachment a33f8ae9-798f-4878-8073-4fa2183f343b. {{(pid=86431) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 02 03:18:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-0c0fd84a-2991-4558-b706-c96ea551119d req-be319f3f-1faf-4f61-8c75-580e9c082900 tempest-ServerActionsTestOtherA-1952099514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:18:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-0c0fd84a-2991-4558-b706-c96ea551119d req-be319f3f-1faf-4f61-8c75-580e9c082900 tempest-ServerActionsTestOtherA-1952099514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:18:50 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f77b1f6-febe-4f84-83df-a9b91e34aa71]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:18:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-0c0fd84a-2991-4558-b706-c96ea551119d req-be319f3f-1faf-4f61-8c75-580e9c082900 tempest-ServerActionsTestOtherA-1952099514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f3df71c5-91c3-4849-9d66-878c927fc84d {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:18:50 devstack sudo[89937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f3df71c5-91c3-4849-9d66-878c927fc84d Jun 02 03:18:50 devstack sudo[89937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:18:50 devstack sudo[89937]: pam_unix(sudo:session): session closed for user root Jun 02 03:18:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-0c0fd84a-2991-4558-b706-c96ea551119d req-be319f3f-1faf-4f61-8c75-580e9c082900 tempest-ServerActionsTestOtherA-1952099514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f3df71c5-91c3-4849-9d66-878c927fc84d" returned: 0 in 0.726s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:18:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-0c0fd84a-2991-4558-b706-c96ea551119d req-be319f3f-1faf-4f61-8c75-580e9c082900 tempest-ServerActionsTestOtherA-1952099514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.746s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:18:50 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-0c0fd84a-2991-4558-b706-c96ea551119d req-be319f3f-1faf-4f61-8c75-580e9c082900 tempest-ServerActionsTestOtherA-1952099514 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1', 'name': 'volume-f3df71c5-91c3-4849-9d66-878c927fc84d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '792396eb-f21a-4505-8a36-c1c528c69fb6', 'enforce_multipath': True} {{(pid=86431) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 02 03:18:51 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-0c0fd84a-2991-4558-b706-c96ea551119d req-be319f3f-1faf-4f61-8c75-580e9c082900 tempest-ServerActionsTestOtherA-1952099514 None] attachment_update completed successfully. Jun 02 03:19:01 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=29,cinder:UPDATE=9,cinder:DELETE=2,cinder:INSERT=2 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:19:05 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:UPDATE=23,cinder:SELECT=21,cinder:INSERT=3 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:19:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-7e4d580c-6fa3-4653-8bfd-86ec2f0e6417 req-16d6a63a-3f74-48b8-ad59-1832e2e8a37c tempest-TaggedAttachmentsTest-1226748328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:19:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-7e4d580c-6fa3-4653-8bfd-86ec2f0e6417 req-16d6a63a-3f74-48b8-ad59-1832e2e8a37c tempest-TaggedAttachmentsTest-1226748328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:19:09 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[08372a99-4809-4cf4-8e46-800b9d2890c3]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:19:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-7e4d580c-6fa3-4653-8bfd-86ec2f0e6417 req-16d6a63a-3f74-48b8-ad59-1832e2e8a37c tempest-TaggedAttachmentsTest-1226748328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d5eb3407-e878-4790-afdc-b7be0a453bac {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:19:09 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:19:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:19:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:19:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:19:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:19:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:19:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:19:09 devstack sudo[90558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:19:09 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:19:09 devstack sudo[90557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d5eb3407-e878-4790-afdc-b7be0a453bac Jun 02 03:19:09 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:19:10 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root Jun 02 03:19:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 1.351s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:19:10 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:19:10 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager._thread_info {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:19:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread count: 8 {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 02 03:19:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread info: [<_MainThread(MainThread, started 138618128814208)>, , , , , , , ] {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 02 03:19:11 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root Jun 02 03:19:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-7e4d580c-6fa3-4653-8bfd-86ec2f0e6417 req-16d6a63a-3f74-48b8-ad59-1832e2e8a37c tempest-TaggedAttachmentsTest-1226748328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d5eb3407-e878-4790-afdc-b7be0a453bac" returned: 0 in 1.851s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:19:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-7e4d580c-6fa3-4653-8bfd-86ec2f0e6417 req-16d6a63a-3f74-48b8-ad59-1832e2e8a37c tempest-TaggedAttachmentsTest-1226748328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.889s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:19:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-7e4d580c-6fa3-4653-8bfd-86ec2f0e6417 req-16d6a63a-3f74-48b8-ad59-1832e2e8a37c tempest-TaggedAttachmentsTest-1226748328 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1', 'name': 'volume-d5eb3407-e878-4790-afdc-b7be0a453bac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a7bf4ad-16be-477b-8835-3c7c57ddb1b3', 'enforce_multipath': True} {{(pid=86431) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 02 03:19:11 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-7e4d580c-6fa3-4653-8bfd-86ec2f0e6417 req-16d6a63a-3f74-48b8-ad59-1832e2e8a37c tempest-TaggedAttachmentsTest-1226748328 None] attachment_update completed successfully. Jun 02 03:19:18 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-8d0aa51b-f40f-47e5-847b-2923e7f4be1b req-b0ad59d4-e67f-4640-8ba0-05af46d9fc9f tempest-TaggedAttachmentsTest-1226748328 None] Terminate volume connection completed successfully. Jun 02 03:19:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-8d0aa51b-f40f-47e5-847b-2923e7f4be1b req-b0ad59d4-e67f-4640-8ba0-05af46d9fc9f tempest-TaggedAttachmentsTest-1226748328 None] Deleting attachment 3a7bf4ad-16be-477b-8835-3c7c57ddb1b3. {{(pid=86431) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 02 03:19:21 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:19:23 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-5b1d5706-2446-4b7c-ac86-fe3f830ef246 req-66b0774c-2395-44d4-9c23-4bb7082bae9c tempest-AttachVolumeTestJSON-1448729226 None] Terminate volume connection completed successfully. Jun 02 03:19:23 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-5b1d5706-2446-4b7c-ac86-fe3f830ef246 req-66b0774c-2395-44d4-9c23-4bb7082bae9c tempest-AttachVolumeTestJSON-1448729226 None] Deleting attachment a42b130c-e5c8-4796-9414-2ef71c908ae0. {{(pid=86431) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 02 03:19:23 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-e2e9e655-285c-4af6-9095-ad067bbf521e req-96bc6dfc-1b32-4ec3-8579-de31b570a9e1 tempest-ServerActionsTestOtherA-1952099514 None] Terminate volume connection completed successfully. Jun 02 03:19:23 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-e2e9e655-285c-4af6-9095-ad067bbf521e req-96bc6dfc-1b32-4ec3-8579-de31b570a9e1 tempest-ServerActionsTestOtherA-1952099514 None] Deleting attachment 792396eb-f21a-4505-8a36-c1c528c69fb6. {{(pid=86431) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 02 03:19:33 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=1 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:19:33 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=12,cinder:UPDATE=2 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:19:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b840e236-b95c-4863-8732-6864aebeee3f tempest-ServerActionsTestOtherA-1952099514 None] Acquiring lock "cinder-f3df71c5-91c3-4849-9d66-878c927fc84d-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:19:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b840e236-b95c-4863-8732-6864aebeee3f tempest-ServerActionsTestOtherA-1952099514 None] Lock "cinder-f3df71c5-91c3-4849-9d66-878c927fc84d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:19:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b840e236-b95c-4863-8732-6864aebeee3f tempest-ServerActionsTestOtherA-1952099514 None] Acquiring lock "cinder-quobyte-f3df71c5-91c3-4849-9d66-878c927fc84d" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:19:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b840e236-b95c-4863-8732-6864aebeee3f tempest-ServerActionsTestOtherA-1952099514 None] Lock "cinder-quobyte-f3df71c5-91c3-4849-9d66-878c927fc84d" acquired by "delete_volume" :: waited 0.022s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:19:34 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74f97b2-8798-4443-801c-02a8d6f08521]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:19:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b840e236-b95c-4863-8732-6864aebeee3f tempest-ServerActionsTestOtherA-1952099514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f3df71c5-91c3-4849-9d66-878c927fc84d {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:19:35 devstack sudo[90974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f3df71c5-91c3-4849-9d66-878c927fc84d Jun 02 03:19:35 devstack sudo[90974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:19:35 devstack sudo[90974]: pam_unix(sudo:session): session closed for user root Jun 02 03:19:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b840e236-b95c-4863-8732-6864aebeee3f tempest-ServerActionsTestOtherA-1952099514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f3df71c5-91c3-4849-9d66-878c927fc84d" returned: 0 in 0.811s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:19:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b840e236-b95c-4863-8732-6864aebeee3f tempest-ServerActionsTestOtherA-1952099514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f3df71c5-91c3-4849-9d66-878c927fc84d {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:19:35 devstack sudo[90986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f3df71c5-91c3-4849-9d66-878c927fc84d Jun 02 03:19:35 devstack sudo[90986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:19:36 devstack sudo[90986]: pam_unix(sudo:session): session closed for user root Jun 02 03:19:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b840e236-b95c-4863-8732-6864aebeee3f tempest-ServerActionsTestOtherA-1952099514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f3df71c5-91c3-4849-9d66-878c927fc84d" returned: 0 in 0.711s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:19:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b840e236-b95c-4863-8732-6864aebeee3f tempest-ServerActionsTestOtherA-1952099514 None] Lock "cinder-quobyte-f3df71c5-91c3-4849-9d66-878c927fc84d" released by "delete_volume" :: held 1.585s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:19:36 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-b840e236-b95c-4863-8732-6864aebeee3f tempest-ServerActionsTestOtherA-1952099514 None] Created reservations ['186cce1c-ccc6-47e7-948b-d04790fffb9a', '40697d42-c6c1-442c-975c-7a62858b5189', '25112052-30cd-4d8f-91d6-af6772958a60', '97df0fcb-3326-4f3c-8528-313480712804'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:19:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b840e236-b95c-4863-8732-6864aebeee3f tempest-ServerActionsTestOtherA-1952099514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:19:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b840e236-b95c-4863-8732-6864aebeee3f tempest-ServerActionsTestOtherA-1952099514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:19:36 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b840e236-b95c-4863-8732-6864aebeee3f tempest-ServerActionsTestOtherA-1952099514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:19:36 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b840e236-b95c-4863-8732-6864aebeee3f tempest-ServerActionsTestOtherA-1952099514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:19:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b840e236-b95c-4863-8732-6864aebeee3f tempest-ServerActionsTestOtherA-1952099514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:19:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b840e236-b95c-4863-8732-6864aebeee3f tempest-ServerActionsTestOtherA-1952099514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:19:36 devstack sudo[90996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:19:36 devstack sudo[90996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:19:37 devstack sudo[90996]: pam_unix(sudo:session): session closed for user root Jun 02 03:19:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b840e236-b95c-4863-8732-6864aebeee3f tempest-ServerActionsTestOtherA-1952099514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 1.070s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:19:37 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-b840e236-b95c-4863-8732-6864aebeee3f tempest-ServerActionsTestOtherA-1952099514 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:19:37 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-b840e236-b95c-4863-8732-6864aebeee3f tempest-ServerActionsTestOtherA-1952099514 None] Deleted volume successfully. Jun 02 03:19:37 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b840e236-b95c-4863-8732-6864aebeee3f tempest-ServerActionsTestOtherA-1952099514 None] Lock "cinder-f3df71c5-91c3-4849-9d66-878c927fc84d-delete_volume" released by "delete_volume" :: held 2.960s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:19:38 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7cfd1d6e-d818-4937-9e3f-b4f698f26b43 tempest-TaggedAttachmentsTest-1226748328 None] Acquiring lock "cinder-d5eb3407-e878-4790-afdc-b7be0a453bac-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:19:38 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7cfd1d6e-d818-4937-9e3f-b4f698f26b43 tempest-TaggedAttachmentsTest-1226748328 None] Lock "cinder-d5eb3407-e878-4790-afdc-b7be0a453bac-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:19:38 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7cfd1d6e-d818-4937-9e3f-b4f698f26b43 tempest-TaggedAttachmentsTest-1226748328 None] Acquiring lock "cinder-quobyte-d5eb3407-e878-4790-afdc-b7be0a453bac" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:19:39 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7cfd1d6e-d818-4937-9e3f-b4f698f26b43 tempest-TaggedAttachmentsTest-1226748328 None] Lock "cinder-quobyte-d5eb3407-e878-4790-afdc-b7be0a453bac" acquired by "delete_volume" :: waited 0.050s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:19:39 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d11812a-4436-4ca4-97ec-532b017156fa]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:19:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7cfd1d6e-d818-4937-9e3f-b4f698f26b43 tempest-TaggedAttachmentsTest-1226748328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d5eb3407-e878-4790-afdc-b7be0a453bac {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:19:39 devstack sudo[91090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d5eb3407-e878-4790-afdc-b7be0a453bac Jun 02 03:19:39 devstack sudo[91090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:19:40 devstack sudo[91090]: pam_unix(sudo:session): session closed for user root Jun 02 03:19:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7cfd1d6e-d818-4937-9e3f-b4f698f26b43 tempest-TaggedAttachmentsTest-1226748328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d5eb3407-e878-4790-afdc-b7be0a453bac" returned: 0 in 1.362s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:19:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7cfd1d6e-d818-4937-9e3f-b4f698f26b43 tempest-TaggedAttachmentsTest-1226748328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d5eb3407-e878-4790-afdc-b7be0a453bac {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:19:40 devstack sudo[91114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d5eb3407-e878-4790-afdc-b7be0a453bac Jun 02 03:19:40 devstack sudo[91114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:19:41 devstack sudo[91114]: pam_unix(sudo:session): session closed for user root Jun 02 03:19:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7cfd1d6e-d818-4937-9e3f-b4f698f26b43 tempest-TaggedAttachmentsTest-1226748328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d5eb3407-e878-4790-afdc-b7be0a453bac" returned: 0 in 1.376s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:19:41 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7cfd1d6e-d818-4937-9e3f-b4f698f26b43 tempest-TaggedAttachmentsTest-1226748328 None] Lock "cinder-quobyte-d5eb3407-e878-4790-afdc-b7be0a453bac" released by "delete_volume" :: held 2.822s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:19:41 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-7cfd1d6e-d818-4937-9e3f-b4f698f26b43 tempest-TaggedAttachmentsTest-1226748328 None] Created reservations ['b3d828a3-96ad-4e24-b4a9-169aa218992b', '9cf4a7a2-be75-4696-92cf-2dfea8f4b3dc', '20d76ad4-e639-4aea-ab39-56b9404056b6', 'ad3b48f4-daa3-4690-85b7-9da2cf308447'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:19:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7cfd1d6e-d818-4937-9e3f-b4f698f26b43 tempest-TaggedAttachmentsTest-1226748328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:19:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7cfd1d6e-d818-4937-9e3f-b4f698f26b43 tempest-TaggedAttachmentsTest-1226748328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:19:42 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-7cfd1d6e-d818-4937-9e3f-b4f698f26b43 tempest-TaggedAttachmentsTest-1226748328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:19:42 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-7cfd1d6e-d818-4937-9e3f-b4f698f26b43 tempest-TaggedAttachmentsTest-1226748328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:19:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7cfd1d6e-d818-4937-9e3f-b4f698f26b43 tempest-TaggedAttachmentsTest-1226748328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:19:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7cfd1d6e-d818-4937-9e3f-b4f698f26b43 tempest-TaggedAttachmentsTest-1226748328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:19:42 devstack sudo[91120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:19:42 devstack sudo[91120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:19:43 devstack sudo[91120]: pam_unix(sudo:session): session closed for user root Jun 02 03:19:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7cfd1d6e-d818-4937-9e3f-b4f698f26b43 tempest-TaggedAttachmentsTest-1226748328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.968s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:19:43 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-7cfd1d6e-d818-4937-9e3f-b4f698f26b43 tempest-TaggedAttachmentsTest-1226748328 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:19:43 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-7cfd1d6e-d818-4937-9e3f-b4f698f26b43 tempest-TaggedAttachmentsTest-1226748328 None] Deleted volume successfully. Jun 02 03:19:43 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7cfd1d6e-d818-4937-9e3f-b4f698f26b43 tempest-TaggedAttachmentsTest-1226748328 None] Lock "cinder-d5eb3407-e878-4790-afdc-b7be0a453bac-delete_volume" released by "delete_volume" :: held 4.257s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:19:52 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=9,cinder:INSERT=2,cinder:UPDATE=15 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:19:53 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:UPDATE=17,cinder:SELECT=11,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:19:53 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef4d8c15-b691-46aa-ba28-6a32ab0b9736 tempest-AttachVolumeNegativeTest-1165991087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:19:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ef4d8c15-b691-46aa-ba28-6a32ab0b9736 tempest-AttachVolumeNegativeTest-1165991087 None] Flow 'volume_create_manager' (2e79ed91-c177-448b-b075-441c8ced3568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:19:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ef4d8c15-b691-46aa-ba28-6a32ab0b9736 tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f4c79be-6f05-4a08-a9a0-f34b6ef35049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:19:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ef4d8c15-b691-46aa-ba28-6a32ab0b9736 tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f4c79be-6f05-4a08-a9a0-f34b6ef35049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1056702460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f3824c7-901d-4494-8faf-5027c3245ad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b41b7af4a304478994e2e229f097aac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:19:54Z,use_quota=True,user_id='1bd56ed743484b4389ae541fd4268448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:19:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ef4d8c15-b691-46aa-ba28-6a32ab0b9736 tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffe85557-dc74-4908-a4c2-6b6affdc20f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:19:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ef4d8c15-b691-46aa-ba28-6a32ab0b9736 tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffe85557-dc74-4908-a4c2-6b6affdc20f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:19:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ef4d8c15-b691-46aa-ba28-6a32ab0b9736 tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (072877fb-246f-459b-af92-8e49214dd049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:19:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ef4d8c15-b691-46aa-ba28-6a32ab0b9736 tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (072877fb-246f-459b-af92-8e49214dd049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f3824c7-901d-4494-8faf-5027c3245ad8', 'volume_name': 'volume-3f3824c7-901d-4494-8faf-5027c3245ad8', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:19:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ef4d8c15-b691-46aa-ba28-6a32ab0b9736 tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c1b789-ca5b-43e1-9d52-fa06ad9e35bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:19:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ef4d8c15-b691-46aa-ba28-6a32ab0b9736 tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c1b789-ca5b-43e1-9d52-fa06ad9e35bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:19:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ef4d8c15-b691-46aa-ba28-6a32ab0b9736 tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b3c2f8-9fb0-447d-8554-b8be37b425e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:19:53 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-ef4d8c15-b691-46aa-ba28-6a32ab0b9736 tempest-AttachVolumeNegativeTest-1165991087 None] Volume 3f3824c7-901d-4494-8faf-5027c3245ad8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f3824c7-901d-4494-8faf-5027c3245ad8', 'volume_size': 1} Jun 02 03:19:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ef4d8c15-b691-46aa-ba28-6a32ab0b9736 tempest-AttachVolumeNegativeTest-1165991087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:19:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ef4d8c15-b691-46aa-ba28-6a32ab0b9736 tempest-AttachVolumeNegativeTest-1165991087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:19:53 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ef4d8c15-b691-46aa-ba28-6a32ab0b9736 tempest-AttachVolumeNegativeTest-1165991087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1056702460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f3824c7-901d-4494-8faf-5027c3245ad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b41b7af4a304478994e2e229f097aac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:19:54Z,use_quota=True,user_id='1bd56ed743484b4389ae541fd4268448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:19:53 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-ef4d8c15-b691-46aa-ba28-6a32ab0b9736 tempest-AttachVolumeNegativeTest-1165991087 None] Creating volume 3f3824c7-901d-4494-8faf-5027c3245ad8 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:19:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ef4d8c15-b691-46aa-ba28-6a32ab0b9736 tempest-AttachVolumeNegativeTest-1165991087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:19:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ef4d8c15-b691-46aa-ba28-6a32ab0b9736 tempest-AttachVolumeNegativeTest-1165991087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:19:54 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ef4d8c15-b691-46aa-ba28-6a32ab0b9736 tempest-AttachVolumeNegativeTest-1165991087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:19:54 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ef4d8c15-b691-46aa-ba28-6a32ab0b9736 tempest-AttachVolumeNegativeTest-1165991087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:19:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ef4d8c15-b691-46aa-ba28-6a32ab0b9736 tempest-AttachVolumeNegativeTest-1165991087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:19:54 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ef4d8c15-b691-46aa-ba28-6a32ab0b9736 tempest-AttachVolumeNegativeTest-1165991087 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:19:54 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-ef4d8c15-b691-46aa-ba28-6a32ab0b9736 tempest-AttachVolumeNegativeTest-1165991087 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:19:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ef4d8c15-b691-46aa-ba28-6a32ab0b9736 tempest-AttachVolumeNegativeTest-1165991087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3f3824c7-901d-4494-8faf-5027c3245ad8 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:19:54 devstack sudo[91151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3f3824c7-901d-4494-8faf-5027c3245ad8 1073741824 Jun 02 03:19:54 devstack sudo[91151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:19:54 devstack sudo[91151]: pam_unix(sudo:session): session closed for user root Jun 02 03:19:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ef4d8c15-b691-46aa-ba28-6a32ab0b9736 tempest-AttachVolumeNegativeTest-1165991087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3f3824c7-901d-4494-8faf-5027c3245ad8 1073741824" returned: 0 in 0.874s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:19:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ef4d8c15-b691-46aa-ba28-6a32ab0b9736 tempest-AttachVolumeNegativeTest-1165991087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3f3824c7-901d-4494-8faf-5027c3245ad8 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:19:55 devstack sudo[91167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3f3824c7-901d-4494-8faf-5027c3245ad8 Jun 02 03:19:55 devstack sudo[91167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:19:55 devstack sudo[91167]: pam_unix(sudo:session): session closed for user root Jun 02 03:19:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ef4d8c15-b691-46aa-ba28-6a32ab0b9736 tempest-AttachVolumeNegativeTest-1165991087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3f3824c7-901d-4494-8faf-5027c3245ad8" returned: 0 in 0.732s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:19:55 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ef4d8c15-b691-46aa-ba28-6a32ab0b9736 tempest-AttachVolumeNegativeTest-1165991087 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:19:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ef4d8c15-b691-46aa-ba28-6a32ab0b9736 tempest-AttachVolumeNegativeTest-1165991087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:19:55 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ef4d8c15-b691-46aa-ba28-6a32ab0b9736 tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b3c2f8-9fb0-447d-8554-b8be37b425e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f3824c7-901d-4494-8faf-5027c3245ad8', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:19:55 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ef4d8c15-b691-46aa-ba28-6a32ab0b9736 tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b22a9e5-2f78-4df0-974f-4428ed7438b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:19:55 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-ef4d8c15-b691-46aa-ba28-6a32ab0b9736 tempest-AttachVolumeNegativeTest-1165991087 None] Volume volume-3f3824c7-901d-4494-8faf-5027c3245ad8 (3f3824c7-901d-4494-8faf-5027c3245ad8): created successfully Jun 02 03:19:55 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ef4d8c15-b691-46aa-ba28-6a32ab0b9736 tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b22a9e5-2f78-4df0-974f-4428ed7438b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:19:55 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ef4d8c15-b691-46aa-ba28-6a32ab0b9736 tempest-AttachVolumeNegativeTest-1165991087 None] Flow 'volume_create_manager' (2e79ed91-c177-448b-b075-441c8ced3568) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:19:55 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-ef4d8c15-b691-46aa-ba28-6a32ab0b9736 tempest-AttachVolumeNegativeTest-1165991087 None] Created volume successfully. Jun 02 03:19:56 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [req-7077a73a-d33d-4d4a-bc9d-0560d0599fb9 req-7dd907f8-e09a-45a5-a06c-5808229b0a67 tempest-VolumesGetTestJSON-1124083599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:19:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-7077a73a-d33d-4d4a-bc9d-0560d0599fb9 req-7dd907f8-e09a-45a5-a06c-5808229b0a67 tempest-VolumesGetTestJSON-1124083599 None] Flow 'volume_create_manager' (483191e1-bf44-4add-a04a-2f89db691fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:19:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-7077a73a-d33d-4d4a-bc9d-0560d0599fb9 req-7dd907f8-e09a-45a5-a06c-5808229b0a67 tempest-VolumesGetTestJSON-1124083599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dbd2b2d-a5f7-4a78-992d-fb0224893abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:19:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-7077a73a-d33d-4d4a-bc9d-0560d0599fb9 req-7dd907f8-e09a-45a5-a06c-5808229b0a67 tempest-VolumesGetTestJSON-1124083599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dbd2b2d-a5f7-4a78-992d-fb0224893abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1822942402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b1a039-9b8c-4fa0-86a9-74d5665a2edb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0757b85ff8f946c39b7a63c9e21cdd88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:19:56Z,use_quota=True,user_id='c43abd495c9048c6a9eea161f0f7796d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:19:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-7077a73a-d33d-4d4a-bc9d-0560d0599fb9 req-7dd907f8-e09a-45a5-a06c-5808229b0a67 tempest-VolumesGetTestJSON-1124083599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843701b8-0feb-4c72-b8c4-d9dfbcb5a88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:19:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-7077a73a-d33d-4d4a-bc9d-0560d0599fb9 req-7dd907f8-e09a-45a5-a06c-5808229b0a67 tempest-VolumesGetTestJSON-1124083599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843701b8-0feb-4c72-b8c4-d9dfbcb5a88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:19:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-7077a73a-d33d-4d4a-bc9d-0560d0599fb9 req-7dd907f8-e09a-45a5-a06c-5808229b0a67 tempest-VolumesGetTestJSON-1124083599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c85c1fb5-a980-47d5-a95c-fb0f4c4f9247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:19:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-7077a73a-d33d-4d4a-bc9d-0560d0599fb9 req-7dd907f8-e09a-45a5-a06c-5808229b0a67 tempest-VolumesGetTestJSON-1124083599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c85c1fb5-a980-47d5-a95c-fb0f4c4f9247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32b1a039-9b8c-4fa0-86a9-74d5665a2edb', 'volume_name': 'volume-32b1a039-9b8c-4fa0-86a9-74d5665a2edb', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:19:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-7077a73a-d33d-4d4a-bc9d-0560d0599fb9 req-7dd907f8-e09a-45a5-a06c-5808229b0a67 tempest-VolumesGetTestJSON-1124083599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6577b265-de51-4702-a97d-18b79976959b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:19:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-7077a73a-d33d-4d4a-bc9d-0560d0599fb9 req-7dd907f8-e09a-45a5-a06c-5808229b0a67 tempest-VolumesGetTestJSON-1124083599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6577b265-de51-4702-a97d-18b79976959b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:19:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-7077a73a-d33d-4d4a-bc9d-0560d0599fb9 req-7dd907f8-e09a-45a5-a06c-5808229b0a67 tempest-VolumesGetTestJSON-1124083599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a469a8-7ae5-44d8-818d-783e4a87f449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:19:56 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [req-7077a73a-d33d-4d4a-bc9d-0560d0599fb9 req-7dd907f8-e09a-45a5-a06c-5808229b0a67 tempest-VolumesGetTestJSON-1124083599 None] Volume 32b1a039-9b8c-4fa0-86a9-74d5665a2edb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32b1a039-9b8c-4fa0-86a9-74d5665a2edb', 'volume_size': 1} Jun 02 03:19:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-7077a73a-d33d-4d4a-bc9d-0560d0599fb9 req-7dd907f8-e09a-45a5-a06c-5808229b0a67 tempest-VolumesGetTestJSON-1124083599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:19:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-7077a73a-d33d-4d4a-bc9d-0560d0599fb9 req-7dd907f8-e09a-45a5-a06c-5808229b0a67 tempest-VolumesGetTestJSON-1124083599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:19:56 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [req-7077a73a-d33d-4d4a-bc9d-0560d0599fb9 req-7dd907f8-e09a-45a5-a06c-5808229b0a67 tempest-VolumesGetTestJSON-1124083599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1822942402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b1a039-9b8c-4fa0-86a9-74d5665a2edb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0757b85ff8f946c39b7a63c9e21cdd88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:19:56Z,use_quota=True,user_id='c43abd495c9048c6a9eea161f0f7796d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:19:56 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [req-7077a73a-d33d-4d4a-bc9d-0560d0599fb9 req-7dd907f8-e09a-45a5-a06c-5808229b0a67 tempest-VolumesGetTestJSON-1124083599 None] Creating volume 32b1a039-9b8c-4fa0-86a9-74d5665a2edb {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:19:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-7077a73a-d33d-4d4a-bc9d-0560d0599fb9 req-7dd907f8-e09a-45a5-a06c-5808229b0a67 tempest-VolumesGetTestJSON-1124083599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:19:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-7077a73a-d33d-4d4a-bc9d-0560d0599fb9 req-7dd907f8-e09a-45a5-a06c-5808229b0a67 tempest-VolumesGetTestJSON-1124083599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:19:56 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [req-7077a73a-d33d-4d4a-bc9d-0560d0599fb9 req-7dd907f8-e09a-45a5-a06c-5808229b0a67 tempest-VolumesGetTestJSON-1124083599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:19:56 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [req-7077a73a-d33d-4d4a-bc9d-0560d0599fb9 req-7dd907f8-e09a-45a5-a06c-5808229b0a67 tempest-VolumesGetTestJSON-1124083599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:19:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-7077a73a-d33d-4d4a-bc9d-0560d0599fb9 req-7dd907f8-e09a-45a5-a06c-5808229b0a67 tempest-VolumesGetTestJSON-1124083599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:19:56 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [req-7077a73a-d33d-4d4a-bc9d-0560d0599fb9 req-7dd907f8-e09a-45a5-a06c-5808229b0a67 tempest-VolumesGetTestJSON-1124083599 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:19:56 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [req-7077a73a-d33d-4d4a-bc9d-0560d0599fb9 req-7dd907f8-e09a-45a5-a06c-5808229b0a67 tempest-VolumesGetTestJSON-1124083599 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:19:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-7077a73a-d33d-4d4a-bc9d-0560d0599fb9 req-7dd907f8-e09a-45a5-a06c-5808229b0a67 tempest-VolumesGetTestJSON-1124083599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-32b1a039-9b8c-4fa0-86a9-74d5665a2edb 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:19:56 devstack sudo[91174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-32b1a039-9b8c-4fa0-86a9-74d5665a2edb 1073741824 Jun 02 03:19:56 devstack sudo[91174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:19:57 devstack sudo[91174]: pam_unix(sudo:session): session closed for user root Jun 02 03:19:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-7077a73a-d33d-4d4a-bc9d-0560d0599fb9 req-7dd907f8-e09a-45a5-a06c-5808229b0a67 tempest-VolumesGetTestJSON-1124083599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-32b1a039-9b8c-4fa0-86a9-74d5665a2edb 1073741824" returned: 0 in 0.859s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:19:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-7077a73a-d33d-4d4a-bc9d-0560d0599fb9 req-7dd907f8-e09a-45a5-a06c-5808229b0a67 tempest-VolumesGetTestJSON-1124083599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-32b1a039-9b8c-4fa0-86a9-74d5665a2edb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:19:57 devstack sudo[91180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-32b1a039-9b8c-4fa0-86a9-74d5665a2edb Jun 02 03:19:57 devstack sudo[91180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:19:57 devstack sudo[91180]: pam_unix(sudo:session): session closed for user root Jun 02 03:19:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-7077a73a-d33d-4d4a-bc9d-0560d0599fb9 req-7dd907f8-e09a-45a5-a06c-5808229b0a67 tempest-VolumesGetTestJSON-1124083599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-32b1a039-9b8c-4fa0-86a9-74d5665a2edb" returned: 0 in 0.631s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:19:57 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [req-7077a73a-d33d-4d4a-bc9d-0560d0599fb9 req-7dd907f8-e09a-45a5-a06c-5808229b0a67 tempest-VolumesGetTestJSON-1124083599 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:19:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-7077a73a-d33d-4d4a-bc9d-0560d0599fb9 req-7dd907f8-e09a-45a5-a06c-5808229b0a67 tempest-VolumesGetTestJSON-1124083599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:19:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-7077a73a-d33d-4d4a-bc9d-0560d0599fb9 req-7dd907f8-e09a-45a5-a06c-5808229b0a67 tempest-VolumesGetTestJSON-1124083599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a469a8-7ae5-44d8-818d-783e4a87f449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32b1a039-9b8c-4fa0-86a9-74d5665a2edb', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:19:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-7077a73a-d33d-4d4a-bc9d-0560d0599fb9 req-7dd907f8-e09a-45a5-a06c-5808229b0a67 tempest-VolumesGetTestJSON-1124083599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9d2e99-2350-4a58-ae56-96d1b4877967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:19:57 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [req-7077a73a-d33d-4d4a-bc9d-0560d0599fb9 req-7dd907f8-e09a-45a5-a06c-5808229b0a67 tempest-VolumesGetTestJSON-1124083599 None] Volume volume-32b1a039-9b8c-4fa0-86a9-74d5665a2edb (32b1a039-9b8c-4fa0-86a9-74d5665a2edb): created successfully Jun 02 03:19:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-7077a73a-d33d-4d4a-bc9d-0560d0599fb9 req-7dd907f8-e09a-45a5-a06c-5808229b0a67 tempest-VolumesGetTestJSON-1124083599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9d2e99-2350-4a58-ae56-96d1b4877967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:19:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-7077a73a-d33d-4d4a-bc9d-0560d0599fb9 req-7dd907f8-e09a-45a5-a06c-5808229b0a67 tempest-VolumesGetTestJSON-1124083599 None] Flow 'volume_create_manager' (483191e1-bf44-4add-a04a-2f89db691fce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:19:58 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-7077a73a-d33d-4d4a-bc9d-0560d0599fb9 req-7dd907f8-e09a-45a5-a06c-5808229b0a67 tempest-VolumesGetTestJSON-1124083599 None] Created volume successfully. Jun 02 03:19:58 devstack cinder-volume[86431]: DEBUG cinder.coordination [req-7e7a87f1-d8b2-40cc-8b11-d32972bb2a64 req-aefaad32-9f7e-49e5-917b-24f63205635f tempest-VolumesGetTestJSON-1124083599 None] Acquiring lock "cinder-32b1a039-9b8c-4fa0-86a9-74d5665a2edb-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:19:58 devstack cinder-volume[86431]: DEBUG cinder.coordination [req-7e7a87f1-d8b2-40cc-8b11-d32972bb2a64 req-aefaad32-9f7e-49e5-917b-24f63205635f tempest-VolumesGetTestJSON-1124083599 None] Lock "cinder-32b1a039-9b8c-4fa0-86a9-74d5665a2edb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:19:58 devstack cinder-volume[86431]: DEBUG cinder.coordination [req-7e7a87f1-d8b2-40cc-8b11-d32972bb2a64 req-aefaad32-9f7e-49e5-917b-24f63205635f tempest-VolumesGetTestJSON-1124083599 None] Acquiring lock "cinder-quobyte-32b1a039-9b8c-4fa0-86a9-74d5665a2edb" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:19:58 devstack cinder-volume[86431]: DEBUG cinder.coordination [req-7e7a87f1-d8b2-40cc-8b11-d32972bb2a64 req-aefaad32-9f7e-49e5-917b-24f63205635f tempest-VolumesGetTestJSON-1124083599 None] Lock "cinder-quobyte-32b1a039-9b8c-4fa0-86a9-74d5665a2edb" acquired by "delete_volume" :: waited 0.022s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:19:58 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a5797b-e4f8-41d5-bb47-22ec0cf4a1d2]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:19:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-7e7a87f1-d8b2-40cc-8b11-d32972bb2a64 req-aefaad32-9f7e-49e5-917b-24f63205635f tempest-VolumesGetTestJSON-1124083599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-32b1a039-9b8c-4fa0-86a9-74d5665a2edb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:19:58 devstack sudo[91184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-32b1a039-9b8c-4fa0-86a9-74d5665a2edb Jun 02 03:19:58 devstack sudo[91184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:19:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-b1c8f6f4-59e1-4c32-85df-63988ae40263 req-f8c85277-830a-44e1-9a9a-34fbd189cead tempest-AttachVolumeNegativeTest-1165991087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:19:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-b1c8f6f4-59e1-4c32-85df-63988ae40263 req-f8c85277-830a-44e1-9a9a-34fbd189cead tempest-AttachVolumeNegativeTest-1165991087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:19:59 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[b732db88-1172-4b81-8309-411b61353eb0]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:19:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-b1c8f6f4-59e1-4c32-85df-63988ae40263 req-f8c85277-830a-44e1-9a9a-34fbd189cead tempest-AttachVolumeNegativeTest-1165991087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3f3824c7-901d-4494-8faf-5027c3245ad8 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:19:59 devstack sudo[91194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3f3824c7-901d-4494-8faf-5027c3245ad8 Jun 02 03:19:59 devstack sudo[91194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:19:59 devstack sudo[91184]: pam_unix(sudo:session): session closed for user root Jun 02 03:19:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-7e7a87f1-d8b2-40cc-8b11-d32972bb2a64 req-aefaad32-9f7e-49e5-917b-24f63205635f tempest-VolumesGetTestJSON-1124083599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-32b1a039-9b8c-4fa0-86a9-74d5665a2edb" returned: 0 in 0.726s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:19:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-7e7a87f1-d8b2-40cc-8b11-d32972bb2a64 req-aefaad32-9f7e-49e5-917b-24f63205635f tempest-VolumesGetTestJSON-1124083599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-32b1a039-9b8c-4fa0-86a9-74d5665a2edb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:19:59 devstack sudo[91199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-32b1a039-9b8c-4fa0-86a9-74d5665a2edb Jun 02 03:19:59 devstack sudo[91199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:20:00 devstack sudo[91194]: pam_unix(sudo:session): session closed for user root Jun 02 03:20:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-b1c8f6f4-59e1-4c32-85df-63988ae40263 req-f8c85277-830a-44e1-9a9a-34fbd189cead tempest-AttachVolumeNegativeTest-1165991087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3f3824c7-901d-4494-8faf-5027c3245ad8" returned: 0 in 0.992s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:20:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-b1c8f6f4-59e1-4c32-85df-63988ae40263 req-f8c85277-830a-44e1-9a9a-34fbd189cead tempest-AttachVolumeNegativeTest-1165991087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.017s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:20:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-b1c8f6f4-59e1-4c32-85df-63988ae40263 req-f8c85277-830a-44e1-9a9a-34fbd189cead tempest-AttachVolumeNegativeTest-1165991087 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1', 'name': 'volume-3f3824c7-901d-4494-8faf-5027c3245ad8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7ceef213-1227-48b9-8163-1e5755c676bb', 'enforce_multipath': True} {{(pid=86431) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 02 03:20:00 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-b1c8f6f4-59e1-4c32-85df-63988ae40263 req-f8c85277-830a-44e1-9a9a-34fbd189cead tempest-AttachVolumeNegativeTest-1165991087 None] attachment_update completed successfully. Jun 02 03:20:00 devstack sudo[91199]: pam_unix(sudo:session): session closed for user root Jun 02 03:20:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-7e7a87f1-d8b2-40cc-8b11-d32972bb2a64 req-aefaad32-9f7e-49e5-917b-24f63205635f tempest-VolumesGetTestJSON-1124083599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-32b1a039-9b8c-4fa0-86a9-74d5665a2edb" returned: 0 in 0.907s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:20:00 devstack cinder-volume[86431]: DEBUG cinder.coordination [req-7e7a87f1-d8b2-40cc-8b11-d32972bb2a64 req-aefaad32-9f7e-49e5-917b-24f63205635f tempest-VolumesGetTestJSON-1124083599 None] Lock "cinder-quobyte-32b1a039-9b8c-4fa0-86a9-74d5665a2edb" released by "delete_volume" :: held 1.686s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:20:00 devstack cinder-volume[86431]: DEBUG cinder.quota [req-7e7a87f1-d8b2-40cc-8b11-d32972bb2a64 req-aefaad32-9f7e-49e5-917b-24f63205635f tempest-VolumesGetTestJSON-1124083599 None] Created reservations ['f5c692a1-dcbe-457e-a4b2-47be89bf2eec', '11d0d61f-d733-4d91-9b27-7a7b84eb171b', '655666bf-dcb0-4a68-b406-7d0c5e318b1d', '35e455b4-1d5f-45dd-a8af-fd76765eb6a6'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:20:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-7e7a87f1-d8b2-40cc-8b11-d32972bb2a64 req-aefaad32-9f7e-49e5-917b-24f63205635f tempest-VolumesGetTestJSON-1124083599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:20:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-7e7a87f1-d8b2-40cc-8b11-d32972bb2a64 req-aefaad32-9f7e-49e5-917b-24f63205635f tempest-VolumesGetTestJSON-1124083599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:20:00 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [req-7e7a87f1-d8b2-40cc-8b11-d32972bb2a64 req-aefaad32-9f7e-49e5-917b-24f63205635f tempest-VolumesGetTestJSON-1124083599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:20:00 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [req-7e7a87f1-d8b2-40cc-8b11-d32972bb2a64 req-aefaad32-9f7e-49e5-917b-24f63205635f tempest-VolumesGetTestJSON-1124083599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:20:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-7e7a87f1-d8b2-40cc-8b11-d32972bb2a64 req-aefaad32-9f7e-49e5-917b-24f63205635f tempest-VolumesGetTestJSON-1124083599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:20:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-7e7a87f1-d8b2-40cc-8b11-d32972bb2a64 req-aefaad32-9f7e-49e5-917b-24f63205635f tempest-VolumesGetTestJSON-1124083599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:20:00 devstack sudo[91205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:20:00 devstack sudo[91205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:20:01 devstack sudo[91205]: pam_unix(sudo:session): session closed for user root Jun 02 03:20:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-7e7a87f1-d8b2-40cc-8b11-d32972bb2a64 req-aefaad32-9f7e-49e5-917b-24f63205635f tempest-VolumesGetTestJSON-1124083599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 1.055s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:20:01 devstack cinder-volume[86431]: DEBUG cinder.manager [req-7e7a87f1-d8b2-40cc-8b11-d32972bb2a64 req-aefaad32-9f7e-49e5-917b-24f63205635f tempest-VolumesGetTestJSON-1124083599 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:20:01 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-7e7a87f1-d8b2-40cc-8b11-d32972bb2a64 req-aefaad32-9f7e-49e5-917b-24f63205635f tempest-VolumesGetTestJSON-1124083599 None] Deleted volume successfully. Jun 02 03:20:01 devstack cinder-volume[86431]: DEBUG cinder.coordination [req-7e7a87f1-d8b2-40cc-8b11-d32972bb2a64 req-aefaad32-9f7e-49e5-917b-24f63205635f tempest-VolumesGetTestJSON-1124083599 None] Lock "cinder-32b1a039-9b8c-4fa0-86a9-74d5665a2edb-delete_volume" released by "delete_volume" :: held 3.084s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:20:08 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-168f76c9-8d84-4ec9-9527-654329b1f6a8 tempest-GroupsTest-1885823758 None] Group tempest-Group1-1966347494: creating Jun 02 03:20:08 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-168f76c9-8d84-4ec9-9527-654329b1f6a8 tempest-GroupsTest-1885823758 None] Group tempest-Group1-1966347494: created successfully Jun 02 03:20:08 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-168f76c9-8d84-4ec9-9527-654329b1f6a8 tempest-GroupsTest-1885823758 None] Create group completed successfully. Jun 02 03:20:09 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-137c92c7-b2ea-4c1d-aca4-041d6613a1fe tempest-GroupsTest-1885823758 None] Group tempest-Group2-1929206952: creating Jun 02 03:20:09 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-137c92c7-b2ea-4c1d-aca4-041d6613a1fe tempest-GroupsTest-1885823758 None] Group tempest-Group2-1929206952: created successfully Jun 02 03:20:09 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-137c92c7-b2ea-4c1d-aca4-041d6613a1fe tempest-GroupsTest-1885823758 None] Create group completed successfully. Jun 02 03:20:09 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:20:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:20:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:20:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:20:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:20:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:20:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:20:09 devstack sudo[91638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:20:09 devstack sudo[91638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:20:10 devstack sudo[91638]: pam_unix(sudo:session): session closed for user root Jun 02 03:20:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.634s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:20:10 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:20:10 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-10c0a9c1-ee35-415d-baf7-98134a71fb67 tempest-GroupsTest-1885823758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:20:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-10c0a9c1-ee35-415d-baf7-98134a71fb67 tempest-GroupsTest-1885823758 None] Flow 'volume_create_manager' (ee05ffbc-3b74-4407-b0ca-04b360051ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:20:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-10c0a9c1-ee35-415d-baf7-98134a71fb67 tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c0c4a82-f2b5-4816-ae2b-e67701f39361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:20:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-10c0a9c1-ee35-415d-baf7-98134a71fb67 tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c0c4a82-f2b5-4816-ae2b-e67701f39361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1959531479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4629c03a-9ab6-4f63-a7f6-02903084ca95,host='devstack@QuobyteHD#QuobyteHD',id=7441d8bb-516c-4bea-ba3b-c1954c948d37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61ad5e2c81b4b8ab7ace0c6df6f9059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:20:11Z,use_quota=True,user_id='68005c8a562d432e80ae3337385a58f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(95472bd2-592e-4fb5-9241-6be0419c37c1),volume_type_id=95472bd2-592e-4fb5-9241-6be0419c37c1)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:20:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-10c0a9c1-ee35-415d-baf7-98134a71fb67 tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0174e6f-9d1d-4d06-97e5-02fcc06823ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:20:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-10c0a9c1-ee35-415d-baf7-98134a71fb67 tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0174e6f-9d1d-4d06-97e5-02fcc06823ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:20:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-10c0a9c1-ee35-415d-baf7-98134a71fb67 tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe5a8a5-fc84-453d-943c-c65d2e90e824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:20:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-10c0a9c1-ee35-415d-baf7-98134a71fb67 tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe5a8a5-fc84-453d-943c-c65d2e90e824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7441d8bb-516c-4bea-ba3b-c1954c948d37', 'volume_name': 'volume-7441d8bb-516c-4bea-ba3b-c1954c948d37', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:20:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-10c0a9c1-ee35-415d-baf7-98134a71fb67 tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c0788ac-31e0-4ccc-a317-3469ec9de68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:20:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-10c0a9c1-ee35-415d-baf7-98134a71fb67 tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c0788ac-31e0-4ccc-a317-3469ec9de68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:20:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-10c0a9c1-ee35-415d-baf7-98134a71fb67 tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c842437-fbe6-47ed-96db-2b5386d3696f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:20:11 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-10c0a9c1-ee35-415d-baf7-98134a71fb67 tempest-GroupsTest-1885823758 None] Volume 7441d8bb-516c-4bea-ba3b-c1954c948d37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7441d8bb-516c-4bea-ba3b-c1954c948d37', 'volume_size': 1} Jun 02 03:20:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-10c0a9c1-ee35-415d-baf7-98134a71fb67 tempest-GroupsTest-1885823758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:20:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-10c0a9c1-ee35-415d-baf7-98134a71fb67 tempest-GroupsTest-1885823758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:20:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-10c0a9c1-ee35-415d-baf7-98134a71fb67 tempest-GroupsTest-1885823758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4629c03a-9ab6-4f63-a7f6-02903084ca95,created_at=2026-06-02T01:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1959531479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4629c03a-9ab6-4f63-a7f6-02903084ca95,host='devstack@QuobyteHD#QuobyteHD',id=7441d8bb-516c-4bea-ba3b-c1954c948d37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61ad5e2c81b4b8ab7ace0c6df6f9059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:20:11Z,use_quota=True,user_id='68005c8a562d432e80ae3337385a58f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(95472bd2-592e-4fb5-9241-6be0419c37c1),volume_type_id=95472bd2-592e-4fb5-9241-6be0419c37c1)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:20:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-10c0a9c1-ee35-415d-baf7-98134a71fb67 tempest-GroupsTest-1885823758 None] Creating volume 7441d8bb-516c-4bea-ba3b-c1954c948d37 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:20:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-10c0a9c1-ee35-415d-baf7-98134a71fb67 tempest-GroupsTest-1885823758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:20:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-10c0a9c1-ee35-415d-baf7-98134a71fb67 tempest-GroupsTest-1885823758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:20:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-10c0a9c1-ee35-415d-baf7-98134a71fb67 tempest-GroupsTest-1885823758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:20:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-10c0a9c1-ee35-415d-baf7-98134a71fb67 tempest-GroupsTest-1885823758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:20:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-10c0a9c1-ee35-415d-baf7-98134a71fb67 tempest-GroupsTest-1885823758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:20:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-10c0a9c1-ee35-415d-baf7-98134a71fb67 tempest-GroupsTest-1885823758 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:20:11 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-10c0a9c1-ee35-415d-baf7-98134a71fb67 tempest-GroupsTest-1885823758 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:20:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-10c0a9c1-ee35-415d-baf7-98134a71fb67 tempest-GroupsTest-1885823758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7441d8bb-516c-4bea-ba3b-c1954c948d37 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:20:11 devstack sudo[91642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7441d8bb-516c-4bea-ba3b-c1954c948d37 1073741824 Jun 02 03:20:11 devstack sudo[91642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:20:11 devstack sudo[91642]: pam_unix(sudo:session): session closed for user root Jun 02 03:20:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-10c0a9c1-ee35-415d-baf7-98134a71fb67 tempest-GroupsTest-1885823758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7441d8bb-516c-4bea-ba3b-c1954c948d37 1073741824" returned: 0 in 0.856s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:20:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-10c0a9c1-ee35-415d-baf7-98134a71fb67 tempest-GroupsTest-1885823758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7441d8bb-516c-4bea-ba3b-c1954c948d37 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:20:12 devstack sudo[91648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7441d8bb-516c-4bea-ba3b-c1954c948d37 Jun 02 03:20:12 devstack sudo[91648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:20:12 devstack sudo[91648]: pam_unix(sudo:session): session closed for user root Jun 02 03:20:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-10c0a9c1-ee35-415d-baf7-98134a71fb67 tempest-GroupsTest-1885823758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7441d8bb-516c-4bea-ba3b-c1954c948d37" returned: 0 in 0.638s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:20:12 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-10c0a9c1-ee35-415d-baf7-98134a71fb67 tempest-GroupsTest-1885823758 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:20:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-10c0a9c1-ee35-415d-baf7-98134a71fb67 tempest-GroupsTest-1885823758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:20:12 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-10c0a9c1-ee35-415d-baf7-98134a71fb67 tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c842437-fbe6-47ed-96db-2b5386d3696f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7441d8bb-516c-4bea-ba3b-c1954c948d37', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:20:12 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-10c0a9c1-ee35-415d-baf7-98134a71fb67 tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a391d36e-944c-4a12-9bc1-58767e6266a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:20:12 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-10c0a9c1-ee35-415d-baf7-98134a71fb67 tempest-GroupsTest-1885823758 None] Volume volume-7441d8bb-516c-4bea-ba3b-c1954c948d37 (7441d8bb-516c-4bea-ba3b-c1954c948d37): created successfully Jun 02 03:20:12 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-10c0a9c1-ee35-415d-baf7-98134a71fb67 tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a391d36e-944c-4a12-9bc1-58767e6266a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:20:12 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-10c0a9c1-ee35-415d-baf7-98134a71fb67 tempest-GroupsTest-1885823758 None] Flow 'volume_create_manager' (ee05ffbc-3b74-4407-b0ca-04b360051ec5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:20:12 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-10c0a9c1-ee35-415d-baf7-98134a71fb67 tempest-GroupsTest-1885823758 None] Created volume successfully. Jun 02 03:20:13 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4217f23f-e60e-4a5d-8afe-90a8fec8a43e tempest-GroupsTest-1885823758 None] Acquiring lock "cinder-quobyte-7441d8bb-516c-4bea-ba3b-c1954c948d37" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:20:14 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4217f23f-e60e-4a5d-8afe-90a8fec8a43e tempest-GroupsTest-1885823758 None] Lock "cinder-quobyte-7441d8bb-516c-4bea-ba3b-c1954c948d37" acquired by "delete_volume" :: waited 0.040s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:20:14 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[de961296-3452-43c0-997f-2e9b356c6325]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:20:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4217f23f-e60e-4a5d-8afe-90a8fec8a43e tempest-GroupsTest-1885823758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7441d8bb-516c-4bea-ba3b-c1954c948d37 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:20:14 devstack sudo[91654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7441d8bb-516c-4bea-ba3b-c1954c948d37 Jun 02 03:20:14 devstack sudo[91654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:20:14 devstack sudo[91654]: pam_unix(sudo:session): session closed for user root Jun 02 03:20:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4217f23f-e60e-4a5d-8afe-90a8fec8a43e tempest-GroupsTest-1885823758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7441d8bb-516c-4bea-ba3b-c1954c948d37" returned: 0 in 0.938s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:20:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4217f23f-e60e-4a5d-8afe-90a8fec8a43e tempest-GroupsTest-1885823758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7441d8bb-516c-4bea-ba3b-c1954c948d37 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:20:15 devstack sudo[91671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7441d8bb-516c-4bea-ba3b-c1954c948d37 Jun 02 03:20:15 devstack sudo[91671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:20:15 devstack sudo[91671]: pam_unix(sudo:session): session closed for user root Jun 02 03:20:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4217f23f-e60e-4a5d-8afe-90a8fec8a43e tempest-GroupsTest-1885823758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7441d8bb-516c-4bea-ba3b-c1954c948d37" returned: 0 in 0.766s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:20:15 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4217f23f-e60e-4a5d-8afe-90a8fec8a43e tempest-GroupsTest-1885823758 None] Lock "cinder-quobyte-7441d8bb-516c-4bea-ba3b-c1954c948d37" released by "delete_volume" :: held 1.789s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:20:15 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-4217f23f-e60e-4a5d-8afe-90a8fec8a43e tempest-GroupsTest-1885823758 None] Created reservations ['31b3989f-27b4-4be2-b414-2a9a7be07805'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:20:15 devstack cinder-volume[86431]: WARNING cinder.quota [None req-4217f23f-e60e-4a5d-8afe-90a8fec8a43e tempest-GroupsTest-1885823758 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-347757347 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-347757347, it is now deprecated. Please use the default quota class for default quota. Jun 02 03:20:15 devstack cinder-volume[86431]: WARNING cinder.quota [None req-4217f23f-e60e-4a5d-8afe-90a8fec8a43e tempest-GroupsTest-1885823758 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-347757347 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-347757347, it is now deprecated. Please use the default quota class for default quota. Jun 02 03:20:15 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-4217f23f-e60e-4a5d-8afe-90a8fec8a43e tempest-GroupsTest-1885823758 None] Created reservations ['c8bcd55a-021f-4a0d-9c7c-b6ccb8f6de30', 'acdf2a85-5fe4-44a8-8eb0-11783fa9c12b', '238c9156-ff48-44bb-b45d-5267dc67ed4d', '2b6070f2-7092-4758-804e-0edf27182678'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:20:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4217f23f-e60e-4a5d-8afe-90a8fec8a43e tempest-GroupsTest-1885823758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:20:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4217f23f-e60e-4a5d-8afe-90a8fec8a43e tempest-GroupsTest-1885823758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:20:16 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-4217f23f-e60e-4a5d-8afe-90a8fec8a43e tempest-GroupsTest-1885823758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:20:16 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-4217f23f-e60e-4a5d-8afe-90a8fec8a43e tempest-GroupsTest-1885823758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:20:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4217f23f-e60e-4a5d-8afe-90a8fec8a43e tempest-GroupsTest-1885823758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:20:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4217f23f-e60e-4a5d-8afe-90a8fec8a43e tempest-GroupsTest-1885823758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:20:16 devstack sudo[91716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:20:16 devstack sudo[91716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:20:16 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-e5b2b491-6d3a-41f9-ac29-42d0614b4324 tempest-GroupsTest-1885823758 None] Created reservations ['07c0ab50-7848-4c4e-8fd9-03c0355b1ac3'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:20:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e5b2b491-6d3a-41f9-ac29-42d0614b4324 tempest-GroupsTest-1885823758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:20:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e5b2b491-6d3a-41f9-ac29-42d0614b4324 tempest-GroupsTest-1885823758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:20:16 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e5b2b491-6d3a-41f9-ac29-42d0614b4324 tempest-GroupsTest-1885823758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:20:16 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e5b2b491-6d3a-41f9-ac29-42d0614b4324 tempest-GroupsTest-1885823758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:20:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e5b2b491-6d3a-41f9-ac29-42d0614b4324 tempest-GroupsTest-1885823758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:20:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e5b2b491-6d3a-41f9-ac29-42d0614b4324 tempest-GroupsTest-1885823758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:20:16 devstack sudo[91718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:20:16 devstack sudo[91718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:20:17 devstack sudo[91716]: pam_unix(sudo:session): session closed for user root Jun 02 03:20:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4217f23f-e60e-4a5d-8afe-90a8fec8a43e tempest-GroupsTest-1885823758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.957s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:20:17 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-4217f23f-e60e-4a5d-8afe-90a8fec8a43e tempest-GroupsTest-1885823758 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:20:17 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-4217f23f-e60e-4a5d-8afe-90a8fec8a43e tempest-GroupsTest-1885823758 None] Delete group completed successfully. Jun 02 03:20:17 devstack sudo[91718]: pam_unix(sudo:session): session closed for user root Jun 02 03:20:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e5b2b491-6d3a-41f9-ac29-42d0614b4324 tempest-GroupsTest-1885823758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.832s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:20:17 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-e5b2b491-6d3a-41f9-ac29-42d0614b4324 tempest-GroupsTest-1885823758 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:20:17 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-e5b2b491-6d3a-41f9-ac29-42d0614b4324 tempest-GroupsTest-1885823758 None] Delete group completed successfully. Jun 02 03:20:18 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-287b8ea2-a82d-4922-9107-bf7a708bfeca tempest-GroupsTest-1885823758 None] Group tempest-GroupsTest-Group-1483237019: creating Jun 02 03:20:18 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-287b8ea2-a82d-4922-9107-bf7a708bfeca tempest-GroupsTest-1885823758 None] Group tempest-GroupsTest-Group-1483237019: created successfully Jun 02 03:20:18 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-287b8ea2-a82d-4922-9107-bf7a708bfeca tempest-GroupsTest-1885823758 None] Create group completed successfully. Jun 02 03:20:19 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c1c374c-9943-4ba3-91ee-d9a5cdd3a42d tempest-GroupsTest-1885823758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:20:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c1c374c-9943-4ba3-91ee-d9a5cdd3a42d tempest-GroupsTest-1885823758 None] Flow 'volume_create_manager' (89094e95-fa7f-4179-a810-fb5e78ef6f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:20:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c1c374c-9943-4ba3-91ee-d9a5cdd3a42d tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (386fc8a5-110a-444d-9b9e-02948d44ca8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:20:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c1c374c-9943-4ba3-91ee-d9a5cdd3a42d tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (386fc8a5-110a-444d-9b9e-02948d44ca8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-370433681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=09bfaa4b-b020-4679-addf-7e23f914019e,host='devstack@QuobyteHD#QuobyteHD',id=a5f020bf-b38b-4e72-8043-837499390a37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61ad5e2c81b4b8ab7ace0c6df6f9059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:20:20Z,use_quota=True,user_id='68005c8a562d432e80ae3337385a58f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d02b216-107d-4dbf-b887-c137f886550a),volume_type_id=2d02b216-107d-4dbf-b887-c137f886550a)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:20:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c1c374c-9943-4ba3-91ee-d9a5cdd3a42d tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3315f0c1-203b-4095-ac14-7e45a52e1ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:20:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c1c374c-9943-4ba3-91ee-d9a5cdd3a42d tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3315f0c1-203b-4095-ac14-7e45a52e1ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:20:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c1c374c-9943-4ba3-91ee-d9a5cdd3a42d tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e1ec9f-480c-4549-a23d-bc56edea7a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:20:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c1c374c-9943-4ba3-91ee-d9a5cdd3a42d tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e1ec9f-480c-4549-a23d-bc56edea7a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5f020bf-b38b-4e72-8043-837499390a37', 'volume_name': 'volume-a5f020bf-b38b-4e72-8043-837499390a37', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:20:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c1c374c-9943-4ba3-91ee-d9a5cdd3a42d tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fc4c5bf-5efe-456c-b034-8637e0bbbbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:20:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c1c374c-9943-4ba3-91ee-d9a5cdd3a42d tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fc4c5bf-5efe-456c-b034-8637e0bbbbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:20:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c1c374c-9943-4ba3-91ee-d9a5cdd3a42d tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf9cacf-c51b-4c6c-9ec0-7ebb8fb74d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:20:19 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-0c1c374c-9943-4ba3-91ee-d9a5cdd3a42d tempest-GroupsTest-1885823758 None] Volume a5f020bf-b38b-4e72-8043-837499390a37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5f020bf-b38b-4e72-8043-837499390a37', 'volume_size': 1} Jun 02 03:20:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0c1c374c-9943-4ba3-91ee-d9a5cdd3a42d tempest-GroupsTest-1885823758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:20:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0c1c374c-9943-4ba3-91ee-d9a5cdd3a42d tempest-GroupsTest-1885823758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:20:19 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0c1c374c-9943-4ba3-91ee-d9a5cdd3a42d tempest-GroupsTest-1885823758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=09bfaa4b-b020-4679-addf-7e23f914019e,created_at=2026-06-02T01:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-370433681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=09bfaa4b-b020-4679-addf-7e23f914019e,host='devstack@QuobyteHD#QuobyteHD',id=a5f020bf-b38b-4e72-8043-837499390a37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61ad5e2c81b4b8ab7ace0c6df6f9059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:20:20Z,use_quota=True,user_id='68005c8a562d432e80ae3337385a58f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d02b216-107d-4dbf-b887-c137f886550a),volume_type_id=2d02b216-107d-4dbf-b887-c137f886550a)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:20:19 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-0c1c374c-9943-4ba3-91ee-d9a5cdd3a42d tempest-GroupsTest-1885823758 None] Creating volume a5f020bf-b38b-4e72-8043-837499390a37 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:20:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0c1c374c-9943-4ba3-91ee-d9a5cdd3a42d tempest-GroupsTest-1885823758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:20:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0c1c374c-9943-4ba3-91ee-d9a5cdd3a42d tempest-GroupsTest-1885823758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:20:19 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0c1c374c-9943-4ba3-91ee-d9a5cdd3a42d tempest-GroupsTest-1885823758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:20:19 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0c1c374c-9943-4ba3-91ee-d9a5cdd3a42d tempest-GroupsTest-1885823758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:20:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0c1c374c-9943-4ba3-91ee-d9a5cdd3a42d tempest-GroupsTest-1885823758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:20:19 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0c1c374c-9943-4ba3-91ee-d9a5cdd3a42d tempest-GroupsTest-1885823758 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:20:19 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-0c1c374c-9943-4ba3-91ee-d9a5cdd3a42d tempest-GroupsTest-1885823758 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:20:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0c1c374c-9943-4ba3-91ee-d9a5cdd3a42d tempest-GroupsTest-1885823758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a5f020bf-b38b-4e72-8043-837499390a37 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:20:20 devstack sudo[91743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a5f020bf-b38b-4e72-8043-837499390a37 1073741824 Jun 02 03:20:20 devstack sudo[91743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:20:21 devstack sudo[91743]: pam_unix(sudo:session): session closed for user root Jun 02 03:20:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0c1c374c-9943-4ba3-91ee-d9a5cdd3a42d tempest-GroupsTest-1885823758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a5f020bf-b38b-4e72-8043-837499390a37 1073741824" returned: 0 in 1.531s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:20:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0c1c374c-9943-4ba3-91ee-d9a5cdd3a42d tempest-GroupsTest-1885823758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a5f020bf-b38b-4e72-8043-837499390a37 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:20:21 devstack sudo[91856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a5f020bf-b38b-4e72-8043-837499390a37 Jun 02 03:20:21 devstack sudo[91856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:20:22 devstack sudo[91856]: pam_unix(sudo:session): session closed for user root Jun 02 03:20:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0c1c374c-9943-4ba3-91ee-d9a5cdd3a42d tempest-GroupsTest-1885823758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a5f020bf-b38b-4e72-8043-837499390a37" returned: 0 in 1.264s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:20:22 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0c1c374c-9943-4ba3-91ee-d9a5cdd3a42d tempest-GroupsTest-1885823758 None] <== create_volume: return (2874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:20:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0c1c374c-9943-4ba3-91ee-d9a5cdd3a42d tempest-GroupsTest-1885823758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.876s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:20:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c1c374c-9943-4ba3-91ee-d9a5cdd3a42d tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf9cacf-c51b-4c6c-9ec0-7ebb8fb74d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5f020bf-b38b-4e72-8043-837499390a37', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:20:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c1c374c-9943-4ba3-91ee-d9a5cdd3a42d tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ed0320-63e6-4807-89ed-372b4ca32691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:20:22 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-0c1c374c-9943-4ba3-91ee-d9a5cdd3a42d tempest-GroupsTest-1885823758 None] Volume volume-a5f020bf-b38b-4e72-8043-837499390a37 (a5f020bf-b38b-4e72-8043-837499390a37): created successfully Jun 02 03:20:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c1c374c-9943-4ba3-91ee-d9a5cdd3a42d tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ed0320-63e6-4807-89ed-372b4ca32691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:20:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c1c374c-9943-4ba3-91ee-d9a5cdd3a42d tempest-GroupsTest-1885823758 None] Flow 'volume_create_manager' (89094e95-fa7f-4179-a810-fb5e78ef6f62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:20:22 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-0c1c374c-9943-4ba3-91ee-d9a5cdd3a42d tempest-GroupsTest-1885823758 None] Created volume successfully. Jun 02 03:20:24 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eb5780e-761e-48c8-afbd-26cbcddc5f06 tempest-GroupsTest-1885823758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:20:24 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8eb5780e-761e-48c8-afbd-26cbcddc5f06 tempest-GroupsTest-1885823758 None] Flow 'volume_create_manager' (17362cba-c4be-47ed-a62b-a5fec596e8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:20:24 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8eb5780e-761e-48c8-afbd-26cbcddc5f06 tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4c5b16c-c6b9-4f4c-8df9-e397145c24f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:20:24 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8eb5780e-761e-48c8-afbd-26cbcddc5f06 tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4c5b16c-c6b9-4f4c-8df9-e397145c24f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-233249464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=09bfaa4b-b020-4679-addf-7e23f914019e,host='devstack@QuobyteHD#QuobyteHD',id=29794c3d-dba2-43fc-9122-ce80124ab77d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61ad5e2c81b4b8ab7ace0c6df6f9059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:20:24Z,use_quota=True,user_id='68005c8a562d432e80ae3337385a58f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d02b216-107d-4dbf-b887-c137f886550a),volume_type_id=2d02b216-107d-4dbf-b887-c137f886550a)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:20:24 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8eb5780e-761e-48c8-afbd-26cbcddc5f06 tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91bc3f9-fde7-4def-b35e-166e0ff42acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:20:24 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8eb5780e-761e-48c8-afbd-26cbcddc5f06 tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91bc3f9-fde7-4def-b35e-166e0ff42acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:20:24 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8eb5780e-761e-48c8-afbd-26cbcddc5f06 tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (331cb8ac-9715-411f-ae73-5864a658346e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:20:24 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8eb5780e-761e-48c8-afbd-26cbcddc5f06 tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (331cb8ac-9715-411f-ae73-5864a658346e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29794c3d-dba2-43fc-9122-ce80124ab77d', 'volume_name': 'volume-29794c3d-dba2-43fc-9122-ce80124ab77d', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:20:24 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8eb5780e-761e-48c8-afbd-26cbcddc5f06 tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46bdea86-ddf2-4b12-bf0c-73a9b7726b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:20:24 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8eb5780e-761e-48c8-afbd-26cbcddc5f06 tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46bdea86-ddf2-4b12-bf0c-73a9b7726b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:20:24 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8eb5780e-761e-48c8-afbd-26cbcddc5f06 tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e522d0-b97a-4b9f-800c-f6bd96ca97c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:20:24 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-8eb5780e-761e-48c8-afbd-26cbcddc5f06 tempest-GroupsTest-1885823758 None] Volume 29794c3d-dba2-43fc-9122-ce80124ab77d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29794c3d-dba2-43fc-9122-ce80124ab77d', 'volume_size': 1} Jun 02 03:20:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8eb5780e-761e-48c8-afbd-26cbcddc5f06 tempest-GroupsTest-1885823758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:20:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8eb5780e-761e-48c8-afbd-26cbcddc5f06 tempest-GroupsTest-1885823758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:20:24 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-8eb5780e-761e-48c8-afbd-26cbcddc5f06 tempest-GroupsTest-1885823758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=09bfaa4b-b020-4679-addf-7e23f914019e,created_at=2026-06-02T01:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-233249464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=09bfaa4b-b020-4679-addf-7e23f914019e,host='devstack@QuobyteHD#QuobyteHD',id=29794c3d-dba2-43fc-9122-ce80124ab77d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c61ad5e2c81b4b8ab7ace0c6df6f9059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:20:24Z,use_quota=True,user_id='68005c8a562d432e80ae3337385a58f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d02b216-107d-4dbf-b887-c137f886550a),volume_type_id=2d02b216-107d-4dbf-b887-c137f886550a)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:20:24 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-8eb5780e-761e-48c8-afbd-26cbcddc5f06 tempest-GroupsTest-1885823758 None] Creating volume 29794c3d-dba2-43fc-9122-ce80124ab77d {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:20:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8eb5780e-761e-48c8-afbd-26cbcddc5f06 tempest-GroupsTest-1885823758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:20:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8eb5780e-761e-48c8-afbd-26cbcddc5f06 tempest-GroupsTest-1885823758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:20:24 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-8eb5780e-761e-48c8-afbd-26cbcddc5f06 tempest-GroupsTest-1885823758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:20:24 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-8eb5780e-761e-48c8-afbd-26cbcddc5f06 tempest-GroupsTest-1885823758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:20:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8eb5780e-761e-48c8-afbd-26cbcddc5f06 tempest-GroupsTest-1885823758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:20:24 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-8eb5780e-761e-48c8-afbd-26cbcddc5f06 tempest-GroupsTest-1885823758 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:20:24 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-8eb5780e-761e-48c8-afbd-26cbcddc5f06 tempest-GroupsTest-1885823758 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:20:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8eb5780e-761e-48c8-afbd-26cbcddc5f06 tempest-GroupsTest-1885823758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29794c3d-dba2-43fc-9122-ce80124ab77d 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:20:24 devstack sudo[91906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29794c3d-dba2-43fc-9122-ce80124ab77d 1073741824 Jun 02 03:20:24 devstack sudo[91906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:20:25 devstack sudo[91906]: pam_unix(sudo:session): session closed for user root Jun 02 03:20:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8eb5780e-761e-48c8-afbd-26cbcddc5f06 tempest-GroupsTest-1885823758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29794c3d-dba2-43fc-9122-ce80124ab77d 1073741824" returned: 0 in 0.978s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:20:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8eb5780e-761e-48c8-afbd-26cbcddc5f06 tempest-GroupsTest-1885823758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29794c3d-dba2-43fc-9122-ce80124ab77d {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:20:25 devstack sudo[91917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29794c3d-dba2-43fc-9122-ce80124ab77d Jun 02 03:20:25 devstack sudo[91917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:20:27 devstack sudo[91917]: pam_unix(sudo:session): session closed for user root Jun 02 03:20:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8eb5780e-761e-48c8-afbd-26cbcddc5f06 tempest-GroupsTest-1885823758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29794c3d-dba2-43fc-9122-ce80124ab77d" returned: 0 in 1.879s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:20:27 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-8eb5780e-761e-48c8-afbd-26cbcddc5f06 tempest-GroupsTest-1885823758 None] <== create_volume: return (2999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:20:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8eb5780e-761e-48c8-afbd-26cbcddc5f06 tempest-GroupsTest-1885823758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:20:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8eb5780e-761e-48c8-afbd-26cbcddc5f06 tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e522d0-b97a-4b9f-800c-f6bd96ca97c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29794c3d-dba2-43fc-9122-ce80124ab77d', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:20:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8eb5780e-761e-48c8-afbd-26cbcddc5f06 tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b998314-3b07-4d9e-8406-baaf798a56b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:20:27 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-8eb5780e-761e-48c8-afbd-26cbcddc5f06 tempest-GroupsTest-1885823758 None] Volume volume-29794c3d-dba2-43fc-9122-ce80124ab77d (29794c3d-dba2-43fc-9122-ce80124ab77d): created successfully Jun 02 03:20:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8eb5780e-761e-48c8-afbd-26cbcddc5f06 tempest-GroupsTest-1885823758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b998314-3b07-4d9e-8406-baaf798a56b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:20:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8eb5780e-761e-48c8-afbd-26cbcddc5f06 tempest-GroupsTest-1885823758 None] Flow 'volume_create_manager' (17362cba-c4be-47ed-a62b-a5fec596e8f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:20:27 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-8eb5780e-761e-48c8-afbd-26cbcddc5f06 tempest-GroupsTest-1885823758 None] Created volume successfully. Jun 02 03:20:28 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-b3344b92-0d57-40d9-a46b-1325146ac1bd tempest-GroupsTest-1885823758 None] Update group completed successfully. Jun 02 03:20:30 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-12d07ee0-1673-4458-b4ff-0d3e6a6863ca tempest-GroupsTest-1885823758 None] Update group completed successfully. Jun 02 03:20:32 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0ce38449-d1b7-4a08-9c98-fce18a337f62 tempest-GroupsTest-1885823758 None] Acquiring lock "cinder-quobyte-29794c3d-dba2-43fc-9122-ce80124ab77d" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:20:32 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0ce38449-d1b7-4a08-9c98-fce18a337f62 tempest-GroupsTest-1885823758 None] Lock "cinder-quobyte-29794c3d-dba2-43fc-9122-ce80124ab77d" acquired by "delete_volume" :: waited 0.040s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:20:32 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a665672-da92-4759-8e98-a09d4d52db6e]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:20:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0ce38449-d1b7-4a08-9c98-fce18a337f62 tempest-GroupsTest-1885823758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29794c3d-dba2-43fc-9122-ce80124ab77d {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:20:32 devstack sudo[91999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29794c3d-dba2-43fc-9122-ce80124ab77d Jun 02 03:20:32 devstack sudo[91999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:20:33 devstack sudo[91999]: pam_unix(sudo:session): session closed for user root Jun 02 03:20:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0ce38449-d1b7-4a08-9c98-fce18a337f62 tempest-GroupsTest-1885823758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29794c3d-dba2-43fc-9122-ce80124ab77d" returned: 0 in 1.127s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:20:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0ce38449-d1b7-4a08-9c98-fce18a337f62 tempest-GroupsTest-1885823758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29794c3d-dba2-43fc-9122-ce80124ab77d {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:20:33 devstack sudo[92006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29794c3d-dba2-43fc-9122-ce80124ab77d Jun 02 03:20:33 devstack sudo[92006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:20:34 devstack sudo[92006]: pam_unix(sudo:session): session closed for user root Jun 02 03:20:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0ce38449-d1b7-4a08-9c98-fce18a337f62 tempest-GroupsTest-1885823758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29794c3d-dba2-43fc-9122-ce80124ab77d" returned: 0 in 0.785s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:20:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0ce38449-d1b7-4a08-9c98-fce18a337f62 tempest-GroupsTest-1885823758 None] Lock "cinder-quobyte-29794c3d-dba2-43fc-9122-ce80124ab77d" released by "delete_volume" :: held 2.007s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:20:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0ce38449-d1b7-4a08-9c98-fce18a337f62 tempest-GroupsTest-1885823758 None] Acquiring lock "cinder-quobyte-a5f020bf-b38b-4e72-8043-837499390a37" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:20:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0ce38449-d1b7-4a08-9c98-fce18a337f62 tempest-GroupsTest-1885823758 None] Lock "cinder-quobyte-a5f020bf-b38b-4e72-8043-837499390a37" acquired by "delete_volume" :: waited 0.023s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:20:34 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b6fa15-52aa-4f35-a73f-cdb978c4f60b]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:20:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0ce38449-d1b7-4a08-9c98-fce18a337f62 tempest-GroupsTest-1885823758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a5f020bf-b38b-4e72-8043-837499390a37 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:20:34 devstack sudo[92010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a5f020bf-b38b-4e72-8043-837499390a37 Jun 02 03:20:34 devstack sudo[92010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:20:35 devstack sudo[92010]: pam_unix(sudo:session): session closed for user root Jun 02 03:20:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0ce38449-d1b7-4a08-9c98-fce18a337f62 tempest-GroupsTest-1885823758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a5f020bf-b38b-4e72-8043-837499390a37" returned: 0 in 0.896s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:20:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0ce38449-d1b7-4a08-9c98-fce18a337f62 tempest-GroupsTest-1885823758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a5f020bf-b38b-4e72-8043-837499390a37 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:20:35 devstack sudo[92015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a5f020bf-b38b-4e72-8043-837499390a37 Jun 02 03:20:35 devstack sudo[92015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:20:36 devstack sudo[92015]: pam_unix(sudo:session): session closed for user root Jun 02 03:20:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0ce38449-d1b7-4a08-9c98-fce18a337f62 tempest-GroupsTest-1885823758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a5f020bf-b38b-4e72-8043-837499390a37" returned: 0 in 0.617s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:20:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0ce38449-d1b7-4a08-9c98-fce18a337f62 tempest-GroupsTest-1885823758 None] Lock "cinder-quobyte-a5f020bf-b38b-4e72-8043-837499390a37" released by "delete_volume" :: held 1.573s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:20:36 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-0ce38449-d1b7-4a08-9c98-fce18a337f62 tempest-GroupsTest-1885823758 None] Created reservations ['09c7d018-4289-4b2a-929c-9a8b668d8172'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:20:36 devstack cinder-volume[86431]: WARNING cinder.quota [None req-0ce38449-d1b7-4a08-9c98-fce18a337f62 tempest-GroupsTest-1885823758 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-393257437 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-393257437, it is now deprecated. Please use the default quota class for default quota. Jun 02 03:20:36 devstack cinder-volume[86431]: WARNING cinder.quota [None req-0ce38449-d1b7-4a08-9c98-fce18a337f62 tempest-GroupsTest-1885823758 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-393257437 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-393257437, it is now deprecated. Please use the default quota class for default quota. Jun 02 03:20:36 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-0ce38449-d1b7-4a08-9c98-fce18a337f62 tempest-GroupsTest-1885823758 None] Created reservations ['b92cd415-77df-4dd9-ab8d-d822eef7e7c5', 'ed274d7e-59aa-492d-8494-460320f3a02a', '6868e446-e913-4cbe-9afa-451d99095bb1', 'fe01b1c2-9963-42e3-af24-2ab7658337cb'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:20:36 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-0ce38449-d1b7-4a08-9c98-fce18a337f62 tempest-GroupsTest-1885823758 None] Created reservations ['71013161-199a-4fde-bee8-3d1a3678918b', '6b842479-dc5b-4d13-88dd-f7aabe9d0a08', 'e8c79065-5eb7-4628-9499-06231dc7282c', 'e8c7fac1-d5c0-41c2-b36e-1a88e8172200'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:20:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0ce38449-d1b7-4a08-9c98-fce18a337f62 tempest-GroupsTest-1885823758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:20:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0ce38449-d1b7-4a08-9c98-fce18a337f62 tempest-GroupsTest-1885823758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:20:36 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0ce38449-d1b7-4a08-9c98-fce18a337f62 tempest-GroupsTest-1885823758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:20:36 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0ce38449-d1b7-4a08-9c98-fce18a337f62 tempest-GroupsTest-1885823758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:20:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0ce38449-d1b7-4a08-9c98-fce18a337f62 tempest-GroupsTest-1885823758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:20:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0ce38449-d1b7-4a08-9c98-fce18a337f62 tempest-GroupsTest-1885823758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:20:36 devstack sudo[92018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:20:36 devstack sudo[92018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:20:37 devstack sudo[92018]: pam_unix(sudo:session): session closed for user root Jun 02 03:20:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0ce38449-d1b7-4a08-9c98-fce18a337f62 tempest-GroupsTest-1885823758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.689s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:20:37 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-0ce38449-d1b7-4a08-9c98-fce18a337f62 tempest-GroupsTest-1885823758 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:20:37 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-0ce38449-d1b7-4a08-9c98-fce18a337f62 tempest-GroupsTest-1885823758 None] Delete group completed successfully. Jun 02 03:20:46 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=54,cinder:UPDATE=52,cinder:INSERT=12,cinder:DELETE=4 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:20:46 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=61,cinder:UPDATE=70,cinder:DELETE=2,cinder:INSERT=12 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:20:47 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9e33622-e3f8-4393-bd48-5e39455271a9 tempest-AttachVolumeShelveTestJSON-808950028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:20:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a9e33622-e3f8-4393-bd48-5e39455271a9 tempest-AttachVolumeShelveTestJSON-808950028 None] Flow 'volume_create_manager' (710fe118-01f0-4398-9a41-2c6577302ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:20:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a9e33622-e3f8-4393-bd48-5e39455271a9 tempest-AttachVolumeShelveTestJSON-808950028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b25d4b6-d490-4095-a5b2-05d9ecaf82fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:20:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a9e33622-e3f8-4393-bd48-5e39455271a9 tempest-AttachVolumeShelveTestJSON-808950028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b25d4b6-d490-4095-a5b2-05d9ecaf82fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1077074750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77b4973f-4a88-4acd-b863-644ee283ea0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4722eeb492a4822995665c03077ee81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:20:47Z,use_quota=True,user_id='99dc2db648784502ba37a054d0331947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:20:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a9e33622-e3f8-4393-bd48-5e39455271a9 tempest-AttachVolumeShelveTestJSON-808950028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (680394ce-4c75-41b0-ab67-31f31835677e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:20:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a9e33622-e3f8-4393-bd48-5e39455271a9 tempest-AttachVolumeShelveTestJSON-808950028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (680394ce-4c75-41b0-ab67-31f31835677e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:20:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a9e33622-e3f8-4393-bd48-5e39455271a9 tempest-AttachVolumeShelveTestJSON-808950028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (335a945b-66a3-49e3-a1a1-100f37b79615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:20:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a9e33622-e3f8-4393-bd48-5e39455271a9 tempest-AttachVolumeShelveTestJSON-808950028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (335a945b-66a3-49e3-a1a1-100f37b79615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77b4973f-4a88-4acd-b863-644ee283ea0b', 'volume_name': 'volume-77b4973f-4a88-4acd-b863-644ee283ea0b', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:20:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a9e33622-e3f8-4393-bd48-5e39455271a9 tempest-AttachVolumeShelveTestJSON-808950028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d46f3e0b-d04e-43a9-ac29-c6a5677fc092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:20:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a9e33622-e3f8-4393-bd48-5e39455271a9 tempest-AttachVolumeShelveTestJSON-808950028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d46f3e0b-d04e-43a9-ac29-c6a5677fc092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:20:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a9e33622-e3f8-4393-bd48-5e39455271a9 tempest-AttachVolumeShelveTestJSON-808950028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f10b5e-3e5f-4b5d-aa8b-aaab68ec46c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:20:47 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-a9e33622-e3f8-4393-bd48-5e39455271a9 tempest-AttachVolumeShelveTestJSON-808950028 None] Volume 77b4973f-4a88-4acd-b863-644ee283ea0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77b4973f-4a88-4acd-b863-644ee283ea0b', 'volume_size': 1} Jun 02 03:20:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a9e33622-e3f8-4393-bd48-5e39455271a9 tempest-AttachVolumeShelveTestJSON-808950028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:20:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a9e33622-e3f8-4393-bd48-5e39455271a9 tempest-AttachVolumeShelveTestJSON-808950028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:20:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a9e33622-e3f8-4393-bd48-5e39455271a9 tempest-AttachVolumeShelveTestJSON-808950028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1077074750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77b4973f-4a88-4acd-b863-644ee283ea0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4722eeb492a4822995665c03077ee81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:20:47Z,use_quota=True,user_id='99dc2db648784502ba37a054d0331947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:20:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-a9e33622-e3f8-4393-bd48-5e39455271a9 tempest-AttachVolumeShelveTestJSON-808950028 None] Creating volume 77b4973f-4a88-4acd-b863-644ee283ea0b {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:20:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a9e33622-e3f8-4393-bd48-5e39455271a9 tempest-AttachVolumeShelveTestJSON-808950028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:20:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a9e33622-e3f8-4393-bd48-5e39455271a9 tempest-AttachVolumeShelveTestJSON-808950028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:20:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a9e33622-e3f8-4393-bd48-5e39455271a9 tempest-AttachVolumeShelveTestJSON-808950028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:20:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a9e33622-e3f8-4393-bd48-5e39455271a9 tempest-AttachVolumeShelveTestJSON-808950028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:20:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a9e33622-e3f8-4393-bd48-5e39455271a9 tempest-AttachVolumeShelveTestJSON-808950028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:20:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a9e33622-e3f8-4393-bd48-5e39455271a9 tempest-AttachVolumeShelveTestJSON-808950028 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:20:47 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-a9e33622-e3f8-4393-bd48-5e39455271a9 tempest-AttachVolumeShelveTestJSON-808950028 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:20:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a9e33622-e3f8-4393-bd48-5e39455271a9 tempest-AttachVolumeShelveTestJSON-808950028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-77b4973f-4a88-4acd-b863-644ee283ea0b 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:20:47 devstack sudo[92099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-77b4973f-4a88-4acd-b863-644ee283ea0b 1073741824 Jun 02 03:20:47 devstack sudo[92099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:20:48 devstack sudo[92099]: pam_unix(sudo:session): session closed for user root Jun 02 03:20:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a9e33622-e3f8-4393-bd48-5e39455271a9 tempest-AttachVolumeShelveTestJSON-808950028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-77b4973f-4a88-4acd-b863-644ee283ea0b 1073741824" returned: 0 in 0.928s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:20:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a9e33622-e3f8-4393-bd48-5e39455271a9 tempest-AttachVolumeShelveTestJSON-808950028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-77b4973f-4a88-4acd-b863-644ee283ea0b {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:20:48 devstack sudo[92105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-77b4973f-4a88-4acd-b863-644ee283ea0b Jun 02 03:20:48 devstack sudo[92105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:20:48 devstack sudo[92105]: pam_unix(sudo:session): session closed for user root Jun 02 03:20:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a9e33622-e3f8-4393-bd48-5e39455271a9 tempest-AttachVolumeShelveTestJSON-808950028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-77b4973f-4a88-4acd-b863-644ee283ea0b" returned: 0 in 0.633s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:20:48 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a9e33622-e3f8-4393-bd48-5e39455271a9 tempest-AttachVolumeShelveTestJSON-808950028 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:20:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a9e33622-e3f8-4393-bd48-5e39455271a9 tempest-AttachVolumeShelveTestJSON-808950028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:20:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a9e33622-e3f8-4393-bd48-5e39455271a9 tempest-AttachVolumeShelveTestJSON-808950028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f10b5e-3e5f-4b5d-aa8b-aaab68ec46c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77b4973f-4a88-4acd-b863-644ee283ea0b', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:20:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a9e33622-e3f8-4393-bd48-5e39455271a9 tempest-AttachVolumeShelveTestJSON-808950028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9189386-ddb8-4a52-abe7-bf40e4c9c81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:20:48 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-a9e33622-e3f8-4393-bd48-5e39455271a9 tempest-AttachVolumeShelveTestJSON-808950028 None] Volume volume-77b4973f-4a88-4acd-b863-644ee283ea0b (77b4973f-4a88-4acd-b863-644ee283ea0b): created successfully Jun 02 03:20:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a9e33622-e3f8-4393-bd48-5e39455271a9 tempest-AttachVolumeShelveTestJSON-808950028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9189386-ddb8-4a52-abe7-bf40e4c9c81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:20:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a9e33622-e3f8-4393-bd48-5e39455271a9 tempest-AttachVolumeShelveTestJSON-808950028 None] Flow 'volume_create_manager' (710fe118-01f0-4398-9a41-2c6577302ca6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:20:48 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-a9e33622-e3f8-4393-bd48-5e39455271a9 tempest-AttachVolumeShelveTestJSON-808950028 None] Created volume successfully. Jun 02 03:20:53 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a938f00-c32a-4845-98c7-e55a75f53401 tempest-AttachVolumeTestJSON-1448729226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:20:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8a938f00-c32a-4845-98c7-e55a75f53401 tempest-AttachVolumeTestJSON-1448729226 None] Flow 'volume_create_manager' (0530a79b-ed1b-4e95-b4ae-6bf5392e885f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:20:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8a938f00-c32a-4845-98c7-e55a75f53401 tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20da8811-7caf-4288-bf44-d8ea7e26f1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:20:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8a938f00-c32a-4845-98c7-e55a75f53401 tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20da8811-7caf-4288-bf44-d8ea7e26f1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1256954664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f774ca46-739c-400f-8b1b-8df9996b37a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115386977b8e4618a3fa08387dc03f78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:20:54Z,use_quota=True,user_id='f750d23b6b4b4383b904a6328bcd3208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:20:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8a938f00-c32a-4845-98c7-e55a75f53401 tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (906b17cc-feb2-4f84-9c51-1b7893c906fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:20:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8a938f00-c32a-4845-98c7-e55a75f53401 tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (906b17cc-feb2-4f84-9c51-1b7893c906fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:20:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8a938f00-c32a-4845-98c7-e55a75f53401 tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65339aa7-bf10-4338-b613-dd43bc88a118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:20:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8a938f00-c32a-4845-98c7-e55a75f53401 tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65339aa7-bf10-4338-b613-dd43bc88a118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f774ca46-739c-400f-8b1b-8df9996b37a7', 'volume_name': 'volume-f774ca46-739c-400f-8b1b-8df9996b37a7', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:20:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8a938f00-c32a-4845-98c7-e55a75f53401 tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3447e719-1a2d-4886-8f8c-795474614746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:20:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8a938f00-c32a-4845-98c7-e55a75f53401 tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3447e719-1a2d-4886-8f8c-795474614746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:20:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8a938f00-c32a-4845-98c7-e55a75f53401 tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37dd1e03-cc68-40ab-9fa0-7a4e87a24f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:20:53 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-8a938f00-c32a-4845-98c7-e55a75f53401 tempest-AttachVolumeTestJSON-1448729226 None] Volume f774ca46-739c-400f-8b1b-8df9996b37a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f774ca46-739c-400f-8b1b-8df9996b37a7', 'volume_size': 1} Jun 02 03:20:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8a938f00-c32a-4845-98c7-e55a75f53401 tempest-AttachVolumeTestJSON-1448729226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:20:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8a938f00-c32a-4845-98c7-e55a75f53401 tempest-AttachVolumeTestJSON-1448729226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:20:53 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-8a938f00-c32a-4845-98c7-e55a75f53401 tempest-AttachVolumeTestJSON-1448729226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1256954664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f774ca46-739c-400f-8b1b-8df9996b37a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115386977b8e4618a3fa08387dc03f78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:20:54Z,use_quota=True,user_id='f750d23b6b4b4383b904a6328bcd3208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:20:53 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-8a938f00-c32a-4845-98c7-e55a75f53401 tempest-AttachVolumeTestJSON-1448729226 None] Creating volume f774ca46-739c-400f-8b1b-8df9996b37a7 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:20:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8a938f00-c32a-4845-98c7-e55a75f53401 tempest-AttachVolumeTestJSON-1448729226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:20:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8a938f00-c32a-4845-98c7-e55a75f53401 tempest-AttachVolumeTestJSON-1448729226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:20:53 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-8a938f00-c32a-4845-98c7-e55a75f53401 tempest-AttachVolumeTestJSON-1448729226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:20:53 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-8a938f00-c32a-4845-98c7-e55a75f53401 tempest-AttachVolumeTestJSON-1448729226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:20:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8a938f00-c32a-4845-98c7-e55a75f53401 tempest-AttachVolumeTestJSON-1448729226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:20:53 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-8a938f00-c32a-4845-98c7-e55a75f53401 tempest-AttachVolumeTestJSON-1448729226 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:20:53 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-8a938f00-c32a-4845-98c7-e55a75f53401 tempest-AttachVolumeTestJSON-1448729226 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:20:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8a938f00-c32a-4845-98c7-e55a75f53401 tempest-AttachVolumeTestJSON-1448729226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f774ca46-739c-400f-8b1b-8df9996b37a7 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:20:53 devstack sudo[92207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f774ca46-739c-400f-8b1b-8df9996b37a7 1073741824 Jun 02 03:20:53 devstack sudo[92207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:20:55 devstack sudo[92207]: pam_unix(sudo:session): session closed for user root Jun 02 03:20:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8a938f00-c32a-4845-98c7-e55a75f53401 tempest-AttachVolumeTestJSON-1448729226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f774ca46-739c-400f-8b1b-8df9996b37a7 1073741824" returned: 0 in 1.120s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:20:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8a938f00-c32a-4845-98c7-e55a75f53401 tempest-AttachVolumeTestJSON-1448729226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f774ca46-739c-400f-8b1b-8df9996b37a7 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:20:55 devstack sudo[92224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f774ca46-739c-400f-8b1b-8df9996b37a7 Jun 02 03:20:55 devstack sudo[92224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:20:55 devstack sudo[92224]: pam_unix(sudo:session): session closed for user root Jun 02 03:20:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8a938f00-c32a-4845-98c7-e55a75f53401 tempest-AttachVolumeTestJSON-1448729226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f774ca46-739c-400f-8b1b-8df9996b37a7" returned: 0 in 0.638s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:20:55 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-8a938f00-c32a-4845-98c7-e55a75f53401 tempest-AttachVolumeTestJSON-1448729226 None] <== create_volume: return (1816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:20:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8a938f00-c32a-4845-98c7-e55a75f53401 tempest-AttachVolumeTestJSON-1448729226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.819s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:20:55 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8a938f00-c32a-4845-98c7-e55a75f53401 tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37dd1e03-cc68-40ab-9fa0-7a4e87a24f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f774ca46-739c-400f-8b1b-8df9996b37a7', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:20:55 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8a938f00-c32a-4845-98c7-e55a75f53401 tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d6941ec-ae21-4c1e-ae52-9b85cebed41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:20:55 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-8a938f00-c32a-4845-98c7-e55a75f53401 tempest-AttachVolumeTestJSON-1448729226 None] Volume volume-f774ca46-739c-400f-8b1b-8df9996b37a7 (f774ca46-739c-400f-8b1b-8df9996b37a7): created successfully Jun 02 03:20:55 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8a938f00-c32a-4845-98c7-e55a75f53401 tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d6941ec-ae21-4c1e-ae52-9b85cebed41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:20:55 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8a938f00-c32a-4845-98c7-e55a75f53401 tempest-AttachVolumeTestJSON-1448729226 None] Flow 'volume_create_manager' (0530a79b-ed1b-4e95-b4ae-6bf5392e885f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:20:55 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-8a938f00-c32a-4845-98c7-e55a75f53401 tempest-AttachVolumeTestJSON-1448729226 None] Created volume successfully. Jun 02 03:20:58 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-831d2e9d-bd2e-4033-8e5f-69f0981f1e68 tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:20:58 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-831d2e9d-bd2e-4033-8e5f-69f0981f1e68 tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Flow 'volume_create_manager' (63b1599e-8913-421b-9d6d-25ffdb27b09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:20:58 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-831d2e9d-bd2e-4033-8e5f-69f0981f1e68 tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bdf947d-f146-4f1a-b5d6-3ce6b99d68cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:20:58 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-831d2e9d-bd2e-4033-8e5f-69f0981f1e68 tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bdf947d-f146-4f1a-b5d6-3ce6b99d68cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1478128377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f2746e1-18af-42bc-8292-45b72cdb4dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bead45708b34cdbb1deb7a09cebf912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:20:58Z,use_quota=True,user_id='a252737bbae24ba6809015ff0743dcee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0567fb3e-625f-447f-85a2-a65963029a16),volume_type_id=0567fb3e-625f-447f-85a2-a65963029a16)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:20:58 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-831d2e9d-bd2e-4033-8e5f-69f0981f1e68 tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51037677-365f-4520-bd5a-12f11ae592e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:20:58 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-831d2e9d-bd2e-4033-8e5f-69f0981f1e68 tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51037677-365f-4520-bd5a-12f11ae592e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:20:58 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-831d2e9d-bd2e-4033-8e5f-69f0981f1e68 tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec20e2e-d39e-4cd8-ba71-e5d625fa7de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:20:58 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-831d2e9d-bd2e-4033-8e5f-69f0981f1e68 tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec20e2e-d39e-4cd8-ba71-e5d625fa7de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f2746e1-18af-42bc-8292-45b72cdb4dcc', 'volume_name': 'volume-8f2746e1-18af-42bc-8292-45b72cdb4dcc', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:20:58 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-831d2e9d-bd2e-4033-8e5f-69f0981f1e68 tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3ab2fc-488e-456b-b16a-e0c976083a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:20:58 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-831d2e9d-bd2e-4033-8e5f-69f0981f1e68 tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3ab2fc-488e-456b-b16a-e0c976083a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:20:58 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-831d2e9d-bd2e-4033-8e5f-69f0981f1e68 tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be1cd9b7-988a-47e0-960c-b6441c3a0fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:20:58 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-831d2e9d-bd2e-4033-8e5f-69f0981f1e68 tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Volume 8f2746e1-18af-42bc-8292-45b72cdb4dcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f2746e1-18af-42bc-8292-45b72cdb4dcc', 'volume_size': 1} Jun 02 03:20:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-831d2e9d-bd2e-4033-8e5f-69f0981f1e68 tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:20:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-831d2e9d-bd2e-4033-8e5f-69f0981f1e68 tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:20:58 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-831d2e9d-bd2e-4033-8e5f-69f0981f1e68 tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1478128377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f2746e1-18af-42bc-8292-45b72cdb4dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bead45708b34cdbb1deb7a09cebf912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:20:58Z,use_quota=True,user_id='a252737bbae24ba6809015ff0743dcee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0567fb3e-625f-447f-85a2-a65963029a16),volume_type_id=0567fb3e-625f-447f-85a2-a65963029a16)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:20:58 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-831d2e9d-bd2e-4033-8e5f-69f0981f1e68 tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Creating volume 8f2746e1-18af-42bc-8292-45b72cdb4dcc {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:20:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-831d2e9d-bd2e-4033-8e5f-69f0981f1e68 tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:20:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-831d2e9d-bd2e-4033-8e5f-69f0981f1e68 tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:20:58 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-831d2e9d-bd2e-4033-8e5f-69f0981f1e68 tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:20:58 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-831d2e9d-bd2e-4033-8e5f-69f0981f1e68 tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:20:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-831d2e9d-bd2e-4033-8e5f-69f0981f1e68 tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:20:58 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-831d2e9d-bd2e-4033-8e5f-69f0981f1e68 tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:20:58 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-831d2e9d-bd2e-4033-8e5f-69f0981f1e68 tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:20:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-831d2e9d-bd2e-4033-8e5f-69f0981f1e68 tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8f2746e1-18af-42bc-8292-45b72cdb4dcc 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:20:58 devstack sudo[92247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8f2746e1-18af-42bc-8292-45b72cdb4dcc 1073741824 Jun 02 03:20:58 devstack sudo[92247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:20:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-ef0de441-3aa8-4a63-9a4f-9e5755201e03 req-0c2def9d-1e9a-4544-bc44-6c8943890939 tempest-AttachVolumeTestJSON-1448729226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:20:59 devstack sudo[92247]: pam_unix(sudo:session): session closed for user root Jun 02 03:20:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-831d2e9d-bd2e-4033-8e5f-69f0981f1e68 tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8f2746e1-18af-42bc-8292-45b72cdb4dcc 1073741824" returned: 0 in 1.237s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:20:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-831d2e9d-bd2e-4033-8e5f-69f0981f1e68 tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8f2746e1-18af-42bc-8292-45b72cdb4dcc {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:20:59 devstack sudo[92262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8f2746e1-18af-42bc-8292-45b72cdb4dcc Jun 02 03:20:59 devstack sudo[92262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:21:00 devstack sudo[92262]: pam_unix(sudo:session): session closed for user root Jun 02 03:21:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-831d2e9d-bd2e-4033-8e5f-69f0981f1e68 tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8f2746e1-18af-42bc-8292-45b72cdb4dcc" returned: 0 in 0.607s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:21:00 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-831d2e9d-bd2e-4033-8e5f-69f0981f1e68 tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] <== create_volume: return (1892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:21:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-831d2e9d-bd2e-4033-8e5f-69f0981f1e68 tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:21:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-ef0de441-3aa8-4a63-9a4f-9e5755201e03 req-0c2def9d-1e9a-4544-bc44-6c8943890939 tempest-AttachVolumeTestJSON-1448729226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.695s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:21:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-831d2e9d-bd2e-4033-8e5f-69f0981f1e68 tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be1cd9b7-988a-47e0-960c-b6441c3a0fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f2746e1-18af-42bc-8292-45b72cdb4dcc', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:21:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-831d2e9d-bd2e-4033-8e5f-69f0981f1e68 tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a4d573f-723a-4f89-803b-ce28b079199e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:21:00 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[234667ea-19aa-403d-9eb1-b0760fbf45e1]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:21:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-ef0de441-3aa8-4a63-9a4f-9e5755201e03 req-0c2def9d-1e9a-4544-bc44-6c8943890939 tempest-AttachVolumeTestJSON-1448729226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f774ca46-739c-400f-8b1b-8df9996b37a7 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:21:00 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-831d2e9d-bd2e-4033-8e5f-69f0981f1e68 tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Volume volume-8f2746e1-18af-42bc-8292-45b72cdb4dcc (8f2746e1-18af-42bc-8292-45b72cdb4dcc): created successfully Jun 02 03:21:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-831d2e9d-bd2e-4033-8e5f-69f0981f1e68 tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a4d573f-723a-4f89-803b-ce28b079199e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:21:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-831d2e9d-bd2e-4033-8e5f-69f0981f1e68 tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Flow 'volume_create_manager' (63b1599e-8913-421b-9d6d-25ffdb27b09f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:21:00 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-831d2e9d-bd2e-4033-8e5f-69f0981f1e68 tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Created volume successfully. Jun 02 03:21:00 devstack sudo[92265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f774ca46-739c-400f-8b1b-8df9996b37a7 Jun 02 03:21:00 devstack sudo[92265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:21:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e599f3a4-1532-415f-9250-430877573ffc tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:21:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e599f3a4-1532-415f-9250-430877573ffc tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:21:00 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e599f3a4-1532-415f-9250-430877573ffc tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:21:00 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e599f3a4-1532-415f-9250-430877573ffc tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:21:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e599f3a4-1532-415f-9250-430877573ffc tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:21:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e599f3a4-1532-415f-9250-430877573ffc tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:21:00 devstack sudo[92267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:21:00 devstack sudo[92267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:21:01 devstack sudo[92265]: pam_unix(sudo:session): session closed for user root Jun 02 03:21:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-ef0de441-3aa8-4a63-9a4f-9e5755201e03 req-0c2def9d-1e9a-4544-bc44-6c8943890939 tempest-AttachVolumeTestJSON-1448729226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f774ca46-739c-400f-8b1b-8df9996b37a7" returned: 0 in 0.888s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:21:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-ef0de441-3aa8-4a63-9a4f-9e5755201e03 req-0c2def9d-1e9a-4544-bc44-6c8943890939 tempest-AttachVolumeTestJSON-1448729226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.920s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:21:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-ef0de441-3aa8-4a63-9a4f-9e5755201e03 req-0c2def9d-1e9a-4544-bc44-6c8943890939 tempest-AttachVolumeTestJSON-1448729226 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1', 'name': 'volume-f774ca46-739c-400f-8b1b-8df9996b37a7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9329c66b-ec44-4b6c-871b-e4c4a59bee66', 'enforce_multipath': True} {{(pid=86431) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 02 03:21:01 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-ef0de441-3aa8-4a63-9a4f-9e5755201e03 req-0c2def9d-1e9a-4544-bc44-6c8943890939 tempest-AttachVolumeTestJSON-1448729226 None] attachment_update completed successfully. Jun 02 03:21:01 devstack sudo[92267]: pam_unix(sudo:session): session closed for user root Jun 02 03:21:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e599f3a4-1532-415f-9250-430877573ffc tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.702s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:21:01 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-e599f3a4-1532-415f-9250-430877573ffc tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:21:01 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-e599f3a4-1532-415f-9250-430877573ffc tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Retype volume completed successfully. Jun 02 03:21:02 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e1161693-ebac-40bf-857e-147d78b5a6bd tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Acquiring lock "cinder-8f2746e1-18af-42bc-8292-45b72cdb4dcc-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:21:02 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e1161693-ebac-40bf-857e-147d78b5a6bd tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Lock "cinder-8f2746e1-18af-42bc-8292-45b72cdb4dcc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:21:02 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e1161693-ebac-40bf-857e-147d78b5a6bd tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Acquiring lock "cinder-quobyte-8f2746e1-18af-42bc-8292-45b72cdb4dcc" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:21:02 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e1161693-ebac-40bf-857e-147d78b5a6bd tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Lock "cinder-quobyte-8f2746e1-18af-42bc-8292-45b72cdb4dcc" acquired by "delete_volume" :: waited 0.024s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:21:02 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a737639-ba6b-4d30-b232-135f29ec01e1]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:21:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e1161693-ebac-40bf-857e-147d78b5a6bd tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8f2746e1-18af-42bc-8292-45b72cdb4dcc {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:21:02 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-3aca0c60-359a-451d-b655-5ddd990a237a req-555d9c97-cc53-4904-b2a6-200f8b848c81 tempest-AttachVolumeNegativeTest-1165991087 None] Terminate volume connection completed successfully. Jun 02 03:21:02 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-3aca0c60-359a-451d-b655-5ddd990a237a req-555d9c97-cc53-4904-b2a6-200f8b848c81 tempest-AttachVolumeNegativeTest-1165991087 None] Deleting attachment 7ceef213-1227-48b9-8163-1e5755c676bb. {{(pid=86431) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 02 03:21:02 devstack sudo[92279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8f2746e1-18af-42bc-8292-45b72cdb4dcc Jun 02 03:21:02 devstack sudo[92279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:21:03 devstack sudo[92279]: pam_unix(sudo:session): session closed for user root Jun 02 03:21:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e1161693-ebac-40bf-857e-147d78b5a6bd tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8f2746e1-18af-42bc-8292-45b72cdb4dcc" returned: 0 in 0.801s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:21:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e1161693-ebac-40bf-857e-147d78b5a6bd tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8f2746e1-18af-42bc-8292-45b72cdb4dcc {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:21:03 devstack sudo[92285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8f2746e1-18af-42bc-8292-45b72cdb4dcc Jun 02 03:21:03 devstack sudo[92285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:21:03 devstack sudo[92285]: pam_unix(sudo:session): session closed for user root Jun 02 03:21:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e1161693-ebac-40bf-857e-147d78b5a6bd tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8f2746e1-18af-42bc-8292-45b72cdb4dcc" returned: 0 in 0.624s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:21:03 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e1161693-ebac-40bf-857e-147d78b5a6bd tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Lock "cinder-quobyte-8f2746e1-18af-42bc-8292-45b72cdb4dcc" released by "delete_volume" :: held 1.481s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:21:03 devstack cinder-volume[86431]: WARNING cinder.quota [None req-e1161693-ebac-40bf-857e-147d78b5a6bd tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 02 03:21:03 devstack cinder-volume[86431]: WARNING cinder.quota [None req-e1161693-ebac-40bf-857e-147d78b5a6bd tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 02 03:21:03 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-e1161693-ebac-40bf-857e-147d78b5a6bd tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Created reservations ['c01ef73b-4989-4dd0-b0f0-03fcc7aea8eb', '945288c6-109f-4461-8c8a-e03dc2fe57f0', '7ab370c3-9eab-4714-840e-e0c86e3ef98d', '863d5567-512c-4f73-84f7-88a5153ab64c'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:21:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e1161693-ebac-40bf-857e-147d78b5a6bd tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:21:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e1161693-ebac-40bf-857e-147d78b5a6bd tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:21:03 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e1161693-ebac-40bf-857e-147d78b5a6bd tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:21:03 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e1161693-ebac-40bf-857e-147d78b5a6bd tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:21:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e1161693-ebac-40bf-857e-147d78b5a6bd tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:21:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e1161693-ebac-40bf-857e-147d78b5a6bd tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:21:03 devstack sudo[92288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:21:03 devstack sudo[92288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:21:04 devstack sudo[92288]: pam_unix(sudo:session): session closed for user root Jun 02 03:21:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e1161693-ebac-40bf-857e-147d78b5a6bd tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.675s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:21:04 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-e1161693-ebac-40bf-857e-147d78b5a6bd tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:21:04 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-e1161693-ebac-40bf-857e-147d78b5a6bd tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Deleted volume successfully. Jun 02 03:21:04 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e1161693-ebac-40bf-857e-147d78b5a6bd tempest-VolumeRetypeWithoutMigrationTest-1350587177 None] Lock "cinder-8f2746e1-18af-42bc-8292-45b72cdb4dcc-delete_volume" released by "delete_volume" :: held 2.416s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:21:06 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-128d2e35-2d21-4cf7-8a9c-183fec74810a tempest-AttachVolumeTestJSON-1448729226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:21:06 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-128d2e35-2d21-4cf7-8a9c-183fec74810a tempest-AttachVolumeTestJSON-1448729226 None] Flow 'volume_create_manager' (bc00cc5e-f2ce-47cb-abca-224f48ee3d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:21:06 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-128d2e35-2d21-4cf7-8a9c-183fec74810a tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d23a732-b71c-4a2f-ae4e-cd50887cb66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:21:06 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-128d2e35-2d21-4cf7-8a9c-183fec74810a tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d23a732-b71c-4a2f-ae4e-cd50887cb66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-135193290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=232dfef2-9dc3-4005-8529-426f93f02a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115386977b8e4618a3fa08387dc03f78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:21:06Z,use_quota=True,user_id='f750d23b6b4b4383b904a6328bcd3208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:21:06 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-128d2e35-2d21-4cf7-8a9c-183fec74810a tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b52f809-1a3d-4955-a117-21ad26b49cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:21:06 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-128d2e35-2d21-4cf7-8a9c-183fec74810a tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b52f809-1a3d-4955-a117-21ad26b49cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:21:06 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-128d2e35-2d21-4cf7-8a9c-183fec74810a tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (762927f4-9f60-4949-ba9e-24e580135907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:21:06 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-128d2e35-2d21-4cf7-8a9c-183fec74810a tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (762927f4-9f60-4949-ba9e-24e580135907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '232dfef2-9dc3-4005-8529-426f93f02a92', 'volume_name': 'volume-232dfef2-9dc3-4005-8529-426f93f02a92', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:21:06 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-128d2e35-2d21-4cf7-8a9c-183fec74810a tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f444b4fc-7fac-4122-8b8f-4b92a00ea28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:21:06 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-128d2e35-2d21-4cf7-8a9c-183fec74810a tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f444b4fc-7fac-4122-8b8f-4b92a00ea28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:21:06 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-128d2e35-2d21-4cf7-8a9c-183fec74810a tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a6df6d-71dd-472b-94ff-4c29587dba24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:21:06 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-128d2e35-2d21-4cf7-8a9c-183fec74810a tempest-AttachVolumeTestJSON-1448729226 None] Volume 232dfef2-9dc3-4005-8529-426f93f02a92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-232dfef2-9dc3-4005-8529-426f93f02a92', 'volume_size': 1} Jun 02 03:21:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-128d2e35-2d21-4cf7-8a9c-183fec74810a tempest-AttachVolumeTestJSON-1448729226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:21:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-128d2e35-2d21-4cf7-8a9c-183fec74810a tempest-AttachVolumeTestJSON-1448729226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:21:06 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-128d2e35-2d21-4cf7-8a9c-183fec74810a tempest-AttachVolumeTestJSON-1448729226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-135193290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=232dfef2-9dc3-4005-8529-426f93f02a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='115386977b8e4618a3fa08387dc03f78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:21:06Z,use_quota=True,user_id='f750d23b6b4b4383b904a6328bcd3208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:21:06 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-128d2e35-2d21-4cf7-8a9c-183fec74810a tempest-AttachVolumeTestJSON-1448729226 None] Creating volume 232dfef2-9dc3-4005-8529-426f93f02a92 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:21:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-128d2e35-2d21-4cf7-8a9c-183fec74810a tempest-AttachVolumeTestJSON-1448729226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:21:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-128d2e35-2d21-4cf7-8a9c-183fec74810a tempest-AttachVolumeTestJSON-1448729226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:21:06 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-128d2e35-2d21-4cf7-8a9c-183fec74810a tempest-AttachVolumeTestJSON-1448729226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:21:06 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-128d2e35-2d21-4cf7-8a9c-183fec74810a tempest-AttachVolumeTestJSON-1448729226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:21:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-128d2e35-2d21-4cf7-8a9c-183fec74810a tempest-AttachVolumeTestJSON-1448729226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:21:06 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-128d2e35-2d21-4cf7-8a9c-183fec74810a tempest-AttachVolumeTestJSON-1448729226 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:21:06 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-128d2e35-2d21-4cf7-8a9c-183fec74810a tempest-AttachVolumeTestJSON-1448729226 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:21:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-128d2e35-2d21-4cf7-8a9c-183fec74810a tempest-AttachVolumeTestJSON-1448729226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-232dfef2-9dc3-4005-8529-426f93f02a92 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:21:06 devstack sudo[92329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-232dfef2-9dc3-4005-8529-426f93f02a92 1073741824 Jun 02 03:21:06 devstack sudo[92329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:21:07 devstack sudo[92329]: pam_unix(sudo:session): session closed for user root Jun 02 03:21:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-128d2e35-2d21-4cf7-8a9c-183fec74810a tempest-AttachVolumeTestJSON-1448729226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-232dfef2-9dc3-4005-8529-426f93f02a92 1073741824" returned: 0 in 0.964s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:21:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-128d2e35-2d21-4cf7-8a9c-183fec74810a tempest-AttachVolumeTestJSON-1448729226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-232dfef2-9dc3-4005-8529-426f93f02a92 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:21:07 devstack sudo[92336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-232dfef2-9dc3-4005-8529-426f93f02a92 Jun 02 03:21:07 devstack sudo[92336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:21:08 devstack sudo[92336]: pam_unix(sudo:session): session closed for user root Jun 02 03:21:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-128d2e35-2d21-4cf7-8a9c-183fec74810a tempest-AttachVolumeTestJSON-1448729226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-232dfef2-9dc3-4005-8529-426f93f02a92" returned: 0 in 0.809s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:21:08 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-128d2e35-2d21-4cf7-8a9c-183fec74810a tempest-AttachVolumeTestJSON-1448729226 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:21:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-128d2e35-2d21-4cf7-8a9c-183fec74810a tempest-AttachVolumeTestJSON-1448729226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:21:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-128d2e35-2d21-4cf7-8a9c-183fec74810a tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a6df6d-71dd-472b-94ff-4c29587dba24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-232dfef2-9dc3-4005-8529-426f93f02a92', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:21:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-128d2e35-2d21-4cf7-8a9c-183fec74810a tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc8ed93-467b-4385-8fbb-ae757510510b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:21:08 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-128d2e35-2d21-4cf7-8a9c-183fec74810a tempest-AttachVolumeTestJSON-1448729226 None] Volume volume-232dfef2-9dc3-4005-8529-426f93f02a92 (232dfef2-9dc3-4005-8529-426f93f02a92): created successfully Jun 02 03:21:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-128d2e35-2d21-4cf7-8a9c-183fec74810a tempest-AttachVolumeTestJSON-1448729226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc8ed93-467b-4385-8fbb-ae757510510b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:21:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-128d2e35-2d21-4cf7-8a9c-183fec74810a tempest-AttachVolumeTestJSON-1448729226 None] Flow 'volume_create_manager' (bc00cc5e-f2ce-47cb-abca-224f48ee3d4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:21:08 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-128d2e35-2d21-4cf7-8a9c-183fec74810a tempest-AttachVolumeTestJSON-1448729226 None] Created volume successfully. Jun 02 03:21:09 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:21:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:21:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:21:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:21:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:21:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:21:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:21:09 devstack sudo[92341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:21:09 devstack sudo[92341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:21:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-a8878e20-12c6-474b-87fd-94182ad5fb82 req-1f8f3207-6904-471b-ba41-6df4e0910d8b tempest-AttachVolumeShelveTestJSON-808950028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:21:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-a8878e20-12c6-474b-87fd-94182ad5fb82 req-1f8f3207-6904-471b-ba41-6df4e0910d8b tempest-AttachVolumeShelveTestJSON-808950028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:21:09 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[048887c6-c393-46e9-80ae-b0781c90bf20]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:21:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-a8878e20-12c6-474b-87fd-94182ad5fb82 req-1f8f3207-6904-471b-ba41-6df4e0910d8b tempest-AttachVolumeShelveTestJSON-808950028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-77b4973f-4a88-4acd-b863-644ee283ea0b {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:21:10 devstack sudo[92351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-77b4973f-4a88-4acd-b863-644ee283ea0b Jun 02 03:21:10 devstack sudo[92351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:21:10 devstack sudo[92341]: pam_unix(sudo:session): session closed for user root Jun 02 03:21:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.648s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:21:10 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:21:10 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager._thread_info {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:21:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread count: 8 {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 02 03:21:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread info: [<_MainThread(MainThread, started 138618128814208)>, , , , , , , ] {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 02 03:21:10 devstack sudo[92351]: pam_unix(sudo:session): session closed for user root Jun 02 03:21:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-a8878e20-12c6-474b-87fd-94182ad5fb82 req-1f8f3207-6904-471b-ba41-6df4e0910d8b tempest-AttachVolumeShelveTestJSON-808950028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-77b4973f-4a88-4acd-b863-644ee283ea0b" returned: 0 in 0.771s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:21:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-a8878e20-12c6-474b-87fd-94182ad5fb82 req-1f8f3207-6904-471b-ba41-6df4e0910d8b tempest-AttachVolumeShelveTestJSON-808950028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.788s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:21:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-a8878e20-12c6-474b-87fd-94182ad5fb82 req-1f8f3207-6904-471b-ba41-6df4e0910d8b tempest-AttachVolumeShelveTestJSON-808950028 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1', 'name': 'volume-77b4973f-4a88-4acd-b863-644ee283ea0b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd3fa2eba-42ce-4852-beca-0621637ae51d', 'enforce_multipath': True} {{(pid=86431) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 02 03:21:10 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-a8878e20-12c6-474b-87fd-94182ad5fb82 req-1f8f3207-6904-471b-ba41-6df4e0910d8b tempest-AttachVolumeShelveTestJSON-808950028 None] attachment_update completed successfully. Jun 02 03:21:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-494a1e5e-7a77-423d-a877-f3a9997ca6f2 req-26b947d1-fcea-4b1f-8d5f-bf8b44c3bf90 tempest-AttachVolumeTestJSON-1448729226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:21:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-494a1e5e-7a77-423d-a877-f3a9997ca6f2 req-26b947d1-fcea-4b1f-8d5f-bf8b44c3bf90 tempest-AttachVolumeTestJSON-1448729226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:21:11 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d40b2e-704a-4e50-aa22-10d2ccc347a2]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:21:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-494a1e5e-7a77-423d-a877-f3a9997ca6f2 req-26b947d1-fcea-4b1f-8d5f-bf8b44c3bf90 tempest-AttachVolumeTestJSON-1448729226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-232dfef2-9dc3-4005-8529-426f93f02a92 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:21:11 devstack sudo[92365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-232dfef2-9dc3-4005-8529-426f93f02a92 Jun 02 03:21:11 devstack sudo[92365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:21:12 devstack sudo[92365]: pam_unix(sudo:session): session closed for user root Jun 02 03:21:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-494a1e5e-7a77-423d-a877-f3a9997ca6f2 req-26b947d1-fcea-4b1f-8d5f-bf8b44c3bf90 tempest-AttachVolumeTestJSON-1448729226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-232dfef2-9dc3-4005-8529-426f93f02a92" returned: 0 in 0.857s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:21:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-494a1e5e-7a77-423d-a877-f3a9997ca6f2 req-26b947d1-fcea-4b1f-8d5f-bf8b44c3bf90 tempest-AttachVolumeTestJSON-1448729226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.880s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:21:12 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-494a1e5e-7a77-423d-a877-f3a9997ca6f2 req-26b947d1-fcea-4b1f-8d5f-bf8b44c3bf90 tempest-AttachVolumeTestJSON-1448729226 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1', 'name': 'volume-232dfef2-9dc3-4005-8529-426f93f02a92', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4dc63201-8d35-457e-8ddb-65a0486dab51', 'enforce_multipath': True} {{(pid=86431) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 02 03:21:12 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-494a1e5e-7a77-423d-a877-f3a9997ca6f2 req-26b947d1-fcea-4b1f-8d5f-bf8b44c3bf90 tempest-AttachVolumeTestJSON-1448729226 None] attachment_update completed successfully. Jun 02 03:21:17 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-1419dfee-7e1d-490a-bd28-41929dfeb875 tempest-VolumeTypesAccessTest-1027214750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:21:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1419dfee-7e1d-490a-bd28-41929dfeb875 tempest-VolumeTypesAccessTest-1027214750 None] Flow 'volume_create_manager' (ebdc6b30-0ef7-49a0-925b-23ad13f136d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:21:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1419dfee-7e1d-490a-bd28-41929dfeb875 tempest-VolumeTypesAccessTest-1027214750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9510851-dc6a-40c1-b779-8c2d52e805ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:21:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1419dfee-7e1d-490a-bd28-41929dfeb875 tempest-VolumeTypesAccessTest-1027214750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9510851-dc6a-40c1-b779-8c2d52e805ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-800389386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b97c9d07-26b7-46a5-b9aa-a5c4bb6ebaf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e34179ecdfe40f28790cae369baa7c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:21:18Z,use_quota=True,user_id='a72e64cf76894f88ad1bf9ac6b78077b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03948448-426a-40fc-bc14-17f6f2b7a934),volume_type_id=03948448-426a-40fc-bc14-17f6f2b7a934)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:21:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1419dfee-7e1d-490a-bd28-41929dfeb875 tempest-VolumeTypesAccessTest-1027214750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b79a5417-a55c-4961-bfc1-db3f505e6d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:21:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1419dfee-7e1d-490a-bd28-41929dfeb875 tempest-VolumeTypesAccessTest-1027214750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b79a5417-a55c-4961-bfc1-db3f505e6d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:21:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1419dfee-7e1d-490a-bd28-41929dfeb875 tempest-VolumeTypesAccessTest-1027214750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5105ca2-a18a-41e9-b77a-8d06ce63b6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:21:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1419dfee-7e1d-490a-bd28-41929dfeb875 tempest-VolumeTypesAccessTest-1027214750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5105ca2-a18a-41e9-b77a-8d06ce63b6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b97c9d07-26b7-46a5-b9aa-a5c4bb6ebaf9', 'volume_name': 'volume-b97c9d07-26b7-46a5-b9aa-a5c4bb6ebaf9', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:21:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1419dfee-7e1d-490a-bd28-41929dfeb875 tempest-VolumeTypesAccessTest-1027214750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ab52fd3-7f3e-4829-b5b2-55ca024cc7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:21:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1419dfee-7e1d-490a-bd28-41929dfeb875 tempest-VolumeTypesAccessTest-1027214750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ab52fd3-7f3e-4829-b5b2-55ca024cc7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:21:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1419dfee-7e1d-490a-bd28-41929dfeb875 tempest-VolumeTypesAccessTest-1027214750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c8b920-4856-4902-86d0-df03c83f1093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:21:17 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-1419dfee-7e1d-490a-bd28-41929dfeb875 tempest-VolumeTypesAccessTest-1027214750 None] Volume b97c9d07-26b7-46a5-b9aa-a5c4bb6ebaf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b97c9d07-26b7-46a5-b9aa-a5c4bb6ebaf9', 'volume_size': 1} Jun 02 03:21:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1419dfee-7e1d-490a-bd28-41929dfeb875 tempest-VolumeTypesAccessTest-1027214750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:21:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1419dfee-7e1d-490a-bd28-41929dfeb875 tempest-VolumeTypesAccessTest-1027214750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:21:17 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-1419dfee-7e1d-490a-bd28-41929dfeb875 tempest-VolumeTypesAccessTest-1027214750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-800389386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b97c9d07-26b7-46a5-b9aa-a5c4bb6ebaf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e34179ecdfe40f28790cae369baa7c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:21:18Z,use_quota=True,user_id='a72e64cf76894f88ad1bf9ac6b78077b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03948448-426a-40fc-bc14-17f6f2b7a934),volume_type_id=03948448-426a-40fc-bc14-17f6f2b7a934)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:21:17 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-1419dfee-7e1d-490a-bd28-41929dfeb875 tempest-VolumeTypesAccessTest-1027214750 None] Creating volume b97c9d07-26b7-46a5-b9aa-a5c4bb6ebaf9 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:21:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1419dfee-7e1d-490a-bd28-41929dfeb875 tempest-VolumeTypesAccessTest-1027214750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:21:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1419dfee-7e1d-490a-bd28-41929dfeb875 tempest-VolumeTypesAccessTest-1027214750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:21:17 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-1419dfee-7e1d-490a-bd28-41929dfeb875 tempest-VolumeTypesAccessTest-1027214750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:21:17 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-1419dfee-7e1d-490a-bd28-41929dfeb875 tempest-VolumeTypesAccessTest-1027214750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:21:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1419dfee-7e1d-490a-bd28-41929dfeb875 tempest-VolumeTypesAccessTest-1027214750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:21:17 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-1419dfee-7e1d-490a-bd28-41929dfeb875 tempest-VolumeTypesAccessTest-1027214750 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:21:17 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-1419dfee-7e1d-490a-bd28-41929dfeb875 tempest-VolumeTypesAccessTest-1027214750 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:21:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1419dfee-7e1d-490a-bd28-41929dfeb875 tempest-VolumeTypesAccessTest-1027214750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b97c9d07-26b7-46a5-b9aa-a5c4bb6ebaf9 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:21:17 devstack sudo[92413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b97c9d07-26b7-46a5-b9aa-a5c4bb6ebaf9 1073741824 Jun 02 03:21:17 devstack sudo[92413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:21:18 devstack sudo[92413]: pam_unix(sudo:session): session closed for user root Jun 02 03:21:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1419dfee-7e1d-490a-bd28-41929dfeb875 tempest-VolumeTypesAccessTest-1027214750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b97c9d07-26b7-46a5-b9aa-a5c4bb6ebaf9 1073741824" returned: 0 in 0.829s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:21:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1419dfee-7e1d-490a-bd28-41929dfeb875 tempest-VolumeTypesAccessTest-1027214750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b97c9d07-26b7-46a5-b9aa-a5c4bb6ebaf9 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:21:18 devstack sudo[92421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b97c9d07-26b7-46a5-b9aa-a5c4bb6ebaf9 Jun 02 03:21:18 devstack sudo[92421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:21:19 devstack sudo[92421]: pam_unix(sudo:session): session closed for user root Jun 02 03:21:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1419dfee-7e1d-490a-bd28-41929dfeb875 tempest-VolumeTypesAccessTest-1027214750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b97c9d07-26b7-46a5-b9aa-a5c4bb6ebaf9" returned: 0 in 0.720s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:21:19 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-1419dfee-7e1d-490a-bd28-41929dfeb875 tempest-VolumeTypesAccessTest-1027214750 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:21:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1419dfee-7e1d-490a-bd28-41929dfeb875 tempest-VolumeTypesAccessTest-1027214750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:21:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1419dfee-7e1d-490a-bd28-41929dfeb875 tempest-VolumeTypesAccessTest-1027214750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c8b920-4856-4902-86d0-df03c83f1093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b97c9d07-26b7-46a5-b9aa-a5c4bb6ebaf9', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:21:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1419dfee-7e1d-490a-bd28-41929dfeb875 tempest-VolumeTypesAccessTest-1027214750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (293777c1-32f8-49d3-bc7d-c79ba0246fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:21:19 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-1419dfee-7e1d-490a-bd28-41929dfeb875 tempest-VolumeTypesAccessTest-1027214750 None] Volume volume-b97c9d07-26b7-46a5-b9aa-a5c4bb6ebaf9 (b97c9d07-26b7-46a5-b9aa-a5c4bb6ebaf9): created successfully Jun 02 03:21:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1419dfee-7e1d-490a-bd28-41929dfeb875 tempest-VolumeTypesAccessTest-1027214750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (293777c1-32f8-49d3-bc7d-c79ba0246fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:21:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1419dfee-7e1d-490a-bd28-41929dfeb875 tempest-VolumeTypesAccessTest-1027214750 None] Flow 'volume_create_manager' (ebdc6b30-0ef7-49a0-925b-23ad13f136d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:21:19 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-1419dfee-7e1d-490a-bd28-41929dfeb875 tempest-VolumeTypesAccessTest-1027214750 None] Created volume successfully. Jun 02 03:21:19 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-55b5da81-196f-4fc5-9f63-e4d80ae42419 tempest-VolumeTypesAccessTest-1027214750 None] Acquiring lock "cinder-b97c9d07-26b7-46a5-b9aa-a5c4bb6ebaf9-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:21:19 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-55b5da81-196f-4fc5-9f63-e4d80ae42419 tempest-VolumeTypesAccessTest-1027214750 None] Lock "cinder-b97c9d07-26b7-46a5-b9aa-a5c4bb6ebaf9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:21:19 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-55b5da81-196f-4fc5-9f63-e4d80ae42419 tempest-VolumeTypesAccessTest-1027214750 None] Acquiring lock "cinder-quobyte-b97c9d07-26b7-46a5-b9aa-a5c4bb6ebaf9" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:21:20 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-55b5da81-196f-4fc5-9f63-e4d80ae42419 tempest-VolumeTypesAccessTest-1027214750 None] Lock "cinder-quobyte-b97c9d07-26b7-46a5-b9aa-a5c4bb6ebaf9" acquired by "delete_volume" :: waited 0.038s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:21:20 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36be71c-cd91-4c20-a6bb-f997fbc7a6da]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:21:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-55b5da81-196f-4fc5-9f63-e4d80ae42419 tempest-VolumeTypesAccessTest-1027214750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b97c9d07-26b7-46a5-b9aa-a5c4bb6ebaf9 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:21:20 devstack sudo[92427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b97c9d07-26b7-46a5-b9aa-a5c4bb6ebaf9 Jun 02 03:21:20 devstack sudo[92427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:21:20 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-70039255-6f3b-4a99-aa0b-c6f80bd42f5c req-e8645261-7d58-4d8d-94e0-55bea0b10ddc tempest-AttachVolumeTestJSON-1448729226 None] Terminate volume connection completed successfully. Jun 02 03:21:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-70039255-6f3b-4a99-aa0b-c6f80bd42f5c req-e8645261-7d58-4d8d-94e0-55bea0b10ddc tempest-AttachVolumeTestJSON-1448729226 None] Deleting attachment 9329c66b-ec44-4b6c-871b-e4c4a59bee66. {{(pid=86431) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 02 03:21:20 devstack sudo[92427]: pam_unix(sudo:session): session closed for user root Jun 02 03:21:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-55b5da81-196f-4fc5-9f63-e4d80ae42419 tempest-VolumeTypesAccessTest-1027214750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b97c9d07-26b7-46a5-b9aa-a5c4bb6ebaf9" returned: 0 in 0.800s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:21:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-55b5da81-196f-4fc5-9f63-e4d80ae42419 tempest-VolumeTypesAccessTest-1027214750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b97c9d07-26b7-46a5-b9aa-a5c4bb6ebaf9 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:21:20 devstack sudo[92455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b97c9d07-26b7-46a5-b9aa-a5c4bb6ebaf9 Jun 02 03:21:20 devstack sudo[92455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:21:21 devstack sudo[92455]: pam_unix(sudo:session): session closed for user root Jun 02 03:21:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-55b5da81-196f-4fc5-9f63-e4d80ae42419 tempest-VolumeTypesAccessTest-1027214750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b97c9d07-26b7-46a5-b9aa-a5c4bb6ebaf9" returned: 0 in 0.726s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:21:21 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-55b5da81-196f-4fc5-9f63-e4d80ae42419 tempest-VolumeTypesAccessTest-1027214750 None] Lock "cinder-quobyte-b97c9d07-26b7-46a5-b9aa-a5c4bb6ebaf9" released by "delete_volume" :: held 1.603s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:21:21 devstack cinder-volume[86431]: WARNING cinder.quota [None req-55b5da81-196f-4fc5-9f63-e4d80ae42419 tempest-VolumeTypesAccessTest-1027214750 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-574385782 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-574385782, it is now deprecated. Please use the default quota class for default quota. Jun 02 03:21:21 devstack cinder-volume[86431]: WARNING cinder.quota [None req-55b5da81-196f-4fc5-9f63-e4d80ae42419 tempest-VolumeTypesAccessTest-1027214750 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-574385782 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-574385782, it is now deprecated. Please use the default quota class for default quota. Jun 02 03:21:21 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-55b5da81-196f-4fc5-9f63-e4d80ae42419 tempest-VolumeTypesAccessTest-1027214750 None] Created reservations ['d8598b89-5404-4974-bf2d-051a954424db', '23ebb97d-4636-40d5-b369-e925c519b948', '3c04720a-3846-4350-8fe6-a6151356e37d', 'a8847411-1667-4815-ade9-b28340d9d307'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:21:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-55b5da81-196f-4fc5-9f63-e4d80ae42419 tempest-VolumeTypesAccessTest-1027214750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:21:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-55b5da81-196f-4fc5-9f63-e4d80ae42419 tempest-VolumeTypesAccessTest-1027214750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:21:21 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-55b5da81-196f-4fc5-9f63-e4d80ae42419 tempest-VolumeTypesAccessTest-1027214750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:21:21 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-55b5da81-196f-4fc5-9f63-e4d80ae42419 tempest-VolumeTypesAccessTest-1027214750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:21:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-55b5da81-196f-4fc5-9f63-e4d80ae42419 tempest-VolumeTypesAccessTest-1027214750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:21:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-55b5da81-196f-4fc5-9f63-e4d80ae42419 tempest-VolumeTypesAccessTest-1027214750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:21:21 devstack sudo[92468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:21:21 devstack sudo[92468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:21:22 devstack sudo[92468]: pam_unix(sudo:session): session closed for user root Jun 02 03:21:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-55b5da81-196f-4fc5-9f63-e4d80ae42419 tempest-VolumeTypesAccessTest-1027214750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.858s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:21:22 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-55b5da81-196f-4fc5-9f63-e4d80ae42419 tempest-VolumeTypesAccessTest-1027214750 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:21:22 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-55b5da81-196f-4fc5-9f63-e4d80ae42419 tempest-VolumeTypesAccessTest-1027214750 None] Deleted volume successfully. Jun 02 03:21:22 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-55b5da81-196f-4fc5-9f63-e4d80ae42419 tempest-VolumeTypesAccessTest-1027214750 None] Lock "cinder-b97c9d07-26b7-46a5-b9aa-a5c4bb6ebaf9-delete_volume" released by "delete_volume" :: held 2.770s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:21:23 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-cf59194e-780e-49d4-be9b-98b4444ad99f req-c80a2922-3405-4766-a549-d1c9636d6432 tempest-AttachVolumeTestJSON-1448729226 None] Terminate volume connection completed successfully. Jun 02 03:21:23 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-cf59194e-780e-49d4-be9b-98b4444ad99f req-c80a2922-3405-4766-a549-d1c9636d6432 tempest-AttachVolumeTestJSON-1448729226 None] Deleting attachment 4dc63201-8d35-457e-8ddb-65a0486dab51. {{(pid=86431) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 02 03:21:33 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=49,cinder:UPDATE=40,cinder:DELETE=3,cinder:INSERT=6 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:21:33 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=45,cinder:UPDATE=41,cinder:INSERT=7,cinder:DELETE=4 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:21:37 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2ff855b3-a201-42e1-a7c5-67599b5c3062 tempest-AttachVolumeTestJSON-1448729226 None] Acquiring lock "cinder-232dfef2-9dc3-4005-8529-426f93f02a92-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:21:37 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2ff855b3-a201-42e1-a7c5-67599b5c3062 tempest-AttachVolumeTestJSON-1448729226 None] Lock "cinder-232dfef2-9dc3-4005-8529-426f93f02a92-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:21:37 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2ff855b3-a201-42e1-a7c5-67599b5c3062 tempest-AttachVolumeTestJSON-1448729226 None] Acquiring lock "cinder-quobyte-232dfef2-9dc3-4005-8529-426f93f02a92" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:21:37 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2ff855b3-a201-42e1-a7c5-67599b5c3062 tempest-AttachVolumeTestJSON-1448729226 None] Lock "cinder-quobyte-232dfef2-9dc3-4005-8529-426f93f02a92" acquired by "delete_volume" :: waited 0.024s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:21:37 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8a0544-44dd-469e-833e-e5f5e103bf79]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:21:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2ff855b3-a201-42e1-a7c5-67599b5c3062 tempest-AttachVolumeTestJSON-1448729226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-232dfef2-9dc3-4005-8529-426f93f02a92 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:21:37 devstack sudo[93098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-232dfef2-9dc3-4005-8529-426f93f02a92 Jun 02 03:21:37 devstack sudo[93098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:21:38 devstack sudo[93098]: pam_unix(sudo:session): session closed for user root Jun 02 03:21:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2ff855b3-a201-42e1-a7c5-67599b5c3062 tempest-AttachVolumeTestJSON-1448729226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-232dfef2-9dc3-4005-8529-426f93f02a92" returned: 0 in 0.916s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:21:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2ff855b3-a201-42e1-a7c5-67599b5c3062 tempest-AttachVolumeTestJSON-1448729226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-232dfef2-9dc3-4005-8529-426f93f02a92 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:21:38 devstack sudo[93103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-232dfef2-9dc3-4005-8529-426f93f02a92 Jun 02 03:21:38 devstack sudo[93103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:21:39 devstack sudo[93103]: pam_unix(sudo:session): session closed for user root Jun 02 03:21:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2ff855b3-a201-42e1-a7c5-67599b5c3062 tempest-AttachVolumeTestJSON-1448729226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-232dfef2-9dc3-4005-8529-426f93f02a92" returned: 0 in 0.777s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:21:39 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2ff855b3-a201-42e1-a7c5-67599b5c3062 tempest-AttachVolumeTestJSON-1448729226 None] Lock "cinder-quobyte-232dfef2-9dc3-4005-8529-426f93f02a92" released by "delete_volume" :: held 1.773s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:21:39 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-2ff855b3-a201-42e1-a7c5-67599b5c3062 tempest-AttachVolumeTestJSON-1448729226 None] Created reservations ['89d25828-e57c-462d-a8d0-051262bb813f', '437ba50f-3d48-407d-a6b0-4986ec8c9055', 'c6f7a129-112d-4343-9d9b-9f44c66ae4d0', '7c67b80f-cde4-45f6-8941-ea3f1bdac94c'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:21:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2ff855b3-a201-42e1-a7c5-67599b5c3062 tempest-AttachVolumeTestJSON-1448729226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:21:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2ff855b3-a201-42e1-a7c5-67599b5c3062 tempest-AttachVolumeTestJSON-1448729226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:21:39 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-2ff855b3-a201-42e1-a7c5-67599b5c3062 tempest-AttachVolumeTestJSON-1448729226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:21:39 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-2ff855b3-a201-42e1-a7c5-67599b5c3062 tempest-AttachVolumeTestJSON-1448729226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:21:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2ff855b3-a201-42e1-a7c5-67599b5c3062 tempest-AttachVolumeTestJSON-1448729226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:21:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2ff855b3-a201-42e1-a7c5-67599b5c3062 tempest-AttachVolumeTestJSON-1448729226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:21:39 devstack sudo[93106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:21:39 devstack sudo[93106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:21:39 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ae910f8d-b5de-40a1-88ad-ad5d9eb8bbff tempest-AttachVolumeTestJSON-1448729226 None] Acquiring lock "cinder-f774ca46-739c-400f-8b1b-8df9996b37a7-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:21:39 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ae910f8d-b5de-40a1-88ad-ad5d9eb8bbff tempest-AttachVolumeTestJSON-1448729226 None] Lock "cinder-f774ca46-739c-400f-8b1b-8df9996b37a7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:21:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ae910f8d-b5de-40a1-88ad-ad5d9eb8bbff tempest-AttachVolumeTestJSON-1448729226 None] Acquiring lock "cinder-quobyte-f774ca46-739c-400f-8b1b-8df9996b37a7" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:21:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ae910f8d-b5de-40a1-88ad-ad5d9eb8bbff tempest-AttachVolumeTestJSON-1448729226 None] Lock "cinder-quobyte-f774ca46-739c-400f-8b1b-8df9996b37a7" acquired by "delete_volume" :: waited 0.036s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:21:40 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[96424b69-c422-4fc8-8d36-7c3db0d582ef]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:21:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ae910f8d-b5de-40a1-88ad-ad5d9eb8bbff tempest-AttachVolumeTestJSON-1448729226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f774ca46-739c-400f-8b1b-8df9996b37a7 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:21:40 devstack sudo[93108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f774ca46-739c-400f-8b1b-8df9996b37a7 Jun 02 03:21:40 devstack sudo[93108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:21:40 devstack sudo[93106]: pam_unix(sudo:session): session closed for user root Jun 02 03:21:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2ff855b3-a201-42e1-a7c5-67599b5c3062 tempest-AttachVolumeTestJSON-1448729226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 1.241s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:21:40 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-2ff855b3-a201-42e1-a7c5-67599b5c3062 tempest-AttachVolumeTestJSON-1448729226 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:21:40 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-2ff855b3-a201-42e1-a7c5-67599b5c3062 tempest-AttachVolumeTestJSON-1448729226 None] Deleted volume successfully. Jun 02 03:21:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2ff855b3-a201-42e1-a7c5-67599b5c3062 tempest-AttachVolumeTestJSON-1448729226 None] Lock "cinder-232dfef2-9dc3-4005-8529-426f93f02a92-delete_volume" released by "delete_volume" :: held 3.356s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:21:41 devstack sudo[93108]: pam_unix(sudo:session): session closed for user root Jun 02 03:21:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ae910f8d-b5de-40a1-88ad-ad5d9eb8bbff tempest-AttachVolumeTestJSON-1448729226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f774ca46-739c-400f-8b1b-8df9996b37a7" returned: 0 in 1.273s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:21:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ae910f8d-b5de-40a1-88ad-ad5d9eb8bbff tempest-AttachVolumeTestJSON-1448729226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f774ca46-739c-400f-8b1b-8df9996b37a7 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:21:41 devstack sudo[93114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f774ca46-739c-400f-8b1b-8df9996b37a7 Jun 02 03:21:41 devstack sudo[93114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:21:42 devstack sudo[93114]: pam_unix(sudo:session): session closed for user root Jun 02 03:21:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ae910f8d-b5de-40a1-88ad-ad5d9eb8bbff tempest-AttachVolumeTestJSON-1448729226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f774ca46-739c-400f-8b1b-8df9996b37a7" returned: 0 in 1.048s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:21:42 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ae910f8d-b5de-40a1-88ad-ad5d9eb8bbff tempest-AttachVolumeTestJSON-1448729226 None] Lock "cinder-quobyte-f774ca46-739c-400f-8b1b-8df9996b37a7" released by "delete_volume" :: held 2.394s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:21:42 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-ae910f8d-b5de-40a1-88ad-ad5d9eb8bbff tempest-AttachVolumeTestJSON-1448729226 None] Created reservations ['a2dad68e-eebf-41bc-81f9-62fe3608a2a6', 'faf4535a-e69b-4fe5-8937-564ef7b7af59', '3ebd61b5-8961-4d51-8ebc-dd6b0422cf50', 'e288e82c-5b3a-4133-b896-752b4576c580'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:21:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ae910f8d-b5de-40a1-88ad-ad5d9eb8bbff tempest-AttachVolumeTestJSON-1448729226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:21:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ae910f8d-b5de-40a1-88ad-ad5d9eb8bbff tempest-AttachVolumeTestJSON-1448729226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:21:42 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ae910f8d-b5de-40a1-88ad-ad5d9eb8bbff tempest-AttachVolumeTestJSON-1448729226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:21:42 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ae910f8d-b5de-40a1-88ad-ad5d9eb8bbff tempest-AttachVolumeTestJSON-1448729226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:21:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ae910f8d-b5de-40a1-88ad-ad5d9eb8bbff tempest-AttachVolumeTestJSON-1448729226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:21:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ae910f8d-b5de-40a1-88ad-ad5d9eb8bbff tempest-AttachVolumeTestJSON-1448729226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:21:42 devstack sudo[93118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:21:42 devstack sudo[93118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:21:43 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7a0bfde3-72a2-41a2-bf96-da9f01d7fae8 tempest-AttachVolumeTestJSON-1448729226 None] Acquiring lock "cinder-8eb30b29-e4be-4f59-aac3-86c634efa0eb-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:21:43 devstack sudo[93118]: pam_unix(sudo:session): session closed for user root Jun 02 03:21:43 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7a0bfde3-72a2-41a2-bf96-da9f01d7fae8 tempest-AttachVolumeTestJSON-1448729226 None] Lock "cinder-8eb30b29-e4be-4f59-aac3-86c634efa0eb-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:21:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ae910f8d-b5de-40a1-88ad-ad5d9eb8bbff tempest-AttachVolumeTestJSON-1448729226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.931s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:21:43 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-ae910f8d-b5de-40a1-88ad-ad5d9eb8bbff tempest-AttachVolumeTestJSON-1448729226 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:21:43 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-ae910f8d-b5de-40a1-88ad-ad5d9eb8bbff tempest-AttachVolumeTestJSON-1448729226 None] Deleted volume successfully. Jun 02 03:21:43 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ae910f8d-b5de-40a1-88ad-ad5d9eb8bbff tempest-AttachVolumeTestJSON-1448729226 None] Lock "cinder-f774ca46-739c-400f-8b1b-8df9996b37a7-delete_volume" released by "delete_volume" :: held 3.673s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:21:43 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7a0bfde3-72a2-41a2-bf96-da9f01d7fae8 tempest-AttachVolumeTestJSON-1448729226 None] Acquiring lock "cinder-quobyte-8eb30b29-e4be-4f59-aac3-86c634efa0eb" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:21:43 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7a0bfde3-72a2-41a2-bf96-da9f01d7fae8 tempest-AttachVolumeTestJSON-1448729226 None] Lock "cinder-quobyte-8eb30b29-e4be-4f59-aac3-86c634efa0eb" acquired by "delete_volume" :: waited 0.040s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:21:43 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bc9fac-1739-46ad-8126-e86adf2b8f0c]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:21:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7a0bfde3-72a2-41a2-bf96-da9f01d7fae8 tempest-AttachVolumeTestJSON-1448729226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8eb30b29-e4be-4f59-aac3-86c634efa0eb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:21:43 devstack sudo[93127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8eb30b29-e4be-4f59-aac3-86c634efa0eb Jun 02 03:21:43 devstack sudo[93127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:21:44 devstack sudo[93127]: pam_unix(sudo:session): session closed for user root Jun 02 03:21:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7a0bfde3-72a2-41a2-bf96-da9f01d7fae8 tempest-AttachVolumeTestJSON-1448729226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8eb30b29-e4be-4f59-aac3-86c634efa0eb" returned: 0 in 0.914s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:21:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7a0bfde3-72a2-41a2-bf96-da9f01d7fae8 tempest-AttachVolumeTestJSON-1448729226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8eb30b29-e4be-4f59-aac3-86c634efa0eb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:21:44 devstack sudo[93134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8eb30b29-e4be-4f59-aac3-86c634efa0eb Jun 02 03:21:44 devstack sudo[93134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:21:45 devstack sudo[93134]: pam_unix(sudo:session): session closed for user root Jun 02 03:21:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7a0bfde3-72a2-41a2-bf96-da9f01d7fae8 tempest-AttachVolumeTestJSON-1448729226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8eb30b29-e4be-4f59-aac3-86c634efa0eb" returned: 0 in 0.673s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:21:45 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7a0bfde3-72a2-41a2-bf96-da9f01d7fae8 tempest-AttachVolumeTestJSON-1448729226 None] Lock "cinder-quobyte-8eb30b29-e4be-4f59-aac3-86c634efa0eb" released by "delete_volume" :: held 1.634s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:21:45 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-7a0bfde3-72a2-41a2-bf96-da9f01d7fae8 tempest-AttachVolumeTestJSON-1448729226 None] Created reservations ['0ba2fc34-2f9f-4a88-8872-86904b19d41c', 'b873f1ee-e2a9-432a-9f81-f15fb198eba9', 'c1e20b9b-c324-421d-b8af-7ec107e7b837', '00a60f70-c654-4615-afc3-220b20de01be'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:21:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7a0bfde3-72a2-41a2-bf96-da9f01d7fae8 tempest-AttachVolumeTestJSON-1448729226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:21:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7a0bfde3-72a2-41a2-bf96-da9f01d7fae8 tempest-AttachVolumeTestJSON-1448729226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:21:45 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-7a0bfde3-72a2-41a2-bf96-da9f01d7fae8 tempest-AttachVolumeTestJSON-1448729226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:21:45 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-7a0bfde3-72a2-41a2-bf96-da9f01d7fae8 tempest-AttachVolumeTestJSON-1448729226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:21:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7a0bfde3-72a2-41a2-bf96-da9f01d7fae8 tempest-AttachVolumeTestJSON-1448729226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:21:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7a0bfde3-72a2-41a2-bf96-da9f01d7fae8 tempest-AttachVolumeTestJSON-1448729226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:21:45 devstack sudo[93161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:21:45 devstack sudo[93161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:21:46 devstack sudo[93161]: pam_unix(sudo:session): session closed for user root Jun 02 03:21:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7a0bfde3-72a2-41a2-bf96-da9f01d7fae8 tempest-AttachVolumeTestJSON-1448729226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.695s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:21:46 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-7a0bfde3-72a2-41a2-bf96-da9f01d7fae8 tempest-AttachVolumeTestJSON-1448729226 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:21:46 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-7a0bfde3-72a2-41a2-bf96-da9f01d7fae8 tempest-AttachVolumeTestJSON-1448729226 None] Deleted volume successfully. Jun 02 03:21:46 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7a0bfde3-72a2-41a2-bf96-da9f01d7fae8 tempest-AttachVolumeTestJSON-1448729226 None] Lock "cinder-8eb30b29-e4be-4f59-aac3-86c634efa0eb-delete_volume" released by "delete_volume" :: held 2.627s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:21:53 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-ffc29b68-7d3e-4b9c-9ebb-ba9a9c6f954f req-d8b13b72-654c-44c8-8ccd-e2824e3dd998 tempest-AttachVolumeShelveTestJSON-808950028 None] Terminate volume connection completed successfully. Jun 02 03:21:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-ffc29b68-7d3e-4b9c-9ebb-ba9a9c6f954f req-d8b13b72-654c-44c8-8ccd-e2824e3dd998 tempest-AttachVolumeShelveTestJSON-808950028 None] Deleting attachment d3fa2eba-42ce-4852-beca-0621637ae51d. {{(pid=86431) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 02 03:21:54 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-74091429-0c2e-48be-af4c-112eafef055a tempest-BackendsCapabilitiesAdminTestsJSON-34940791 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579956054688, 'free_capacity_gb': 1775.7579956054688, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86431) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4831}} Jun 02 03:21:54 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-21a229d5-a716-4384-ae8c-02b76914754c tempest-BackendsCapabilitiesAdminTestsJSON-34940791 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579956054688, 'free_capacity_gb': 1775.7579956054688, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86431) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4831}} Jun 02 03:21:56 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6c98757-1d4f-4f30-a872-3275e3bda0bd tempest-AttachVolumeNegativeTest-1165991087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:21:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e6c98757-1d4f-4f30-a872-3275e3bda0bd tempest-AttachVolumeNegativeTest-1165991087 None] Flow 'volume_create_manager' (540af301-91e7-4bf4-86b5-f05fa52b4775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:21:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e6c98757-1d4f-4f30-a872-3275e3bda0bd tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7fac9e6-d4a4-4f1a-81f2-423555d274f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:21:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e6c98757-1d4f-4f30-a872-3275e3bda0bd tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7fac9e6-d4a4-4f1a-81f2-423555d274f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-628009101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d68953c0-006f-4ed1-be97-5343f0c3d53e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b41b7af4a304478994e2e229f097aac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:21:57Z,use_quota=True,user_id='1bd56ed743484b4389ae541fd4268448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:21:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e6c98757-1d4f-4f30-a872-3275e3bda0bd tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0d7f7c8-acdd-4c53-8908-a46d81d34609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:21:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e6c98757-1d4f-4f30-a872-3275e3bda0bd tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0d7f7c8-acdd-4c53-8908-a46d81d34609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:21:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e6c98757-1d4f-4f30-a872-3275e3bda0bd tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (544b69c8-c7b1-4f88-9410-18e3c5777c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:21:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e6c98757-1d4f-4f30-a872-3275e3bda0bd tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (544b69c8-c7b1-4f88-9410-18e3c5777c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd68953c0-006f-4ed1-be97-5343f0c3d53e', 'volume_name': 'volume-d68953c0-006f-4ed1-be97-5343f0c3d53e', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:21:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e6c98757-1d4f-4f30-a872-3275e3bda0bd tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aadc3d2d-8896-4891-9390-c47e80da3029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:21:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e6c98757-1d4f-4f30-a872-3275e3bda0bd tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aadc3d2d-8896-4891-9390-c47e80da3029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:21:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e6c98757-1d4f-4f30-a872-3275e3bda0bd tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab376877-1b6b-4241-ba91-739883b1426c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:21:56 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-e6c98757-1d4f-4f30-a872-3275e3bda0bd tempest-AttachVolumeNegativeTest-1165991087 None] Volume d68953c0-006f-4ed1-be97-5343f0c3d53e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d68953c0-006f-4ed1-be97-5343f0c3d53e', 'volume_size': 1} Jun 02 03:21:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e6c98757-1d4f-4f30-a872-3275e3bda0bd tempest-AttachVolumeNegativeTest-1165991087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:21:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e6c98757-1d4f-4f30-a872-3275e3bda0bd tempest-AttachVolumeNegativeTest-1165991087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:21:56 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e6c98757-1d4f-4f30-a872-3275e3bda0bd tempest-AttachVolumeNegativeTest-1165991087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-628009101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d68953c0-006f-4ed1-be97-5343f0c3d53e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b41b7af4a304478994e2e229f097aac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:21:57Z,use_quota=True,user_id='1bd56ed743484b4389ae541fd4268448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:21:56 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-e6c98757-1d4f-4f30-a872-3275e3bda0bd tempest-AttachVolumeNegativeTest-1165991087 None] Creating volume d68953c0-006f-4ed1-be97-5343f0c3d53e {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:21:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e6c98757-1d4f-4f30-a872-3275e3bda0bd tempest-AttachVolumeNegativeTest-1165991087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:21:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e6c98757-1d4f-4f30-a872-3275e3bda0bd tempest-AttachVolumeNegativeTest-1165991087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:21:56 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e6c98757-1d4f-4f30-a872-3275e3bda0bd tempest-AttachVolumeNegativeTest-1165991087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:21:56 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e6c98757-1d4f-4f30-a872-3275e3bda0bd tempest-AttachVolumeNegativeTest-1165991087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:21:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e6c98757-1d4f-4f30-a872-3275e3bda0bd tempest-AttachVolumeNegativeTest-1165991087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:21:56 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e6c98757-1d4f-4f30-a872-3275e3bda0bd tempest-AttachVolumeNegativeTest-1165991087 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:21:56 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-e6c98757-1d4f-4f30-a872-3275e3bda0bd tempest-AttachVolumeNegativeTest-1165991087 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:21:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e6c98757-1d4f-4f30-a872-3275e3bda0bd tempest-AttachVolumeNegativeTest-1165991087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d68953c0-006f-4ed1-be97-5343f0c3d53e 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:21:56 devstack sudo[93210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d68953c0-006f-4ed1-be97-5343f0c3d53e 1073741824 Jun 02 03:21:56 devstack sudo[93210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:21:58 devstack sudo[93210]: pam_unix(sudo:session): session closed for user root Jun 02 03:21:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e6c98757-1d4f-4f30-a872-3275e3bda0bd tempest-AttachVolumeNegativeTest-1165991087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d68953c0-006f-4ed1-be97-5343f0c3d53e 1073741824" returned: 0 in 1.194s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:21:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e6c98757-1d4f-4f30-a872-3275e3bda0bd tempest-AttachVolumeNegativeTest-1165991087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d68953c0-006f-4ed1-be97-5343f0c3d53e {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:21:58 devstack sudo[93287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d68953c0-006f-4ed1-be97-5343f0c3d53e Jun 02 03:21:58 devstack sudo[93287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:21:58 devstack sudo[93287]: pam_unix(sudo:session): session closed for user root Jun 02 03:21:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e6c98757-1d4f-4f30-a872-3275e3bda0bd tempest-AttachVolumeNegativeTest-1165991087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d68953c0-006f-4ed1-be97-5343f0c3d53e" returned: 0 in 0.723s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:21:58 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e6c98757-1d4f-4f30-a872-3275e3bda0bd tempest-AttachVolumeNegativeTest-1165991087 None] <== create_volume: return (2020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:21:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e6c98757-1d4f-4f30-a872-3275e3bda0bd tempest-AttachVolumeNegativeTest-1165991087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.031s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:21:58 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e6c98757-1d4f-4f30-a872-3275e3bda0bd tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab376877-1b6b-4241-ba91-739883b1426c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d68953c0-006f-4ed1-be97-5343f0c3d53e', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:21:58 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e6c98757-1d4f-4f30-a872-3275e3bda0bd tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff5875a-2a37-456d-b0a2-66f9a9101863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:21:58 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-e6c98757-1d4f-4f30-a872-3275e3bda0bd tempest-AttachVolumeNegativeTest-1165991087 None] Volume volume-d68953c0-006f-4ed1-be97-5343f0c3d53e (d68953c0-006f-4ed1-be97-5343f0c3d53e): created successfully Jun 02 03:21:58 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e6c98757-1d4f-4f30-a872-3275e3bda0bd tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff5875a-2a37-456d-b0a2-66f9a9101863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:21:58 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e6c98757-1d4f-4f30-a872-3275e3bda0bd tempest-AttachVolumeNegativeTest-1165991087 None] Flow 'volume_create_manager' (540af301-91e7-4bf4-86b5-f05fa52b4775) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:21:58 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-e6c98757-1d4f-4f30-a872-3275e3bda0bd tempest-AttachVolumeNegativeTest-1165991087 None] Created volume successfully. Jun 02 03:22:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-76c99464-e296-4f43-a817-e2e3535837e2 req-e9b68c42-aadf-42fb-bfd9-b239ad66857e tempest-AttachVolumeNegativeTest-1165991087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:22:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-76c99464-e296-4f43-a817-e2e3535837e2 req-e9b68c42-aadf-42fb-bfd9-b239ad66857e tempest-AttachVolumeNegativeTest-1165991087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:22:03 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b90638-635d-4664-9376-4a25fadc2d2d]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:22:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-76c99464-e296-4f43-a817-e2e3535837e2 req-e9b68c42-aadf-42fb-bfd9-b239ad66857e tempest-AttachVolumeNegativeTest-1165991087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d68953c0-006f-4ed1-be97-5343f0c3d53e {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:03 devstack sudo[93320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d68953c0-006f-4ed1-be97-5343f0c3d53e Jun 02 03:22:03 devstack sudo[93320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:04 devstack sudo[93320]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-76c99464-e296-4f43-a817-e2e3535837e2 req-e9b68c42-aadf-42fb-bfd9-b239ad66857e tempest-AttachVolumeNegativeTest-1165991087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d68953c0-006f-4ed1-be97-5343f0c3d53e" returned: 0 in 0.877s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-76c99464-e296-4f43-a817-e2e3535837e2 req-e9b68c42-aadf-42fb-bfd9-b239ad66857e tempest-AttachVolumeNegativeTest-1165991087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.909s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:22:04 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-e1339c65-ff3f-4101-b25b-039a55e5c765 tempest-GroupSnapshotsTest-408043841 None] Group tempest-GroupSnapshotsTest-Group-1938768185: creating Jun 02 03:22:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-76c99464-e296-4f43-a817-e2e3535837e2 req-e9b68c42-aadf-42fb-bfd9-b239ad66857e tempest-AttachVolumeNegativeTest-1165991087 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1', 'name': 'volume-d68953c0-006f-4ed1-be97-5343f0c3d53e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b25dc528-08cf-4cba-8447-09013795c57c', 'enforce_multipath': True} {{(pid=86431) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 02 03:22:04 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-e1339c65-ff3f-4101-b25b-039a55e5c765 tempest-GroupSnapshotsTest-408043841 None] Group tempest-GroupSnapshotsTest-Group-1938768185: created successfully Jun 02 03:22:04 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-e1339c65-ff3f-4101-b25b-039a55e5c765 tempest-GroupSnapshotsTest-408043841 None] Create group completed successfully. Jun 02 03:22:04 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-76c99464-e296-4f43-a817-e2e3535837e2 req-e9b68c42-aadf-42fb-bfd9-b239ad66857e tempest-AttachVolumeNegativeTest-1165991087 None] attachment_update completed successfully. Jun 02 03:22:06 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ade32f9-b067-4fe5-827a-f60556f8b551 tempest-GroupSnapshotsTest-408043841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:22:06 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9ade32f9-b067-4fe5-827a-f60556f8b551 tempest-GroupSnapshotsTest-408043841 None] Flow 'volume_create_manager' (e0bf67e9-3b0d-4b48-9248-6de516bcf119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:22:06 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9ade32f9-b067-4fe5-827a-f60556f8b551 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c15b48a-9ab8-4aa4-8a3f-2698ce0a3add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:06 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9ade32f9-b067-4fe5-827a-f60556f8b551 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c15b48a-9ab8-4aa4-8a3f-2698ce0a3add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-119124451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f5b6477c-5469-4310-981a-56d600ffcffe,host='devstack@QuobyteHD#QuobyteHD',id=431e539d-2c0d-4d06-ba93-63beedb0328a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050054a4bf054b39996d9b0f83376446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:22:06Z,use_quota=True,user_id='394e6c3efc954d1b86b030d05e8c2e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2fea5016-3139-4687-a0e4-81e736e1d68a),volume_type_id=2fea5016-3139-4687-a0e4-81e736e1d68a)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:06 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9ade32f9-b067-4fe5-827a-f60556f8b551 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b1cc4b6-e97d-47f1-bc11-27fa10a56339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:06 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9ade32f9-b067-4fe5-827a-f60556f8b551 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b1cc4b6-e97d-47f1-bc11-27fa10a56339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:06 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9ade32f9-b067-4fe5-827a-f60556f8b551 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5017e1d4-69f7-44c6-9003-15f053e854b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:06 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9ade32f9-b067-4fe5-827a-f60556f8b551 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5017e1d4-69f7-44c6-9003-15f053e854b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '431e539d-2c0d-4d06-ba93-63beedb0328a', 'volume_name': 'volume-431e539d-2c0d-4d06-ba93-63beedb0328a', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:06 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9ade32f9-b067-4fe5-827a-f60556f8b551 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef79f0b8-c50d-41c1-86b8-5d4b64c29a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:06 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9ade32f9-b067-4fe5-827a-f60556f8b551 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef79f0b8-c50d-41c1-86b8-5d4b64c29a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:06 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9ade32f9-b067-4fe5-827a-f60556f8b551 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055e07b0-c041-4160-9a5b-403863469500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:06 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-9ade32f9-b067-4fe5-827a-f60556f8b551 tempest-GroupSnapshotsTest-408043841 None] Volume 431e539d-2c0d-4d06-ba93-63beedb0328a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-431e539d-2c0d-4d06-ba93-63beedb0328a', 'volume_size': 1} Jun 02 03:22:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9ade32f9-b067-4fe5-827a-f60556f8b551 tempest-GroupSnapshotsTest-408043841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:22:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9ade32f9-b067-4fe5-827a-f60556f8b551 tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:22:06 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9ade32f9-b067-4fe5-827a-f60556f8b551 tempest-GroupSnapshotsTest-408043841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f5b6477c-5469-4310-981a-56d600ffcffe,created_at=2026-06-02T01:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-119124451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f5b6477c-5469-4310-981a-56d600ffcffe,host='devstack@QuobyteHD#QuobyteHD',id=431e539d-2c0d-4d06-ba93-63beedb0328a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050054a4bf054b39996d9b0f83376446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:22:06Z,use_quota=True,user_id='394e6c3efc954d1b86b030d05e8c2e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2fea5016-3139-4687-a0e4-81e736e1d68a),volume_type_id=2fea5016-3139-4687-a0e4-81e736e1d68a)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:22:06 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-9ade32f9-b067-4fe5-827a-f60556f8b551 tempest-GroupSnapshotsTest-408043841 None] Creating volume 431e539d-2c0d-4d06-ba93-63beedb0328a {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:22:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9ade32f9-b067-4fe5-827a-f60556f8b551 tempest-GroupSnapshotsTest-408043841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:22:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9ade32f9-b067-4fe5-827a-f60556f8b551 tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:22:06 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9ade32f9-b067-4fe5-827a-f60556f8b551 tempest-GroupSnapshotsTest-408043841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:22:06 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9ade32f9-b067-4fe5-827a-f60556f8b551 tempest-GroupSnapshotsTest-408043841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:22:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9ade32f9-b067-4fe5-827a-f60556f8b551 tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:22:06 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9ade32f9-b067-4fe5-827a-f60556f8b551 tempest-GroupSnapshotsTest-408043841 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:22:06 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-9ade32f9-b067-4fe5-827a-f60556f8b551 tempest-GroupSnapshotsTest-408043841 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:22:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9ade32f9-b067-4fe5-827a-f60556f8b551 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:06 devstack sudo[93707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a 1073741824 Jun 02 03:22:06 devstack sudo[93707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:07 devstack sudo[93707]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9ade32f9-b067-4fe5-827a-f60556f8b551 tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a 1073741824" returned: 0 in 0.977s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9ade32f9-b067-4fe5-827a-f60556f8b551 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:07 devstack sudo[93713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a Jun 02 03:22:07 devstack sudo[93713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:08 devstack sudo[93713]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9ade32f9-b067-4fe5-827a-f60556f8b551 tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a" returned: 0 in 0.766s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:08 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9ade32f9-b067-4fe5-827a-f60556f8b551 tempest-GroupSnapshotsTest-408043841 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:22:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9ade32f9-b067-4fe5-827a-f60556f8b551 tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:22:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9ade32f9-b067-4fe5-827a-f60556f8b551 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055e07b0-c041-4160-9a5b-403863469500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-431e539d-2c0d-4d06-ba93-63beedb0328a', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9ade32f9-b067-4fe5-827a-f60556f8b551 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a3c3249-443a-4e50-9e81-a26b2e89f9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:08 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-9ade32f9-b067-4fe5-827a-f60556f8b551 tempest-GroupSnapshotsTest-408043841 None] Volume volume-431e539d-2c0d-4d06-ba93-63beedb0328a (431e539d-2c0d-4d06-ba93-63beedb0328a): created successfully Jun 02 03:22:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9ade32f9-b067-4fe5-827a-f60556f8b551 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a3c3249-443a-4e50-9e81-a26b2e89f9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9ade32f9-b067-4fe5-827a-f60556f8b551 tempest-GroupSnapshotsTest-408043841 None] Flow 'volume_create_manager' (e0bf67e9-3b0d-4b48-9248-6de516bcf119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:22:08 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-9ade32f9-b067-4fe5-827a-f60556f8b551 tempest-GroupSnapshotsTest-408043841 None] Created volume successfully. Jun 02 03:22:08 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-d56a6844-f1ea-41ea-afc0-d73d4397f175 tempest-GroupSnapshotsTest-408043841 None] GroupSnapshot 7343a228-d055-4a41-aef9-66c8a6980183: creating. Jun 02 03:22:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d56a6844-f1ea-41ea-afc0-d73d4397f175 tempest-GroupSnapshotsTest-408043841 None] Group snapshot 7343a228-d055-4a41-aef9-66c8a6980183: creating. {{(pid=86431) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Jun 02 03:22:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d56a6844-f1ea-41ea-afc0-d73d4397f175 tempest-GroupSnapshotsTest-408043841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:22:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d56a6844-f1ea-41ea-afc0-d73d4397f175 tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:22:08 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-d56a6844-f1ea-41ea-afc0-d73d4397f175 tempest-GroupSnapshotsTest-408043841 None] Creating offline snapshot 63605ad7-44f8-440e-9b47-2c098d722271 of volume 431e539d-2c0d-4d06-ba93-63beedb0328a {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:22:08 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[892945e6-5c33-4766-8e63-c2762aa2648a]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:22:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d56a6844-f1ea-41ea-afc0-d73d4397f175 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:09 devstack sudo[93716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a Jun 02 03:22:09 devstack sudo[93716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:09 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:22:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:22:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:22:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:22:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:22:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:22:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:09 devstack sudo[93718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:22:09 devstack sudo[93718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:09 devstack sudo[93716]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d56a6844-f1ea-41ea-afc0-d73d4397f175 tempest-GroupSnapshotsTest-408043841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a" returned: 0 in 1.101s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d56a6844-f1ea-41ea-afc0-d73d4397f175 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a.63605ad7-44f8-440e-9b47-2c098d722271 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:10 devstack sudo[93724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a.63605ad7-44f8-440e-9b47-2c098d722271 1G Jun 02 03:22:10 devstack sudo[93724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:10 devstack sudo[93718]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.887s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:10 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:22:10 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager._thread_info {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:22:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread count: 8 {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 02 03:22:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread info: [<_MainThread(MainThread, started 138618128814208)>, , , , , , , ] {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 02 03:22:11 devstack sudo[93724]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d56a6844-f1ea-41ea-afc0-d73d4397f175 tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a.63605ad7-44f8-440e-9b47-2c098d722271 1G" returned: 0 in 1.002s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d56a6844-f1ea-41ea-afc0-d73d4397f175 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-431e539d-2c0d-4d06-ba93-63beedb0328a -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a.63605ad7-44f8-440e-9b47-2c098d722271 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:11 devstack sudo[93733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-431e539d-2c0d-4d06-ba93-63beedb0328a -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a.63605ad7-44f8-440e-9b47-2c098d722271 Jun 02 03:22:11 devstack sudo[93733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:11 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-3ab5a2c2-a576-477f-a96f-178a276c2ef5 req-a61e5f7f-b454-4972-8fa0-5be1c00c111c tempest-AttachVolumeNegativeTest-1165991087 None] Terminate volume connection completed successfully. Jun 02 03:22:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-3ab5a2c2-a576-477f-a96f-178a276c2ef5 req-a61e5f7f-b454-4972-8fa0-5be1c00c111c tempest-AttachVolumeNegativeTest-1165991087 None] Deleting attachment b25dc528-08cf-4cba-8447-09013795c57c. {{(pid=86431) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 02 03:22:12 devstack sudo[93733]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d56a6844-f1ea-41ea-afc0-d73d4397f175 tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-431e539d-2c0d-4d06-ba93-63beedb0328a -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a.63605ad7-44f8-440e-9b47-2c098d722271" returned: 0 in 1.046s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:12 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-d56a6844-f1ea-41ea-afc0-d73d4397f175 tempest-GroupSnapshotsTest-408043841 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a.63605ad7-44f8-440e-9b47-2c098d722271 is being set with open permissions: ugo+rw: NotImplementedError Jun 02 03:22:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d56a6844-f1ea-41ea-afc0-d73d4397f175 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a.63605ad7-44f8-440e-9b47-2c098d722271 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:12 devstack sudo[93765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a.63605ad7-44f8-440e-9b47-2c098d722271 Jun 02 03:22:12 devstack sudo[93765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:12 devstack sudo[93765]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d56a6844-f1ea-41ea-afc0-d73d4397f175 tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a.63605ad7-44f8-440e-9b47-2c098d722271" returned: 0 in 0.696s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d56a6844-f1ea-41ea-afc0-d73d4397f175 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:12 devstack sudo[93769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a.info Jun 02 03:22:12 devstack sudo[93769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:13 devstack sudo[93769]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d56a6844-f1ea-41ea-afc0-d73d4397f175 tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a.info" returned: 0 in 0.644s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:13 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-d56a6844-f1ea-41ea-afc0-d73d4397f175 tempest-GroupSnapshotsTest-408043841 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a.info is being set with open permissions: ugo+rw: NotImplementedError Jun 02 03:22:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d56a6844-f1ea-41ea-afc0-d73d4397f175 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:13 devstack sudo[93773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a.info Jun 02 03:22:13 devstack sudo[93773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:14 devstack sudo[93773]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d56a6844-f1ea-41ea-afc0-d73d4397f175 tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a.info" returned: 0 in 0.644s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d56a6844-f1ea-41ea-afc0-d73d4397f175 tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.269s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:22:14 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-d56a6844-f1ea-41ea-afc0-d73d4397f175 tempest-GroupSnapshotsTest-408043841 None] group_snapshot 7343a228-d055-4a41-aef9-66c8a6980183: created successfully Jun 02 03:22:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:22:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:22:16 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] Acquiring lock "cinder-quobyte-63605ad7-44f8-440e-9b47-2c098d722271-6ebf63cb-c8cd-43a1-a2e6-e5337ec2df57" by "_create_volume_from_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:22:16 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] Lock "cinder-quobyte-63605ad7-44f8-440e-9b47-2c098d722271-6ebf63cb-c8cd-43a1-a2e6-e5337ec2df57" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:22:16 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] Creating volume 6ebf63cb-c8cd-43a1-a2e6-e5337ec2df57 from snapshot 63605ad7-44f8-440e-9b47-2c098d722271 {{(pid=86431) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 02 03:22:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:22:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:22:16 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:22:16 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:22:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:22:16 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:22:16 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] Acquiring lock "cinder-quobyte-6ebf63cb-c8cd-43a1-a2e6-e5337ec2df57" by "_copy_volume_from_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:22:16 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] Lock "cinder-quobyte-6ebf63cb-c8cd-43a1-a2e6-e5337ec2df57" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:22:16 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] snapshot: 63605ad7-44f8-440e-9b47-2c098d722271, volume: 6ebf63cb-c8cd-43a1-a2e6-e5337ec2df57, {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 03:22:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:22:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:22:16 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:22:16 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:22:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:22:16 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a5a93c-c20f-4804-b63b-2d18bea61cfa]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:22:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a.63605ad7-44f8-440e-9b47-2c098d722271 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:16 devstack sudo[93813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a.63605ad7-44f8-440e-9b47-2c098d722271 Jun 02 03:22:16 devstack sudo[93813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:17 devstack sudo[93813]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a.63605ad7-44f8-440e-9b47-2c098d722271" returned: 0 in 1.060s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:17 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-431e539d-2c0d-4d06-ba93-63beedb0328a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:22:17 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 03:22:17 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] Creating direct copy from snapshot {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 03:22:17 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2ab5a8-d2f2-4153-bca9-2f167f7629d0]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:22:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:17 devstack sudo[93873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a Jun 02 03:22:17 devstack sudo[93873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:18 devstack sudo[93873]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a" returned: 0 in 0.868s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:18 devstack cinder-volume[86431]: DEBUG cinder.utils [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] Path /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6ebf63cb-c8cd-43a1-a2e6-e5337ec2df57 not found in is_blk_device check {{(pid=86431) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 02 03:22:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6ebf63cb-c8cd-43a1-a2e6-e5337ec2df57 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:18 devstack sudo[93881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6ebf63cb-c8cd-43a1-a2e6-e5337ec2df57 Jun 02 03:22:18 devstack sudo[93881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:25 devstack sudo[93881]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6ebf63cb-c8cd-43a1-a2e6-e5337ec2df57" returned: 0 in 6.581s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:25 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbdb6ee-c9bd-43e6-87f8-db6014616e7e]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:22:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:25 devstack sudo[93957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a Jun 02 03:22:25 devstack sudo[93957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:26 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=39,cinder:INSERT=8,cinder:UPDATE=38,cinder:DELETE=3 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:22:26 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:UPDATE=31,cinder:SELECT=34,cinder:INSERT=7,cinder:DELETE=2 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:22:26 devstack sudo[93957]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a" returned: 0 in 1.436s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:26 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] Image conversion details: src /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a, size 1024.00 MB, duration 6.58 sec, destination /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6ebf63cb-c8cd-43a1-a2e6-e5337ec2df57 {{(pid=86431) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 02 03:22:26 devstack cinder-volume[86431]: INFO cinder.image.image_utils [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] Converted 1024.00 MB image at 155.58 MB/s Jun 02 03:22:26 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6ebf63cb-c8cd-43a1-a2e6-e5337ec2df57 is being set with open permissions: ugo+rw: NotImplementedError Jun 02 03:22:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6ebf63cb-c8cd-43a1-a2e6-e5337ec2df57 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:26 devstack sudo[94005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6ebf63cb-c8cd-43a1-a2e6-e5337ec2df57 Jun 02 03:22:26 devstack sudo[94005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:27 devstack sudo[94005]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6ebf63cb-c8cd-43a1-a2e6-e5337ec2df57" returned: 0 in 0.885s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:27 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] Lock "cinder-quobyte-6ebf63cb-c8cd-43a1-a2e6-e5337ec2df57" released by "_copy_volume_from_snapshot" :: held 10.951s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:22:27 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] Lock "cinder-quobyte-63605ad7-44f8-440e-9b47-2c098d722271-6ebf63cb-c8cd-43a1-a2e6-e5337ec2df57" released by "_create_volume_from_snapshot" :: held 11.021s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:22:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.045s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:22:27 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-c1e2850f-3e04-4764-a228-5c49f0ec9672 tempest-GroupSnapshotsTest-408043841 None] Create group from source-snapshot-7343a228-d055-4a41-aef9-66c8a6980183 completed successfully. Jun 02 03:22:28 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6a201c2c-29ff-4bd9-bab3-8dd27cb8fd16 tempest-GroupSnapshotsTest-408043841 None] Acquiring lock "cinder-quobyte-6ebf63cb-c8cd-43a1-a2e6-e5337ec2df57" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:22:29 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6a201c2c-29ff-4bd9-bab3-8dd27cb8fd16 tempest-GroupSnapshotsTest-408043841 None] Lock "cinder-quobyte-6ebf63cb-c8cd-43a1-a2e6-e5337ec2df57" acquired by "delete_volume" :: waited 0.058s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:22:29 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59714f8-1991-4890-b667-e511543b79ad]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:22:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6a201c2c-29ff-4bd9-bab3-8dd27cb8fd16 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6ebf63cb-c8cd-43a1-a2e6-e5337ec2df57 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:29 devstack sudo[94040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6ebf63cb-c8cd-43a1-a2e6-e5337ec2df57 Jun 02 03:22:29 devstack sudo[94040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:31 devstack sudo[94040]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6a201c2c-29ff-4bd9-bab3-8dd27cb8fd16 tempest-GroupSnapshotsTest-408043841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6ebf63cb-c8cd-43a1-a2e6-e5337ec2df57" returned: 0 in 1.853s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6a201c2c-29ff-4bd9-bab3-8dd27cb8fd16 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6ebf63cb-c8cd-43a1-a2e6-e5337ec2df57 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:31 devstack sudo[94091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6ebf63cb-c8cd-43a1-a2e6-e5337ec2df57 Jun 02 03:22:31 devstack sudo[94091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:32 devstack sudo[94091]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6a201c2c-29ff-4bd9-bab3-8dd27cb8fd16 tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6ebf63cb-c8cd-43a1-a2e6-e5337ec2df57" returned: 0 in 1.343s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:32 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6a201c2c-29ff-4bd9-bab3-8dd27cb8fd16 tempest-GroupSnapshotsTest-408043841 None] Lock "cinder-quobyte-6ebf63cb-c8cd-43a1-a2e6-e5337ec2df57" released by "delete_volume" :: held 3.387s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:22:32 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-6a201c2c-29ff-4bd9-bab3-8dd27cb8fd16 tempest-GroupSnapshotsTest-408043841 None] Created reservations ['494ccdba-da05-45f2-ba55-8cefbc84f3be'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:22:32 devstack cinder-volume[86431]: WARNING cinder.quota [None req-6a201c2c-29ff-4bd9-bab3-8dd27cb8fd16 tempest-GroupSnapshotsTest-408043841 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1456154081 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1456154081, it is now deprecated. Please use the default quota class for default quota. Jun 02 03:22:32 devstack cinder-volume[86431]: WARNING cinder.quota [None req-6a201c2c-29ff-4bd9-bab3-8dd27cb8fd16 tempest-GroupSnapshotsTest-408043841 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1456154081 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1456154081, it is now deprecated. Please use the default quota class for default quota. Jun 02 03:22:32 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-6a201c2c-29ff-4bd9-bab3-8dd27cb8fd16 tempest-GroupSnapshotsTest-408043841 None] Created reservations ['f4f7477a-1c76-402d-96cd-91136024bb04', '76d75281-42c9-49ec-82f5-7ea9c91935ad', '2a8cac6d-078e-4856-a790-62535492305e', '209a199e-bf6a-483d-8aa1-e57793b02458'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:22:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6a201c2c-29ff-4bd9-bab3-8dd27cb8fd16 tempest-GroupSnapshotsTest-408043841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:22:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6a201c2c-29ff-4bd9-bab3-8dd27cb8fd16 tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:22:33 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6a201c2c-29ff-4bd9-bab3-8dd27cb8fd16 tempest-GroupSnapshotsTest-408043841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:22:33 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6a201c2c-29ff-4bd9-bab3-8dd27cb8fd16 tempest-GroupSnapshotsTest-408043841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:22:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6a201c2c-29ff-4bd9-bab3-8dd27cb8fd16 tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:22:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6a201c2c-29ff-4bd9-bab3-8dd27cb8fd16 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:33 devstack sudo[94097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:22:33 devstack sudo[94097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:34 devstack sudo[94097]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6a201c2c-29ff-4bd9-bab3-8dd27cb8fd16 tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 1.076s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:34 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-6a201c2c-29ff-4bd9-bab3-8dd27cb8fd16 tempest-GroupSnapshotsTest-408043841 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:22:34 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-6a201c2c-29ff-4bd9-bab3-8dd27cb8fd16 tempest-GroupSnapshotsTest-408043841 None] Delete group completed successfully. Jun 02 03:22:34 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-62abf779-71ee-4e60-8a46-e673cca2d455 tempest-VolumesActionsTest-389113780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:22:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-62abf779-71ee-4e60-8a46-e673cca2d455 tempest-VolumesActionsTest-389113780 None] Flow 'volume_create_manager' (d9a25b1e-fac5-4c8f-8a19-297c5cc20bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:22:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-62abf779-71ee-4e60-8a46-e673cca2d455 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c28bf80b-6614-46eb-9154-df9bd30134e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-62abf779-71ee-4e60-8a46-e673cca2d455 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c28bf80b-6614-46eb-9154-df9bd30134e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-119872975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68986db3-ed5e-452d-9400-7c1116660649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3d1ef1e06f442e3b9ab1198a0dd3cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:22:34Z,use_quota=True,user_id='80d8ba02482c43cb8502ce327f3ec5d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-62abf779-71ee-4e60-8a46-e673cca2d455 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e64e5c8-d0e6-4ada-ae9a-1f1b31b672ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-62abf779-71ee-4e60-8a46-e673cca2d455 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e64e5c8-d0e6-4ada-ae9a-1f1b31b672ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-62abf779-71ee-4e60-8a46-e673cca2d455 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9818a34f-74df-48d6-b412-29bd3625a11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-62abf779-71ee-4e60-8a46-e673cca2d455 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9818a34f-74df-48d6-b412-29bd3625a11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68986db3-ed5e-452d-9400-7c1116660649', 'volume_name': 'volume-68986db3-ed5e-452d-9400-7c1116660649', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-62abf779-71ee-4e60-8a46-e673cca2d455 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2908ddc0-b2ef-4be4-b5c7-618f6d3411e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-62abf779-71ee-4e60-8a46-e673cca2d455 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2908ddc0-b2ef-4be4-b5c7-618f6d3411e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-62abf779-71ee-4e60-8a46-e673cca2d455 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7f523e-872a-44d9-bd90-8a3521d2f30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:34 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-62abf779-71ee-4e60-8a46-e673cca2d455 tempest-VolumesActionsTest-389113780 None] Volume 68986db3-ed5e-452d-9400-7c1116660649: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68986db3-ed5e-452d-9400-7c1116660649', 'volume_size': 1} Jun 02 03:22:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-62abf779-71ee-4e60-8a46-e673cca2d455 tempest-VolumesActionsTest-389113780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:22:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-62abf779-71ee-4e60-8a46-e673cca2d455 tempest-VolumesActionsTest-389113780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:22:34 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-62abf779-71ee-4e60-8a46-e673cca2d455 tempest-VolumesActionsTest-389113780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-119872975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68986db3-ed5e-452d-9400-7c1116660649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3d1ef1e06f442e3b9ab1198a0dd3cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:22:34Z,use_quota=True,user_id='80d8ba02482c43cb8502ce327f3ec5d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:22:34 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-62abf779-71ee-4e60-8a46-e673cca2d455 tempest-VolumesActionsTest-389113780 None] Creating volume 68986db3-ed5e-452d-9400-7c1116660649 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:22:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-62abf779-71ee-4e60-8a46-e673cca2d455 tempest-VolumesActionsTest-389113780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:22:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-62abf779-71ee-4e60-8a46-e673cca2d455 tempest-VolumesActionsTest-389113780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:22:34 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-62abf779-71ee-4e60-8a46-e673cca2d455 tempest-VolumesActionsTest-389113780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:22:34 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-62abf779-71ee-4e60-8a46-e673cca2d455 tempest-VolumesActionsTest-389113780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:22:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-62abf779-71ee-4e60-8a46-e673cca2d455 tempest-VolumesActionsTest-389113780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:22:34 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-62abf779-71ee-4e60-8a46-e673cca2d455 tempest-VolumesActionsTest-389113780 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:22:34 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-62abf779-71ee-4e60-8a46-e673cca2d455 tempest-VolumesActionsTest-389113780 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:22:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-62abf779-71ee-4e60-8a46-e673cca2d455 tempest-VolumesActionsTest-389113780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-68986db3-ed5e-452d-9400-7c1116660649 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:34 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-cb9f25d2-5459-4c81-a27f-39aeda976ed8 tempest-GroupSnapshotsTest-408043841 None] group_snapshot 7343a228-d055-4a41-aef9-66c8a6980183: deleting Jun 02 03:22:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-cb9f25d2-5459-4c81-a27f-39aeda976ed8 tempest-GroupSnapshotsTest-408043841 None] group_snapshot 7343a228-d055-4a41-aef9-66c8a6980183: deleting {{(pid=86431) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Jun 02 03:22:34 devstack sudo[94100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-68986db3-ed5e-452d-9400-7c1116660649 1073741824 Jun 02 03:22:34 devstack sudo[94100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-cb9f25d2-5459-4c81-a27f-39aeda976ed8 tempest-GroupSnapshotsTest-408043841 None] Acquiring lock "cinder-quobyte-431e539d-2c0d-4d06-ba93-63beedb0328a" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:22:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-cb9f25d2-5459-4c81-a27f-39aeda976ed8 tempest-GroupSnapshotsTest-408043841 None] Lock "cinder-quobyte-431e539d-2c0d-4d06-ba93-63beedb0328a" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:22:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-cb9f25d2-5459-4c81-a27f-39aeda976ed8 tempest-GroupSnapshotsTest-408043841 None] Acquiring lock "cinder-quobyte-63605ad7-44f8-440e-9b47-2c098d722271" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:22:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-cb9f25d2-5459-4c81-a27f-39aeda976ed8 tempest-GroupSnapshotsTest-408043841 None] Lock "cinder-quobyte-63605ad7-44f8-440e-9b47-2c098d722271" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:22:34 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-cb9f25d2-5459-4c81-a27f-39aeda976ed8 tempest-GroupSnapshotsTest-408043841 None] Deleting offline snapshot 63605ad7-44f8-440e-9b47-2c098d722271 of volume 431e539d-2c0d-4d06-ba93-63beedb0328a {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:22:34 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-cb9f25d2-5459-4c81-a27f-39aeda976ed8 tempest-GroupSnapshotsTest-408043841 None] snapshot_file for this snap is: volume-431e539d-2c0d-4d06-ba93-63beedb0328a.63605ad7-44f8-440e-9b47-2c098d722271 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:22:34 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abeb940-78e1-4ad8-aef1-2370f897dd9c]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:22:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cb9f25d2-5459-4c81-a27f-39aeda976ed8 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a.63605ad7-44f8-440e-9b47-2c098d722271 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:34 devstack sudo[94102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a.63605ad7-44f8-440e-9b47-2c098d722271 Jun 02 03:22:34 devstack sudo[94102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:35 devstack sudo[94102]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cb9f25d2-5459-4c81-a27f-39aeda976ed8 tempest-GroupSnapshotsTest-408043841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a.63605ad7-44f8-440e-9b47-2c098d722271" returned: 0 in 1.144s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:35 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-cb9f25d2-5459-4c81-a27f-39aeda976ed8 tempest-GroupSnapshotsTest-408043841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-431e539d-2c0d-4d06-ba93-63beedb0328a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:22:35 devstack sudo[94100]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:35 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0a673b-02a1-4399-80f7-3b6ae2f9bc7b]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:22:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cb9f25d2-5459-4c81-a27f-39aeda976ed8 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-62abf779-71ee-4e60-8a46-e673cca2d455 tempest-VolumesActionsTest-389113780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-68986db3-ed5e-452d-9400-7c1116660649 1073741824" returned: 0 in 1.499s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-62abf779-71ee-4e60-8a46-e673cca2d455 tempest-VolumesActionsTest-389113780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-68986db3-ed5e-452d-9400-7c1116660649 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:35 devstack sudo[94112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-68986db3-ed5e-452d-9400-7c1116660649 Jun 02 03:22:35 devstack sudo[94112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:35 devstack sudo[94111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a Jun 02 03:22:35 devstack sudo[94111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:37 devstack sudo[94112]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-62abf779-71ee-4e60-8a46-e673cca2d455 tempest-VolumesActionsTest-389113780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-68986db3-ed5e-452d-9400-7c1116660649" returned: 0 in 1.357s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:37 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-62abf779-71ee-4e60-8a46-e673cca2d455 tempest-VolumesActionsTest-389113780 None] <== create_volume: return (2933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:22:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-62abf779-71ee-4e60-8a46-e673cca2d455 tempest-VolumesActionsTest-389113780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.939s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:22:37 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-62abf779-71ee-4e60-8a46-e673cca2d455 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7f523e-872a-44d9-bd90-8a3521d2f30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68986db3-ed5e-452d-9400-7c1116660649', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:37 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-62abf779-71ee-4e60-8a46-e673cca2d455 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d335198c-e404-407c-890b-a835fc47ddec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:37 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-62abf779-71ee-4e60-8a46-e673cca2d455 tempest-VolumesActionsTest-389113780 None] Volume volume-68986db3-ed5e-452d-9400-7c1116660649 (68986db3-ed5e-452d-9400-7c1116660649): created successfully Jun 02 03:22:37 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-62abf779-71ee-4e60-8a46-e673cca2d455 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d335198c-e404-407c-890b-a835fc47ddec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:37 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-62abf779-71ee-4e60-8a46-e673cca2d455 tempest-VolumesActionsTest-389113780 None] Flow 'volume_create_manager' (d9a25b1e-fac5-4c8f-8a19-297c5cc20bab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:22:37 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-62abf779-71ee-4e60-8a46-e673cca2d455 tempest-VolumesActionsTest-389113780 None] Created volume successfully. Jun 02 03:22:37 devstack sudo[94111]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cb9f25d2-5459-4c81-a27f-39aeda976ed8 tempest-GroupSnapshotsTest-408043841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a" returned: 0 in 1.647s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cb9f25d2-5459-4c81-a27f-39aeda976ed8 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a.63605ad7-44f8-440e-9b47-2c098d722271 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:37 devstack sudo[94120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a.63605ad7-44f8-440e-9b47-2c098d722271 Jun 02 03:22:37 devstack sudo[94120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:38 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1249b563-e0d8-479f-9dc9-38d2894c82e4 tempest-VolumesActionsTest-389113780 None] Acquiring lock "cinder-68986db3-ed5e-452d-9400-7c1116660649" by "attach_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:22:38 devstack sudo[94120]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cb9f25d2-5459-4c81-a27f-39aeda976ed8 tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a.63605ad7-44f8-440e-9b47-2c098d722271" returned: 0 in 1.238s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cb9f25d2-5459-4c81-a27f-39aeda976ed8 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a.63605ad7-44f8-440e-9b47-2c098d722271 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:38 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1249b563-e0d8-479f-9dc9-38d2894c82e4 tempest-VolumesActionsTest-389113780 None] Lock "cinder-68986db3-ed5e-452d-9400-7c1116660649" acquired by "attach_volume" :: waited 0.052s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:22:38 devstack sudo[94141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a.63605ad7-44f8-440e-9b47-2c098d722271 Jun 02 03:22:38 devstack sudo[94141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:38 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-1249b563-e0d8-479f-9dc9-38d2894c82e4 tempest-VolumesActionsTest-389113780 None] Attaching volume 68986db3-ed5e-452d-9400-7c1116660649 to instance 66de458c-066a-4701-80e7-22bac66eb301 at mountpoint /dev/vdb on host None. Jun 02 03:22:38 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-1249b563-e0d8-479f-9dc9-38d2894c82e4 tempest-VolumesActionsTest-389113780 None] Attach volume completed successfully. Jun 02 03:22:39 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1249b563-e0d8-479f-9dc9-38d2894c82e4 tempest-VolumesActionsTest-389113780 None] Lock "cinder-68986db3-ed5e-452d-9400-7c1116660649" released by "attach_volume" :: held 0.287s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:22:39 devstack sudo[94141]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cb9f25d2-5459-4c81-a27f-39aeda976ed8 tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a.63605ad7-44f8-440e-9b47-2c098d722271" returned: 0 in 0.924s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:39 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-cb9f25d2-5459-4c81-a27f-39aeda976ed8 tempest-GroupSnapshotsTest-408043841 None] Lock "cinder-quobyte-63605ad7-44f8-440e-9b47-2c098d722271" released by "_delete_snapshot" :: held 5.149s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:22:39 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-cb9f25d2-5459-4c81-a27f-39aeda976ed8 tempest-GroupSnapshotsTest-408043841 None] Lock "cinder-quobyte-431e539d-2c0d-4d06-ba93-63beedb0328a" released by "delete_snapshot" :: held 5.199s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:22:39 devstack cinder-volume[86431]: WARNING cinder.quota [None req-cb9f25d2-5459-4c81-a27f-39aeda976ed8 tempest-GroupSnapshotsTest-408043841 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1456154081 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1456154081, it is now deprecated. Please use the default quota class for default quota. Jun 02 03:22:39 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-ae02a473-393b-4b7f-acd4-5806093fc7b4 tempest-VolumesActionsTest-2009514611 None] Terminate volume connection completed successfully. Jun 02 03:22:39 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-cb9f25d2-5459-4c81-a27f-39aeda976ed8 tempest-GroupSnapshotsTest-408043841 None] Created reservations ['454c1ce2-4cb0-4359-b8fb-81d355a32a6d', '44fddc46-600a-4f84-86a1-fac3b9b12014', '039db437-7b54-4087-9962-9dad9f4143f8', 'da4f34ca-124b-40c2-a173-efbd2d7db0dd'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:22:39 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-cb9f25d2-5459-4c81-a27f-39aeda976ed8 tempest-GroupSnapshotsTest-408043841 None] group_snapshot 7343a228-d055-4a41-aef9-66c8a6980183: deleted successfully Jun 02 03:22:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ae02a473-393b-4b7f-acd4-5806093fc7b4 tempest-VolumesActionsTest-2009514611 None] Acquiring lock "cinder-68986db3-ed5e-452d-9400-7c1116660649-detach_volume" by "detach_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:22:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ae02a473-393b-4b7f-acd4-5806093fc7b4 tempest-VolumesActionsTest-2009514611 None] Lock "cinder-68986db3-ed5e-452d-9400-7c1116660649-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:22:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0ea8f4e3-509c-41e1-8198-ce4e94154e08 tempest-GroupSnapshotsTest-408043841 None] Acquiring lock "cinder-quobyte-431e539d-2c0d-4d06-ba93-63beedb0328a" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:22:40 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-ae02a473-393b-4b7f-acd4-5806093fc7b4 tempest-VolumesActionsTest-2009514611 None] Detaching volume 68986db3-ed5e-452d-9400-7c1116660649 from instance 66de458c-066a-4701-80e7-22bac66eb301. Jun 02 03:22:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0ea8f4e3-509c-41e1-8198-ce4e94154e08 tempest-GroupSnapshotsTest-408043841 None] Lock "cinder-quobyte-431e539d-2c0d-4d06-ba93-63beedb0328a" acquired by "delete_volume" :: waited 0.037s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:22:40 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc2026d-ef13-48cb-a174-bf01038495f9]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:22:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0ea8f4e3-509c-41e1-8198-ce4e94154e08 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:40 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-ae02a473-393b-4b7f-acd4-5806093fc7b4 tempest-VolumesActionsTest-2009514611 None] Detach volume completed successfully. Jun 02 03:22:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ae02a473-393b-4b7f-acd4-5806093fc7b4 tempest-VolumesActionsTest-2009514611 None] Lock "cinder-68986db3-ed5e-452d-9400-7c1116660649-detach_volume" released by "detach_volume" :: held 0.153s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:22:40 devstack sudo[94176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a Jun 02 03:22:40 devstack sudo[94176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:41 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-878e8f98-66ae-427f-8115-76f3a7037792 tempest-VolumesActionsTest-389113780 None] Acquiring lock "cinder-68986db3-ed5e-452d-9400-7c1116660649-detach_volume" by "detach_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:22:41 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-878e8f98-66ae-427f-8115-76f3a7037792 tempest-VolumesActionsTest-389113780 None] Lock "cinder-68986db3-ed5e-452d-9400-7c1116660649-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:22:41 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-878e8f98-66ae-427f-8115-76f3a7037792 tempest-VolumesActionsTest-389113780 None] Volume detach called, but volume not attached. Jun 02 03:22:41 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-878e8f98-66ae-427f-8115-76f3a7037792 tempest-VolumesActionsTest-389113780 None] Lock "cinder-68986db3-ed5e-452d-9400-7c1116660649-detach_volume" released by "detach_volume" :: held 0.029s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:22:41 devstack sudo[94176]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0ea8f4e3-509c-41e1-8198-ce4e94154e08 tempest-GroupSnapshotsTest-408043841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a" returned: 0 in 0.797s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0ea8f4e3-509c-41e1-8198-ce4e94154e08 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:41 devstack sudo[94181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a Jun 02 03:22:41 devstack sudo[94181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:41 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-239713ab-a906-4e58-9765-6ca19b1be66a tempest-VolumesActionsTest-389113780 None] Acquiring lock "cinder-68986db3-ed5e-452d-9400-7c1116660649-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:22:41 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-239713ab-a906-4e58-9765-6ca19b1be66a tempest-VolumesActionsTest-389113780 None] Lock "cinder-68986db3-ed5e-452d-9400-7c1116660649-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:22:41 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-239713ab-a906-4e58-9765-6ca19b1be66a tempest-VolumesActionsTest-389113780 None] Acquiring lock "cinder-quobyte-68986db3-ed5e-452d-9400-7c1116660649" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:22:41 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-239713ab-a906-4e58-9765-6ca19b1be66a tempest-VolumesActionsTest-389113780 None] Lock "cinder-quobyte-68986db3-ed5e-452d-9400-7c1116660649" acquired by "delete_volume" :: waited 0.020s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:22:41 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[4babe98d-2d54-4e73-8053-9b3b1d2c1a4f]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:22:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-239713ab-a906-4e58-9765-6ca19b1be66a tempest-VolumesActionsTest-389113780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-68986db3-ed5e-452d-9400-7c1116660649 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:41 devstack sudo[94181]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0ea8f4e3-509c-41e1-8198-ce4e94154e08 tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-431e539d-2c0d-4d06-ba93-63beedb0328a" returned: 0 in 0.689s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:42 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0ea8f4e3-509c-41e1-8198-ce4e94154e08 tempest-GroupSnapshotsTest-408043841 None] Lock "cinder-quobyte-431e539d-2c0d-4d06-ba93-63beedb0328a" released by "delete_volume" :: held 1.554s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:22:42 devstack sudo[94184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-68986db3-ed5e-452d-9400-7c1116660649 Jun 02 03:22:42 devstack sudo[94184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:42 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-0ea8f4e3-509c-41e1-8198-ce4e94154e08 tempest-GroupSnapshotsTest-408043841 None] Created reservations ['a3489b21-c299-447d-876a-9b9afffb8bb6'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:22:42 devstack cinder-volume[86431]: WARNING cinder.db.sqlalchemy.api [None req-0ea8f4e3-509c-41e1-8198-ce4e94154e08 tempest-GroupSnapshotsTest-408043841 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1456154081'] Jun 02 03:22:42 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-0ea8f4e3-509c-41e1-8198-ce4e94154e08 tempest-GroupSnapshotsTest-408043841 None] Created reservations ['434579a1-0687-4fcd-85bf-dfa170881443', '05b0936d-3b20-48e0-baa8-b7d4b34e338c', 'e77cac44-c1a1-4f4d-a3f9-d38bc56cfc46', '7479f52b-c2b7-43a8-a28d-f1a3dc554fa7'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:22:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0ea8f4e3-509c-41e1-8198-ce4e94154e08 tempest-GroupSnapshotsTest-408043841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:22:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0ea8f4e3-509c-41e1-8198-ce4e94154e08 tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:22:42 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0ea8f4e3-509c-41e1-8198-ce4e94154e08 tempest-GroupSnapshotsTest-408043841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:22:42 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0ea8f4e3-509c-41e1-8198-ce4e94154e08 tempest-GroupSnapshotsTest-408043841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:22:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0ea8f4e3-509c-41e1-8198-ce4e94154e08 tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:22:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0ea8f4e3-509c-41e1-8198-ce4e94154e08 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:42 devstack sudo[94186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:22:42 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:42 devstack sudo[94184]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-239713ab-a906-4e58-9765-6ca19b1be66a tempest-VolumesActionsTest-389113780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-68986db3-ed5e-452d-9400-7c1116660649" returned: 0 in 0.901s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-239713ab-a906-4e58-9765-6ca19b1be66a tempest-VolumesActionsTest-389113780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-68986db3-ed5e-452d-9400-7c1116660649 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:42 devstack sudo[94192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-68986db3-ed5e-452d-9400-7c1116660649 Jun 02 03:22:42 devstack sudo[94192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:43 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0ea8f4e3-509c-41e1-8198-ce4e94154e08 tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.920s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:43 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-0ea8f4e3-509c-41e1-8198-ce4e94154e08 tempest-GroupSnapshotsTest-408043841 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:22:43 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-0ea8f4e3-509c-41e1-8198-ce4e94154e08 tempest-GroupSnapshotsTest-408043841 None] Delete group completed successfully. Jun 02 03:22:43 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-f922a5e5-b628-46da-a133-c551e8b9b3db tempest-GroupSnapshotsTest-408043841 None] Group tempest-GroupSnapshotsTest-Group-480759693: creating Jun 02 03:22:43 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-f922a5e5-b628-46da-a133-c551e8b9b3db tempest-GroupSnapshotsTest-408043841 None] Group tempest-GroupSnapshotsTest-Group-480759693: created successfully Jun 02 03:22:43 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-f922a5e5-b628-46da-a133-c551e8b9b3db tempest-GroupSnapshotsTest-408043841 None] Create group completed successfully. Jun 02 03:22:43 devstack sudo[94192]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-239713ab-a906-4e58-9765-6ca19b1be66a tempest-VolumesActionsTest-389113780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-68986db3-ed5e-452d-9400-7c1116660649" returned: 0 in 0.805s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:43 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-239713ab-a906-4e58-9765-6ca19b1be66a tempest-VolumesActionsTest-389113780 None] Lock "cinder-quobyte-68986db3-ed5e-452d-9400-7c1116660649" released by "delete_volume" :: held 1.756s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:22:43 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-239713ab-a906-4e58-9765-6ca19b1be66a tempest-VolumesActionsTest-389113780 None] Created reservations ['7d74c24b-265b-484e-b1a4-1217d056e8f5', 'e15e00a1-d509-477b-afee-4e14f98546a0', '708ef91b-8dc0-4a58-97b5-d894c06c72ca', 'e1ee5482-8075-4762-9c7c-5a016049a986'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:22:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-239713ab-a906-4e58-9765-6ca19b1be66a tempest-VolumesActionsTest-389113780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:22:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-239713ab-a906-4e58-9765-6ca19b1be66a tempest-VolumesActionsTest-389113780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:22:43 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-239713ab-a906-4e58-9765-6ca19b1be66a tempest-VolumesActionsTest-389113780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:22:43 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-239713ab-a906-4e58-9765-6ca19b1be66a tempest-VolumesActionsTest-389113780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:22:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-239713ab-a906-4e58-9765-6ca19b1be66a tempest-VolumesActionsTest-389113780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:22:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-239713ab-a906-4e58-9765-6ca19b1be66a tempest-VolumesActionsTest-389113780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:43 devstack sudo[94200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:22:43 devstack sudo[94200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:44 devstack sudo[94200]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-239713ab-a906-4e58-9765-6ca19b1be66a tempest-VolumesActionsTest-389113780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.690s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:44 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-239713ab-a906-4e58-9765-6ca19b1be66a tempest-VolumesActionsTest-389113780 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:22:44 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-239713ab-a906-4e58-9765-6ca19b1be66a tempest-VolumesActionsTest-389113780 None] Deleted volume successfully. Jun 02 03:22:44 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-239713ab-a906-4e58-9765-6ca19b1be66a tempest-VolumesActionsTest-389113780 None] Lock "cinder-68986db3-ed5e-452d-9400-7c1116660649-delete_volume" released by "delete_volume" :: held 2.720s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:22:45 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a2c0fc5-85b2-4e27-bdc5-fb957718b3d4 tempest-GroupSnapshotsTest-408043841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:22:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7a2c0fc5-85b2-4e27-bdc5-fb957718b3d4 tempest-GroupSnapshotsTest-408043841 None] Flow 'volume_create_manager' (f1fd3eca-23b2-4a35-ab00-c2d63e0c5a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:22:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7a2c0fc5-85b2-4e27-bdc5-fb957718b3d4 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f1b382-ec04-41ac-bfe1-cf3c08cbcfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7a2c0fc5-85b2-4e27-bdc5-fb957718b3d4 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f1b382-ec04-41ac-bfe1-cf3c08cbcfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1389620310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a0aa4040-2f6f-4d44-8856-b724accf0072,host='devstack@QuobyteHD#QuobyteHD',id=c5afdd75-2490-4c49-b629-38428fa2b589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050054a4bf054b39996d9b0f83376446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:22:45Z,use_quota=True,user_id='394e6c3efc954d1b86b030d05e8c2e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8af1262a-047e-4096-a814-7ed5f0afa8f2),volume_type_id=8af1262a-047e-4096-a814-7ed5f0afa8f2)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7a2c0fc5-85b2-4e27-bdc5-fb957718b3d4 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bbe2543-963a-4490-a691-88fb142a2f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7a2c0fc5-85b2-4e27-bdc5-fb957718b3d4 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bbe2543-963a-4490-a691-88fb142a2f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7a2c0fc5-85b2-4e27-bdc5-fb957718b3d4 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e7672c-be7d-43a4-97d7-12cd18732964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7a2c0fc5-85b2-4e27-bdc5-fb957718b3d4 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e7672c-be7d-43a4-97d7-12cd18732964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5afdd75-2490-4c49-b629-38428fa2b589', 'volume_name': 'volume-c5afdd75-2490-4c49-b629-38428fa2b589', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7a2c0fc5-85b2-4e27-bdc5-fb957718b3d4 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0fee271-a220-46e7-9b9a-366d671aaf6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7a2c0fc5-85b2-4e27-bdc5-fb957718b3d4 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0fee271-a220-46e7-9b9a-366d671aaf6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7a2c0fc5-85b2-4e27-bdc5-fb957718b3d4 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20b1ca79-343f-422c-8b4e-9b6ac5c532ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:45 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-7a2c0fc5-85b2-4e27-bdc5-fb957718b3d4 tempest-GroupSnapshotsTest-408043841 None] Volume c5afdd75-2490-4c49-b629-38428fa2b589: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5afdd75-2490-4c49-b629-38428fa2b589', 'volume_size': 1} Jun 02 03:22:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7a2c0fc5-85b2-4e27-bdc5-fb957718b3d4 tempest-GroupSnapshotsTest-408043841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:22:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7a2c0fc5-85b2-4e27-bdc5-fb957718b3d4 tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:22:45 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-7a2c0fc5-85b2-4e27-bdc5-fb957718b3d4 tempest-GroupSnapshotsTest-408043841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a0aa4040-2f6f-4d44-8856-b724accf0072,created_at=2026-06-02T01:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1389620310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a0aa4040-2f6f-4d44-8856-b724accf0072,host='devstack@QuobyteHD#QuobyteHD',id=c5afdd75-2490-4c49-b629-38428fa2b589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050054a4bf054b39996d9b0f83376446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:22:45Z,use_quota=True,user_id='394e6c3efc954d1b86b030d05e8c2e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8af1262a-047e-4096-a814-7ed5f0afa8f2),volume_type_id=8af1262a-047e-4096-a814-7ed5f0afa8f2)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:22:45 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-7a2c0fc5-85b2-4e27-bdc5-fb957718b3d4 tempest-GroupSnapshotsTest-408043841 None] Creating volume c5afdd75-2490-4c49-b629-38428fa2b589 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:22:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7a2c0fc5-85b2-4e27-bdc5-fb957718b3d4 tempest-GroupSnapshotsTest-408043841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:22:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7a2c0fc5-85b2-4e27-bdc5-fb957718b3d4 tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:22:45 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-7a2c0fc5-85b2-4e27-bdc5-fb957718b3d4 tempest-GroupSnapshotsTest-408043841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:22:45 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-7a2c0fc5-85b2-4e27-bdc5-fb957718b3d4 tempest-GroupSnapshotsTest-408043841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:22:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7a2c0fc5-85b2-4e27-bdc5-fb957718b3d4 tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:22:45 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-7a2c0fc5-85b2-4e27-bdc5-fb957718b3d4 tempest-GroupSnapshotsTest-408043841 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:22:45 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-7a2c0fc5-85b2-4e27-bdc5-fb957718b3d4 tempest-GroupSnapshotsTest-408043841 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:22:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7a2c0fc5-85b2-4e27-bdc5-fb957718b3d4 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:45 devstack sudo[94286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589 1073741824 Jun 02 03:22:45 devstack sudo[94286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:46 devstack sudo[94286]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7a2c0fc5-85b2-4e27-bdc5-fb957718b3d4 tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589 1073741824" returned: 0 in 1.237s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7a2c0fc5-85b2-4e27-bdc5-fb957718b3d4 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:46 devstack sudo[94331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589 Jun 02 03:22:46 devstack sudo[94331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:47 devstack sudo[94331]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7a2c0fc5-85b2-4e27-bdc5-fb957718b3d4 tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589" returned: 0 in 0.833s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-7a2c0fc5-85b2-4e27-bdc5-fb957718b3d4 tempest-GroupSnapshotsTest-408043841 None] <== create_volume: return (2148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:22:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7a2c0fc5-85b2-4e27-bdc5-fb957718b3d4 tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.151s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:22:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7a2c0fc5-85b2-4e27-bdc5-fb957718b3d4 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20b1ca79-343f-422c-8b4e-9b6ac5c532ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5afdd75-2490-4c49-b629-38428fa2b589', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7a2c0fc5-85b2-4e27-bdc5-fb957718b3d4 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb26229-cd3d-4ac8-9d54-bde7ce3f3eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:47 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-7a2c0fc5-85b2-4e27-bdc5-fb957718b3d4 tempest-GroupSnapshotsTest-408043841 None] Volume volume-c5afdd75-2490-4c49-b629-38428fa2b589 (c5afdd75-2490-4c49-b629-38428fa2b589): created successfully Jun 02 03:22:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7a2c0fc5-85b2-4e27-bdc5-fb957718b3d4 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb26229-cd3d-4ac8-9d54-bde7ce3f3eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7a2c0fc5-85b2-4e27-bdc5-fb957718b3d4 tempest-GroupSnapshotsTest-408043841 None] Flow 'volume_create_manager' (f1fd3eca-23b2-4a35-ab00-c2d63e0c5a63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:22:47 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-7a2c0fc5-85b2-4e27-bdc5-fb957718b3d4 tempest-GroupSnapshotsTest-408043841 None] Created volume successfully. Jun 02 03:22:49 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-26cccc5e-b8ad-4e84-8432-04e24d9b8151 tempest-GroupSnapshotsTest-408043841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:22:49 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-26cccc5e-b8ad-4e84-8432-04e24d9b8151 tempest-GroupSnapshotsTest-408043841 None] Flow 'volume_create_manager' (0feb52f6-7435-4d3c-a076-72e9df7cee25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:22:49 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-26cccc5e-b8ad-4e84-8432-04e24d9b8151 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83901775-1bd0-434d-9ba4-05194ea29fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:49 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-26cccc5e-b8ad-4e84-8432-04e24d9b8151 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83901775-1bd0-434d-9ba4-05194ea29fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1526126749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a0aa4040-2f6f-4d44-8856-b724accf0072,host='devstack@QuobyteHD#QuobyteHD',id=f038ab4a-889c-40de-808a-1383bfee2f20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050054a4bf054b39996d9b0f83376446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:22:49Z,use_quota=True,user_id='394e6c3efc954d1b86b030d05e8c2e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8af1262a-047e-4096-a814-7ed5f0afa8f2),volume_type_id=8af1262a-047e-4096-a814-7ed5f0afa8f2)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:49 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-26cccc5e-b8ad-4e84-8432-04e24d9b8151 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (404e29ee-8a9a-40de-9e0a-c8ca51a2fd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:49 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-26cccc5e-b8ad-4e84-8432-04e24d9b8151 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (404e29ee-8a9a-40de-9e0a-c8ca51a2fd42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:49 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-26cccc5e-b8ad-4e84-8432-04e24d9b8151 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ffef881-4f81-4efe-aafa-5960b5217668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:49 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-26cccc5e-b8ad-4e84-8432-04e24d9b8151 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ffef881-4f81-4efe-aafa-5960b5217668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f038ab4a-889c-40de-808a-1383bfee2f20', 'volume_name': 'volume-f038ab4a-889c-40de-808a-1383bfee2f20', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:49 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-26cccc5e-b8ad-4e84-8432-04e24d9b8151 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f0939a-1146-4d9e-bfcc-538fad467ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:49 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-26cccc5e-b8ad-4e84-8432-04e24d9b8151 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f0939a-1146-4d9e-bfcc-538fad467ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:49 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-26cccc5e-b8ad-4e84-8432-04e24d9b8151 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ab6324-3e62-4be7-8dc8-0775c9c470b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:49 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-26cccc5e-b8ad-4e84-8432-04e24d9b8151 tempest-GroupSnapshotsTest-408043841 None] Volume f038ab4a-889c-40de-808a-1383bfee2f20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f038ab4a-889c-40de-808a-1383bfee2f20', 'volume_size': 1} Jun 02 03:22:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-26cccc5e-b8ad-4e84-8432-04e24d9b8151 tempest-GroupSnapshotsTest-408043841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:22:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-26cccc5e-b8ad-4e84-8432-04e24d9b8151 tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:22:49 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-26cccc5e-b8ad-4e84-8432-04e24d9b8151 tempest-GroupSnapshotsTest-408043841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a0aa4040-2f6f-4d44-8856-b724accf0072,created_at=2026-06-02T01:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1526126749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a0aa4040-2f6f-4d44-8856-b724accf0072,host='devstack@QuobyteHD#QuobyteHD',id=f038ab4a-889c-40de-808a-1383bfee2f20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050054a4bf054b39996d9b0f83376446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:22:49Z,use_quota=True,user_id='394e6c3efc954d1b86b030d05e8c2e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8af1262a-047e-4096-a814-7ed5f0afa8f2),volume_type_id=8af1262a-047e-4096-a814-7ed5f0afa8f2)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:22:49 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-26cccc5e-b8ad-4e84-8432-04e24d9b8151 tempest-GroupSnapshotsTest-408043841 None] Creating volume f038ab4a-889c-40de-808a-1383bfee2f20 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:22:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-26cccc5e-b8ad-4e84-8432-04e24d9b8151 tempest-GroupSnapshotsTest-408043841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:22:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-26cccc5e-b8ad-4e84-8432-04e24d9b8151 tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:22:49 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-26cccc5e-b8ad-4e84-8432-04e24d9b8151 tempest-GroupSnapshotsTest-408043841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:22:49 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-26cccc5e-b8ad-4e84-8432-04e24d9b8151 tempest-GroupSnapshotsTest-408043841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:22:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-26cccc5e-b8ad-4e84-8432-04e24d9b8151 tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:22:49 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-26cccc5e-b8ad-4e84-8432-04e24d9b8151 tempest-GroupSnapshotsTest-408043841 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:22:49 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-26cccc5e-b8ad-4e84-8432-04e24d9b8151 tempest-GroupSnapshotsTest-408043841 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:22:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-26cccc5e-b8ad-4e84-8432-04e24d9b8151 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:49 devstack sudo[94335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20 1073741824 Jun 02 03:22:49 devstack sudo[94335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:50 devstack sudo[94335]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-26cccc5e-b8ad-4e84-8432-04e24d9b8151 tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20 1073741824" returned: 0 in 0.901s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-26cccc5e-b8ad-4e84-8432-04e24d9b8151 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:50 devstack sudo[94342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20 Jun 02 03:22:50 devstack sudo[94342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:51 devstack sudo[94342]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-26cccc5e-b8ad-4e84-8432-04e24d9b8151 tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20" returned: 0 in 0.688s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:51 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-26cccc5e-b8ad-4e84-8432-04e24d9b8151 tempest-GroupSnapshotsTest-408043841 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:22:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-26cccc5e-b8ad-4e84-8432-04e24d9b8151 tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:22:51 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-26cccc5e-b8ad-4e84-8432-04e24d9b8151 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ab6324-3e62-4be7-8dc8-0775c9c470b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f038ab4a-889c-40de-808a-1383bfee2f20', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:51 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-26cccc5e-b8ad-4e84-8432-04e24d9b8151 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fa4027e-c3be-40b2-a9dd-b3632feefb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:51 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-26cccc5e-b8ad-4e84-8432-04e24d9b8151 tempest-GroupSnapshotsTest-408043841 None] Volume volume-f038ab4a-889c-40de-808a-1383bfee2f20 (f038ab4a-889c-40de-808a-1383bfee2f20): created successfully Jun 02 03:22:51 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-26cccc5e-b8ad-4e84-8432-04e24d9b8151 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fa4027e-c3be-40b2-a9dd-b3632feefb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:51 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-26cccc5e-b8ad-4e84-8432-04e24d9b8151 tempest-GroupSnapshotsTest-408043841 None] Flow 'volume_create_manager' (0feb52f6-7435-4d3c-a076-72e9df7cee25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:22:51 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-26cccc5e-b8ad-4e84-8432-04e24d9b8151 tempest-GroupSnapshotsTest-408043841 None] Created volume successfully. Jun 02 03:22:51 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-aed2f928-ca83-425c-8bd8-462ec4b66686 tempest-GroupSnapshotsTest-408043841 None] Update group completed successfully. Jun 02 03:22:52 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-3807e198-7d75-48d8-80d0-336f5d2810be tempest-VolumesActionsTest-389113780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:22:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3807e198-7d75-48d8-80d0-336f5d2810be tempest-VolumesActionsTest-389113780 None] Flow 'volume_create_manager' (8ef42a51-5bcd-4524-b83c-56c7638dd269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:22:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3807e198-7d75-48d8-80d0-336f5d2810be tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f398ae98-1dbd-48c7-a812-ebc178e3ea1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3807e198-7d75-48d8-80d0-336f5d2810be tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f398ae98-1dbd-48c7-a812-ebc178e3ea1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1303906011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baf7be63-f6e7-4d6c-8381-2ed7e4204ad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3d1ef1e06f442e3b9ab1198a0dd3cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:22:52Z,use_quota=True,user_id='80d8ba02482c43cb8502ce327f3ec5d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3807e198-7d75-48d8-80d0-336f5d2810be tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35db41c4-e892-4689-9634-6cacd513945b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3807e198-7d75-48d8-80d0-336f5d2810be tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35db41c4-e892-4689-9634-6cacd513945b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3807e198-7d75-48d8-80d0-336f5d2810be tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e63ca03-1400-4984-bcd2-caa03bbf43e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3807e198-7d75-48d8-80d0-336f5d2810be tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e63ca03-1400-4984-bcd2-caa03bbf43e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baf7be63-f6e7-4d6c-8381-2ed7e4204ad1', 'volume_name': 'volume-baf7be63-f6e7-4d6c-8381-2ed7e4204ad1', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3807e198-7d75-48d8-80d0-336f5d2810be tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f480699-5f08-45a4-a401-50b30fca3d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3807e198-7d75-48d8-80d0-336f5d2810be tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f480699-5f08-45a4-a401-50b30fca3d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3807e198-7d75-48d8-80d0-336f5d2810be tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e4dc2c5-73b4-4177-a618-399300b42bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:52 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-3807e198-7d75-48d8-80d0-336f5d2810be tempest-VolumesActionsTest-389113780 None] Volume baf7be63-f6e7-4d6c-8381-2ed7e4204ad1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baf7be63-f6e7-4d6c-8381-2ed7e4204ad1', 'volume_size': 1} Jun 02 03:22:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3807e198-7d75-48d8-80d0-336f5d2810be tempest-VolumesActionsTest-389113780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:22:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3807e198-7d75-48d8-80d0-336f5d2810be tempest-VolumesActionsTest-389113780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:22:52 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3807e198-7d75-48d8-80d0-336f5d2810be tempest-VolumesActionsTest-389113780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1303906011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baf7be63-f6e7-4d6c-8381-2ed7e4204ad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3d1ef1e06f442e3b9ab1198a0dd3cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:22:52Z,use_quota=True,user_id='80d8ba02482c43cb8502ce327f3ec5d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:22:52 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-3807e198-7d75-48d8-80d0-336f5d2810be tempest-VolumesActionsTest-389113780 None] Creating volume baf7be63-f6e7-4d6c-8381-2ed7e4204ad1 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:22:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3807e198-7d75-48d8-80d0-336f5d2810be tempest-VolumesActionsTest-389113780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:22:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3807e198-7d75-48d8-80d0-336f5d2810be tempest-VolumesActionsTest-389113780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:22:52 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3807e198-7d75-48d8-80d0-336f5d2810be tempest-VolumesActionsTest-389113780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:22:52 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3807e198-7d75-48d8-80d0-336f5d2810be tempest-VolumesActionsTest-389113780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:22:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3807e198-7d75-48d8-80d0-336f5d2810be tempest-VolumesActionsTest-389113780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:22:52 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3807e198-7d75-48d8-80d0-336f5d2810be tempest-VolumesActionsTest-389113780 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:22:52 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-3807e198-7d75-48d8-80d0-336f5d2810be tempest-VolumesActionsTest-389113780 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:22:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3807e198-7d75-48d8-80d0-336f5d2810be tempest-VolumesActionsTest-389113780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-baf7be63-f6e7-4d6c-8381-2ed7e4204ad1 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:52 devstack sudo[94349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-baf7be63-f6e7-4d6c-8381-2ed7e4204ad1 1073741824 Jun 02 03:22:52 devstack sudo[94349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:53 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-22dccc12-41cb-4419-994d-e06f3e01a0d3 tempest-AttachVolumeShelveTestJSON-808950028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:22:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-22dccc12-41cb-4419-994d-e06f3e01a0d3 tempest-AttachVolumeShelveTestJSON-808950028 None] Flow 'volume_create_manager' (b6914872-fb78-415c-9978-9ec7639c3a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:22:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-22dccc12-41cb-4419-994d-e06f3e01a0d3 tempest-AttachVolumeShelveTestJSON-808950028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e45b360d-1142-479a-abd0-b5e843a90b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-22dccc12-41cb-4419-994d-e06f3e01a0d3 tempest-AttachVolumeShelveTestJSON-808950028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e45b360d-1142-479a-abd0-b5e843a90b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1439733990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec95d7c6-af6b-4600-a2e9-db20a82a7590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4722eeb492a4822995665c03077ee81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:22:53Z,use_quota=True,user_id='99dc2db648784502ba37a054d0331947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-22dccc12-41cb-4419-994d-e06f3e01a0d3 tempest-AttachVolumeShelveTestJSON-808950028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4b1bf55-30c2-4d85-8951-ea778acc91a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-22dccc12-41cb-4419-994d-e06f3e01a0d3 tempest-AttachVolumeShelveTestJSON-808950028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4b1bf55-30c2-4d85-8951-ea778acc91a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-22dccc12-41cb-4419-994d-e06f3e01a0d3 tempest-AttachVolumeShelveTestJSON-808950028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8469b3-a748-4497-a52d-922ac1c4dbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-22dccc12-41cb-4419-994d-e06f3e01a0d3 tempest-AttachVolumeShelveTestJSON-808950028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8469b3-a748-4497-a52d-922ac1c4dbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec95d7c6-af6b-4600-a2e9-db20a82a7590', 'volume_name': 'volume-ec95d7c6-af6b-4600-a2e9-db20a82a7590', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-22dccc12-41cb-4419-994d-e06f3e01a0d3 tempest-AttachVolumeShelveTestJSON-808950028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7076cf7-d591-46ee-9dd2-a4c9ce3493f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-22dccc12-41cb-4419-994d-e06f3e01a0d3 tempest-AttachVolumeShelveTestJSON-808950028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7076cf7-d591-46ee-9dd2-a4c9ce3493f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-22dccc12-41cb-4419-994d-e06f3e01a0d3 tempest-AttachVolumeShelveTestJSON-808950028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b6c3988-8d58-48b1-acf9-29cf9106db4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:53 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-22dccc12-41cb-4419-994d-e06f3e01a0d3 tempest-AttachVolumeShelveTestJSON-808950028 None] Volume ec95d7c6-af6b-4600-a2e9-db20a82a7590: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec95d7c6-af6b-4600-a2e9-db20a82a7590', 'volume_size': 1} Jun 02 03:22:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-22dccc12-41cb-4419-994d-e06f3e01a0d3 tempest-AttachVolumeShelveTestJSON-808950028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:22:53 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-9a3515d6-4078-4c50-a6de-658bd3c16b31 tempest-GroupSnapshotsTest-408043841 None] Update group completed successfully. Jun 02 03:22:53 devstack sudo[94349]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3807e198-7d75-48d8-80d0-336f5d2810be tempest-VolumesActionsTest-389113780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-baf7be63-f6e7-4d6c-8381-2ed7e4204ad1 1073741824" returned: 0 in 0.976s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3807e198-7d75-48d8-80d0-336f5d2810be tempest-VolumesActionsTest-389113780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-baf7be63-f6e7-4d6c-8381-2ed7e4204ad1 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:53 devstack sudo[94355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-baf7be63-f6e7-4d6c-8381-2ed7e4204ad1 Jun 02 03:22:53 devstack sudo[94355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:54 devstack sudo[94355]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3807e198-7d75-48d8-80d0-336f5d2810be tempest-VolumesActionsTest-389113780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-baf7be63-f6e7-4d6c-8381-2ed7e4204ad1" returned: 0 in 0.581s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:54 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3807e198-7d75-48d8-80d0-336f5d2810be tempest-VolumesActionsTest-389113780 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:22:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3807e198-7d75-48d8-80d0-336f5d2810be tempest-VolumesActionsTest-389113780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:22:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-22dccc12-41cb-4419-994d-e06f3e01a0d3 tempest-AttachVolumeShelveTestJSON-808950028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.919s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:22:54 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-22dccc12-41cb-4419-994d-e06f3e01a0d3 tempest-AttachVolumeShelveTestJSON-808950028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1439733990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec95d7c6-af6b-4600-a2e9-db20a82a7590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4722eeb492a4822995665c03077ee81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:22:53Z,use_quota=True,user_id='99dc2db648784502ba37a054d0331947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:22:54 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-22dccc12-41cb-4419-994d-e06f3e01a0d3 tempest-AttachVolumeShelveTestJSON-808950028 None] Creating volume ec95d7c6-af6b-4600-a2e9-db20a82a7590 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:22:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-22dccc12-41cb-4419-994d-e06f3e01a0d3 tempest-AttachVolumeShelveTestJSON-808950028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:22:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-22dccc12-41cb-4419-994d-e06f3e01a0d3 tempest-AttachVolumeShelveTestJSON-808950028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:22:54 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-22dccc12-41cb-4419-994d-e06f3e01a0d3 tempest-AttachVolumeShelveTestJSON-808950028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:22:54 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-22dccc12-41cb-4419-994d-e06f3e01a0d3 tempest-AttachVolumeShelveTestJSON-808950028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:22:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-22dccc12-41cb-4419-994d-e06f3e01a0d3 tempest-AttachVolumeShelveTestJSON-808950028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:22:54 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-22dccc12-41cb-4419-994d-e06f3e01a0d3 tempest-AttachVolumeShelveTestJSON-808950028 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:22:54 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-22dccc12-41cb-4419-994d-e06f3e01a0d3 tempest-AttachVolumeShelveTestJSON-808950028 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:22:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-22dccc12-41cb-4419-994d-e06f3e01a0d3 tempest-AttachVolumeShelveTestJSON-808950028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ec95d7c6-af6b-4600-a2e9-db20a82a7590 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:54 devstack sudo[94358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ec95d7c6-af6b-4600-a2e9-db20a82a7590 1073741824 Jun 02 03:22:54 devstack sudo[94358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:54 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3807e198-7d75-48d8-80d0-336f5d2810be tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e4dc2c5-73b4-4177-a618-399300b42bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baf7be63-f6e7-4d6c-8381-2ed7e4204ad1', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:54 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3807e198-7d75-48d8-80d0-336f5d2810be tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fd613f6-b291-4f1d-8f9d-81339111bc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:54 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-3807e198-7d75-48d8-80d0-336f5d2810be tempest-VolumesActionsTest-389113780 None] Volume volume-baf7be63-f6e7-4d6c-8381-2ed7e4204ad1 (baf7be63-f6e7-4d6c-8381-2ed7e4204ad1): created successfully Jun 02 03:22:54 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3807e198-7d75-48d8-80d0-336f5d2810be tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fd613f6-b291-4f1d-8f9d-81339111bc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:54 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3807e198-7d75-48d8-80d0-336f5d2810be tempest-VolumesActionsTest-389113780 None] Flow 'volume_create_manager' (8ef42a51-5bcd-4524-b83c-56c7638dd269) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:22:54 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-3807e198-7d75-48d8-80d0-336f5d2810be tempest-VolumesActionsTest-389113780 None] Created volume successfully. Jun 02 03:22:54 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-2a26e298-1d6d-427e-805f-7c520416a033 tempest-GroupSnapshotsTest-408043841 None] Update group completed successfully. Jun 02 03:22:54 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-24a22e94-c1ed-49dc-b775-064d3c29a429 tempest-VolumesActionsTest-2009514611 None] Acquiring lock "cinder-baf7be63-f6e7-4d6c-8381-2ed7e4204ad1-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:22:54 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-24a22e94-c1ed-49dc-b775-064d3c29a429 tempest-VolumesActionsTest-2009514611 None] Lock "cinder-baf7be63-f6e7-4d6c-8381-2ed7e4204ad1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:22:54 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-24a22e94-c1ed-49dc-b775-064d3c29a429 tempest-VolumesActionsTest-2009514611 None] Acquiring lock "cinder-quobyte-baf7be63-f6e7-4d6c-8381-2ed7e4204ad1" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:22:54 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-24a22e94-c1ed-49dc-b775-064d3c29a429 tempest-VolumesActionsTest-2009514611 None] Lock "cinder-quobyte-baf7be63-f6e7-4d6c-8381-2ed7e4204ad1" acquired by "delete_volume" :: waited 0.021s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:22:54 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df734a4-2b5d-4dcc-99cd-733726b59446]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:22:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-24a22e94-c1ed-49dc-b775-064d3c29a429 tempest-VolumesActionsTest-2009514611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-baf7be63-f6e7-4d6c-8381-2ed7e4204ad1 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:54 devstack sudo[94363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-baf7be63-f6e7-4d6c-8381-2ed7e4204ad1 Jun 02 03:22:54 devstack sudo[94363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:54 devstack sudo[94358]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-22dccc12-41cb-4419-994d-e06f3e01a0d3 tempest-AttachVolumeShelveTestJSON-808950028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ec95d7c6-af6b-4600-a2e9-db20a82a7590 1073741824" returned: 0 in 0.893s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-22dccc12-41cb-4419-994d-e06f3e01a0d3 tempest-AttachVolumeShelveTestJSON-808950028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ec95d7c6-af6b-4600-a2e9-db20a82a7590 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:55 devstack sudo[94365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ec95d7c6-af6b-4600-a2e9-db20a82a7590 Jun 02 03:22:55 devstack sudo[94365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:55 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-3352b3f9-035c-49f8-b9de-048276c746ff tempest-GroupSnapshotsTest-408043841 None] Update group completed successfully. Jun 02 03:22:55 devstack sudo[94363]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-24a22e94-c1ed-49dc-b775-064d3c29a429 tempest-VolumesActionsTest-2009514611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-baf7be63-f6e7-4d6c-8381-2ed7e4204ad1" returned: 0 in 0.821s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-24a22e94-c1ed-49dc-b775-064d3c29a429 tempest-VolumesActionsTest-2009514611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-baf7be63-f6e7-4d6c-8381-2ed7e4204ad1 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:55 devstack sudo[94371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-baf7be63-f6e7-4d6c-8381-2ed7e4204ad1 Jun 02 03:22:55 devstack sudo[94371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:55 devstack sudo[94365]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-22dccc12-41cb-4419-994d-e06f3e01a0d3 tempest-AttachVolumeShelveTestJSON-808950028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ec95d7c6-af6b-4600-a2e9-db20a82a7590" returned: 0 in 0.719s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:55 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-22dccc12-41cb-4419-994d-e06f3e01a0d3 tempest-AttachVolumeShelveTestJSON-808950028 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:22:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-22dccc12-41cb-4419-994d-e06f3e01a0d3 tempest-AttachVolumeShelveTestJSON-808950028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:22:55 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-22dccc12-41cb-4419-994d-e06f3e01a0d3 tempest-AttachVolumeShelveTestJSON-808950028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b6c3988-8d58-48b1-acf9-29cf9106db4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec95d7c6-af6b-4600-a2e9-db20a82a7590', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:55 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-22dccc12-41cb-4419-994d-e06f3e01a0d3 tempest-AttachVolumeShelveTestJSON-808950028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9d989df-79a7-4b45-9dfd-eecb85651d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:55 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-22dccc12-41cb-4419-994d-e06f3e01a0d3 tempest-AttachVolumeShelveTestJSON-808950028 None] Volume volume-ec95d7c6-af6b-4600-a2e9-db20a82a7590 (ec95d7c6-af6b-4600-a2e9-db20a82a7590): created successfully Jun 02 03:22:55 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-22dccc12-41cb-4419-994d-e06f3e01a0d3 tempest-AttachVolumeShelveTestJSON-808950028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9d989df-79a7-4b45-9dfd-eecb85651d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:55 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-22dccc12-41cb-4419-994d-e06f3e01a0d3 tempest-AttachVolumeShelveTestJSON-808950028 None] Flow 'volume_create_manager' (b6914872-fb78-415c-9978-9ec7639c3a81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:22:55 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-22dccc12-41cb-4419-994d-e06f3e01a0d3 tempest-AttachVolumeShelveTestJSON-808950028 None] Created volume successfully. Jun 02 03:22:56 devstack sudo[94371]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-24a22e94-c1ed-49dc-b775-064d3c29a429 tempest-VolumesActionsTest-2009514611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-baf7be63-f6e7-4d6c-8381-2ed7e4204ad1" returned: 0 in 0.641s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:56 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-24a22e94-c1ed-49dc-b775-064d3c29a429 tempest-VolumesActionsTest-2009514611 None] Lock "cinder-quobyte-baf7be63-f6e7-4d6c-8381-2ed7e4204ad1" released by "delete_volume" :: held 1.517s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:22:56 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-24a22e94-c1ed-49dc-b775-064d3c29a429 tempest-VolumesActionsTest-2009514611 None] Created reservations ['d81293fe-db7b-4867-aaa2-b4414ab951ac', '9f7c290f-a40d-4096-8282-40eade367e22', 'f75afc4c-5745-4dc9-ac1e-d71e32d649f9', 'd08027ce-947a-4766-bef1-f8adc8dc5a42'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:22:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-24a22e94-c1ed-49dc-b775-064d3c29a429 tempest-VolumesActionsTest-2009514611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:22:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-24a22e94-c1ed-49dc-b775-064d3c29a429 tempest-VolumesActionsTest-2009514611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:22:56 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-24a22e94-c1ed-49dc-b775-064d3c29a429 tempest-VolumesActionsTest-2009514611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:22:56 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-24a22e94-c1ed-49dc-b775-064d3c29a429 tempest-VolumesActionsTest-2009514611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:22:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-24a22e94-c1ed-49dc-b775-064d3c29a429 tempest-VolumesActionsTest-2009514611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:22:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-24a22e94-c1ed-49dc-b775-064d3c29a429 tempest-VolumesActionsTest-2009514611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:56 devstack sudo[94379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:22:56 devstack sudo[94379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:57 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] GroupSnapshot a1a793d4-a7c3-4506-a868-6b3f9d6c877f: creating. Jun 02 03:22:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] Group snapshot a1a793d4-a7c3-4506-a868-6b3f9d6c877f: creating. {{(pid=86431) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Jun 02 03:22:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:22:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:22:57 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] Creating offline snapshot 4f5b9488-e882-4087-8d59-6c87da79868d of volume c5afdd75-2490-4c49-b629-38428fa2b589 {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:22:57 devstack sudo[94379]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-24a22e94-c1ed-49dc-b775-064d3c29a429 tempest-VolumesActionsTest-2009514611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.876s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:57 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-24a22e94-c1ed-49dc-b775-064d3c29a429 tempest-VolumesActionsTest-2009514611 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:22:57 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf437f5-fbae-4bb7-8068-9fa9a7866f5a]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:22:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:57 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-24a22e94-c1ed-49dc-b775-064d3c29a429 tempest-VolumesActionsTest-2009514611 None] Deleted volume successfully. Jun 02 03:22:57 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-24a22e94-c1ed-49dc-b775-064d3c29a429 tempest-VolumesActionsTest-2009514611 None] Lock "cinder-baf7be63-f6e7-4d6c-8381-2ed7e4204ad1-delete_volume" released by "delete_volume" :: held 2.658s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:22:57 devstack sudo[94382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589 Jun 02 03:22:57 devstack sudo[94382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:57 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-3881274e-0fbf-4f75-90ec-f5204e69aea3 tempest-VolumesActionsTest-389113780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:22:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3881274e-0fbf-4f75-90ec-f5204e69aea3 tempest-VolumesActionsTest-389113780 None] Flow 'volume_create_manager' (87c3f4ba-27a8-43a8-b9da-349408622275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:22:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3881274e-0fbf-4f75-90ec-f5204e69aea3 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb7e9383-1b81-4313-9f5b-fbf7f5c28f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3881274e-0fbf-4f75-90ec-f5204e69aea3 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb7e9383-1b81-4313-9f5b-fbf7f5c28f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-223480638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4de75a6-836f-44ed-8537-ecd2ef8efba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3d1ef1e06f442e3b9ab1198a0dd3cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:22:58Z,use_quota=True,user_id='80d8ba02482c43cb8502ce327f3ec5d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3881274e-0fbf-4f75-90ec-f5204e69aea3 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b73fdb-f20d-4448-8ed3-18eb24c1791a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3881274e-0fbf-4f75-90ec-f5204e69aea3 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b73fdb-f20d-4448-8ed3-18eb24c1791a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3881274e-0fbf-4f75-90ec-f5204e69aea3 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (845ce540-91e7-48e4-b72c-2e0a2d649199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3881274e-0fbf-4f75-90ec-f5204e69aea3 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (845ce540-91e7-48e4-b72c-2e0a2d649199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4de75a6-836f-44ed-8537-ecd2ef8efba3', 'volume_name': 'volume-d4de75a6-836f-44ed-8537-ecd2ef8efba3', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3881274e-0fbf-4f75-90ec-f5204e69aea3 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac636e9-3f60-4e0f-bfaf-fdea62ee9896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3881274e-0fbf-4f75-90ec-f5204e69aea3 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac636e9-3f60-4e0f-bfaf-fdea62ee9896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:22:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3881274e-0fbf-4f75-90ec-f5204e69aea3 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9ab6788-8e03-48e7-a2a5-e3b648815358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:22:57 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-3881274e-0fbf-4f75-90ec-f5204e69aea3 tempest-VolumesActionsTest-389113780 None] Volume d4de75a6-836f-44ed-8537-ecd2ef8efba3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4de75a6-836f-44ed-8537-ecd2ef8efba3', 'volume_size': 1} Jun 02 03:22:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3881274e-0fbf-4f75-90ec-f5204e69aea3 tempest-VolumesActionsTest-389113780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:22:58 devstack sudo[94382]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589" returned: 0 in 0.983s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589.4f5b9488-e882-4087-8d59-6c87da79868d 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:58 devstack sudo[94387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589.4f5b9488-e882-4087-8d59-6c87da79868d 1G Jun 02 03:22:58 devstack sudo[94387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:59 devstack sudo[94387]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589.4f5b9488-e882-4087-8d59-6c87da79868d 1G" returned: 0 in 0.829s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5afdd75-2490-4c49-b629-38428fa2b589 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589.4f5b9488-e882-4087-8d59-6c87da79868d {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:59 devstack sudo[94392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5afdd75-2490-4c49-b629-38428fa2b589 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589.4f5b9488-e882-4087-8d59-6c87da79868d Jun 02 03:22:59 devstack sudo[94392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:22:59 devstack sudo[94392]: pam_unix(sudo:session): session closed for user root Jun 02 03:22:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5afdd75-2490-4c49-b629-38428fa2b589 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589.4f5b9488-e882-4087-8d59-6c87da79868d" returned: 0 in 0.850s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:22:59 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589.4f5b9488-e882-4087-8d59-6c87da79868d is being set with open permissions: ugo+rw: NotImplementedError Jun 02 03:22:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589.4f5b9488-e882-4087-8d59-6c87da79868d {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:22:59 devstack sudo[94451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589.4f5b9488-e882-4087-8d59-6c87da79868d Jun 02 03:22:59 devstack sudo[94451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:00 devstack sudo[94451]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589.4f5b9488-e882-4087-8d59-6c87da79868d" returned: 0 in 0.615s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:00 devstack sudo[94456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589.info Jun 02 03:23:00 devstack sudo[94456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:01 devstack sudo[94456]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589.info" returned: 0 in 0.631s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:01 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589.info is being set with open permissions: ugo+rw: NotImplementedError Jun 02 03:23:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:01 devstack sudo[94470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589.info Jun 02 03:23:01 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:01 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589.info" returned: 0 in 0.605s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.636s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:23:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:23:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:23:01 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] Creating offline snapshot e798c232-7cbc-445b-8e00-cc0786dc8b31 of volume f038ab4a-889c-40de-808a-1383bfee2f20 {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:23:01 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[8568638d-a5a5-4df0-9714-8166bd8541b2]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:23:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:01 devstack sudo[94474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20 Jun 02 03:23:01 devstack sudo[94474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:02 devstack sudo[94474]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20" returned: 0 in 0.736s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20.e798c232-7cbc-445b-8e00-cc0786dc8b31 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:02 devstack sudo[94488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20.e798c232-7cbc-445b-8e00-cc0786dc8b31 1G Jun 02 03:23:02 devstack sudo[94488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:03 devstack sudo[94488]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20.e798c232-7cbc-445b-8e00-cc0786dc8b31 1G" returned: 0 in 0.816s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f038ab4a-889c-40de-808a-1383bfee2f20 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20.e798c232-7cbc-445b-8e00-cc0786dc8b31 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:03 devstack sudo[94498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f038ab4a-889c-40de-808a-1383bfee2f20 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20.e798c232-7cbc-445b-8e00-cc0786dc8b31 Jun 02 03:23:03 devstack sudo[94498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:04 devstack sudo[94498]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f038ab4a-889c-40de-808a-1383bfee2f20 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20.e798c232-7cbc-445b-8e00-cc0786dc8b31" returned: 0 in 0.710s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:04 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20.e798c232-7cbc-445b-8e00-cc0786dc8b31 is being set with open permissions: ugo+rw: NotImplementedError Jun 02 03:23:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20.e798c232-7cbc-445b-8e00-cc0786dc8b31 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:04 devstack sudo[94504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20.e798c232-7cbc-445b-8e00-cc0786dc8b31 Jun 02 03:23:04 devstack sudo[94504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:04 devstack sudo[94504]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20.e798c232-7cbc-445b-8e00-cc0786dc8b31" returned: 0 in 0.715s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:04 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20.info Jun 02 03:23:04 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:05 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20.info" returned: 0 in 0.852s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:05 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20.info is being set with open permissions: ugo+rw: NotImplementedError Jun 02 03:23:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:05 devstack sudo[94510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20.info Jun 02 03:23:05 devstack sudo[94510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:06 devstack sudo[94510]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20.info" returned: 0 in 0.761s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.684s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:23:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3881274e-0fbf-4f75-90ec-f5204e69aea3 tempest-VolumesActionsTest-389113780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.597s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:23:06 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3881274e-0fbf-4f75-90ec-f5204e69aea3 tempest-VolumesActionsTest-389113780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-223480638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4de75a6-836f-44ed-8537-ecd2ef8efba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3d1ef1e06f442e3b9ab1198a0dd3cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:22:58Z,use_quota=True,user_id='80d8ba02482c43cb8502ce327f3ec5d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:23:06 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-3881274e-0fbf-4f75-90ec-f5204e69aea3 tempest-VolumesActionsTest-389113780 None] Creating volume d4de75a6-836f-44ed-8537-ecd2ef8efba3 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:23:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3881274e-0fbf-4f75-90ec-f5204e69aea3 tempest-VolumesActionsTest-389113780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:23:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3881274e-0fbf-4f75-90ec-f5204e69aea3 tempest-VolumesActionsTest-389113780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:23:06 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3881274e-0fbf-4f75-90ec-f5204e69aea3 tempest-VolumesActionsTest-389113780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:23:06 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3881274e-0fbf-4f75-90ec-f5204e69aea3 tempest-VolumesActionsTest-389113780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:23:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3881274e-0fbf-4f75-90ec-f5204e69aea3 tempest-VolumesActionsTest-389113780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:23:06 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3881274e-0fbf-4f75-90ec-f5204e69aea3 tempest-VolumesActionsTest-389113780 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:23:06 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-3881274e-0fbf-4f75-90ec-f5204e69aea3 tempest-VolumesActionsTest-389113780 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:23:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3881274e-0fbf-4f75-90ec-f5204e69aea3 tempest-VolumesActionsTest-389113780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d4de75a6-836f-44ed-8537-ecd2ef8efba3 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:06 devstack sudo[94513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d4de75a6-836f-44ed-8537-ecd2ef8efba3 1073741824 Jun 02 03:23:06 devstack sudo[94513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:06 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-1ad8fb9d-3edc-4974-8a98-1f42b392312c tempest-GroupSnapshotsTest-408043841 None] group_snapshot a1a793d4-a7c3-4506-a868-6b3f9d6c877f: created successfully Jun 02 03:23:07 devstack sudo[94513]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3881274e-0fbf-4f75-90ec-f5204e69aea3 tempest-VolumesActionsTest-389113780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d4de75a6-836f-44ed-8537-ecd2ef8efba3 1073741824" returned: 0 in 0.830s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3881274e-0fbf-4f75-90ec-f5204e69aea3 tempest-VolumesActionsTest-389113780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d4de75a6-836f-44ed-8537-ecd2ef8efba3 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:07 devstack sudo[94518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d4de75a6-836f-44ed-8537-ecd2ef8efba3 Jun 02 03:23:07 devstack sudo[94518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:07 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] group_snapshot a1a793d4-a7c3-4506-a868-6b3f9d6c877f: deleting Jun 02 03:23:07 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] group_snapshot a1a793d4-a7c3-4506-a868-6b3f9d6c877f: deleting {{(pid=86431) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Jun 02 03:23:07 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] Acquiring lock "cinder-quobyte-c5afdd75-2490-4c49-b629-38428fa2b589" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:23:07 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] Lock "cinder-quobyte-c5afdd75-2490-4c49-b629-38428fa2b589" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:23:07 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] Acquiring lock "cinder-quobyte-4f5b9488-e882-4087-8d59-6c87da79868d" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:23:07 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] Lock "cinder-quobyte-4f5b9488-e882-4087-8d59-6c87da79868d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:23:07 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] Deleting offline snapshot 4f5b9488-e882-4087-8d59-6c87da79868d of volume c5afdd75-2490-4c49-b629-38428fa2b589 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:23:07 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] snapshot_file for this snap is: volume-c5afdd75-2490-4c49-b629-38428fa2b589.4f5b9488-e882-4087-8d59-6c87da79868d {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:23:07 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ea6349-0e95-4290-bad6-3e3f5acae930]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:23:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589.4f5b9488-e882-4087-8d59-6c87da79868d {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:08 devstack sudo[94518]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3881274e-0fbf-4f75-90ec-f5204e69aea3 tempest-VolumesActionsTest-389113780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d4de75a6-836f-44ed-8537-ecd2ef8efba3" returned: 0 in 0.649s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:08 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3881274e-0fbf-4f75-90ec-f5204e69aea3 tempest-VolumesActionsTest-389113780 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:23:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3881274e-0fbf-4f75-90ec-f5204e69aea3 tempest-VolumesActionsTest-389113780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:23:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3881274e-0fbf-4f75-90ec-f5204e69aea3 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9ab6788-8e03-48e7-a2a5-e3b648815358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4de75a6-836f-44ed-8537-ecd2ef8efba3', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3881274e-0fbf-4f75-90ec-f5204e69aea3 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ec5716-03a3-41a5-9eac-fccceea103a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:08 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-3881274e-0fbf-4f75-90ec-f5204e69aea3 tempest-VolumesActionsTest-389113780 None] Volume volume-d4de75a6-836f-44ed-8537-ecd2ef8efba3 (d4de75a6-836f-44ed-8537-ecd2ef8efba3): created successfully Jun 02 03:23:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3881274e-0fbf-4f75-90ec-f5204e69aea3 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ec5716-03a3-41a5-9eac-fccceea103a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3881274e-0fbf-4f75-90ec-f5204e69aea3 tempest-VolumesActionsTest-389113780 None] Flow 'volume_create_manager' (87c3f4ba-27a8-43a8-b9da-349408622275) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:23:08 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-3881274e-0fbf-4f75-90ec-f5204e69aea3 tempest-VolumesActionsTest-389113780 None] Created volume successfully. Jun 02 03:23:08 devstack sudo[94521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589.4f5b9488-e882-4087-8d59-6c87da79868d Jun 02 03:23:08 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:08 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-72d6af65-2afe-4847-8ca4-f7822a7bf533 tempest-VolumesActionsTest-2009514611 None] Acquiring lock "cinder-d4de75a6-836f-44ed-8537-ecd2ef8efba3-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:23:08 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-72d6af65-2afe-4847-8ca4-f7822a7bf533 tempest-VolumesActionsTest-2009514611 None] Lock "cinder-d4de75a6-836f-44ed-8537-ecd2ef8efba3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:23:08 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-72d6af65-2afe-4847-8ca4-f7822a7bf533 tempest-VolumesActionsTest-2009514611 None] Acquiring lock "cinder-quobyte-d4de75a6-836f-44ed-8537-ecd2ef8efba3" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:23:08 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-72d6af65-2afe-4847-8ca4-f7822a7bf533 tempest-VolumesActionsTest-2009514611 None] Lock "cinder-quobyte-d4de75a6-836f-44ed-8537-ecd2ef8efba3" acquired by "delete_volume" :: waited 0.021s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:23:08 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db94108-17ca-4828-bfbc-debc2f9a1a4f]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:23:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-72d6af65-2afe-4847-8ca4-f7822a7bf533 tempest-VolumesActionsTest-2009514611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d4de75a6-836f-44ed-8537-ecd2ef8efba3 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:08 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589.4f5b9488-e882-4087-8d59-6c87da79868d" returned: 0 in 0.784s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:08 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5afdd75-2490-4c49-b629-38428fa2b589(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:23:08 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ff7130-5631-4e1f-a5b5-c773099e5d52]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:23:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:08 devstack sudo[94526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d4de75a6-836f-44ed-8537-ecd2ef8efba3 Jun 02 03:23:08 devstack sudo[94526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:08 devstack sudo[94527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589 Jun 02 03:23:08 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:09 devstack sudo[94526]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-72d6af65-2afe-4847-8ca4-f7822a7bf533 tempest-VolumesActionsTest-2009514611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d4de75a6-836f-44ed-8537-ecd2ef8efba3" returned: 0 in 0.785s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-72d6af65-2afe-4847-8ca4-f7822a7bf533 tempest-VolumesActionsTest-2009514611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d4de75a6-836f-44ed-8537-ecd2ef8efba3 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:09 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:23:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:23:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:23:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:23:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:23:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:23:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:09 devstack sudo[94538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d4de75a6-836f-44ed-8537-ecd2ef8efba3 Jun 02 03:23:09 devstack sudo[94538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:09 devstack sudo[94540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:23:09 devstack sudo[94540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:09 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589" returned: 0 in 0.806s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589.4f5b9488-e882-4087-8d59-6c87da79868d {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:09 devstack sudo[94542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589.4f5b9488-e882-4087-8d59-6c87da79868d Jun 02 03:23:09 devstack sudo[94542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:10 devstack sudo[94538]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-72d6af65-2afe-4847-8ca4-f7822a7bf533 tempest-VolumesActionsTest-2009514611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d4de75a6-836f-44ed-8537-ecd2ef8efba3" returned: 0 in 0.714s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:10 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-72d6af65-2afe-4847-8ca4-f7822a7bf533 tempest-VolumesActionsTest-2009514611 None] Lock "cinder-quobyte-d4de75a6-836f-44ed-8537-ecd2ef8efba3" released by "delete_volume" :: held 1.561s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:23:10 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-72d6af65-2afe-4847-8ca4-f7822a7bf533 tempest-VolumesActionsTest-2009514611 None] Created reservations ['10a39c8a-4b8d-4ecd-b28e-e6ddc0f4e29b', '5294ad71-2199-4e74-a155-57369ef847a7', 'f1c82676-e875-4b66-83fe-edbd1b930410', '02e033dd-612a-4f13-b763-26a8a8c9150e'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:23:10 devstack sudo[94540]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.829s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:10 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:23:10 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager._thread_info {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:23:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread count: 8 {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 02 03:23:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread info: [<_MainThread(MainThread, started 138618128814208)>, , , , , , , ] {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 02 03:23:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-72d6af65-2afe-4847-8ca4-f7822a7bf533 tempest-VolumesActionsTest-2009514611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:23:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-72d6af65-2afe-4847-8ca4-f7822a7bf533 tempest-VolumesActionsTest-2009514611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:23:10 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-72d6af65-2afe-4847-8ca4-f7822a7bf533 tempest-VolumesActionsTest-2009514611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:23:10 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-72d6af65-2afe-4847-8ca4-f7822a7bf533 tempest-VolumesActionsTest-2009514611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:23:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-72d6af65-2afe-4847-8ca4-f7822a7bf533 tempest-VolumesActionsTest-2009514611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:23:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-72d6af65-2afe-4847-8ca4-f7822a7bf533 tempest-VolumesActionsTest-2009514611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:10 devstack sudo[94549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:23:10 devstack sudo[94549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:10 devstack sudo[94542]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589.4f5b9488-e882-4087-8d59-6c87da79868d" returned: 0 in 0.837s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589.4f5b9488-e882-4087-8d59-6c87da79868d {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:10 devstack sudo[94551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589.4f5b9488-e882-4087-8d59-6c87da79868d Jun 02 03:23:10 devstack sudo[94551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:11 devstack sudo[94551]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:11 devstack sudo[94549]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589.4f5b9488-e882-4087-8d59-6c87da79868d" returned: 0 in 0.623s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-72d6af65-2afe-4847-8ca4-f7822a7bf533 tempest-VolumesActionsTest-2009514611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.703s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-72d6af65-2afe-4847-8ca4-f7822a7bf533 tempest-VolumesActionsTest-2009514611 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] Lock "cinder-quobyte-4f5b9488-e882-4087-8d59-6c87da79868d" released by "_delete_snapshot" :: held 3.174s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:23:11 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-72d6af65-2afe-4847-8ca4-f7822a7bf533 tempest-VolumesActionsTest-2009514611 None] Deleted volume successfully. Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] Lock "cinder-quobyte-c5afdd75-2490-4c49-b629-38428fa2b589" released by "delete_snapshot" :: held 3.208s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-72d6af65-2afe-4847-8ca4-f7822a7bf533 tempest-VolumesActionsTest-2009514611 None] Lock "cinder-d4de75a6-836f-44ed-8537-ecd2ef8efba3-delete_volume" released by "delete_volume" :: held 2.558s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] Acquiring lock "cinder-quobyte-f038ab4a-889c-40de-808a-1383bfee2f20" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] Lock "cinder-quobyte-f038ab4a-889c-40de-808a-1383bfee2f20" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] Acquiring lock "cinder-quobyte-e798c232-7cbc-445b-8e00-cc0786dc8b31" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] Lock "cinder-quobyte-e798c232-7cbc-445b-8e00-cc0786dc8b31" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] Deleting offline snapshot e798c232-7cbc-445b-8e00-cc0786dc8b31 of volume f038ab4a-889c-40de-808a-1383bfee2f20 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] snapshot_file for this snap is: volume-f038ab4a-889c-40de-808a-1383bfee2f20.e798c232-7cbc-445b-8e00-cc0786dc8b31 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc281e8c-21d0-49be-bd59-4050ab73dc89]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20.e798c232-7cbc-445b-8e00-cc0786dc8b31 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfb9d4d2-5e6b-4f86-8fa7-3b1ca353ad39 tempest-VolumesActionsTest-389113780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:23:11 devstack sudo[94557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20.e798c232-7cbc-445b-8e00-cc0786dc8b31 Jun 02 03:23:11 devstack sudo[94557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-cfb9d4d2-5e6b-4f86-8fa7-3b1ca353ad39 tempest-VolumesActionsTest-389113780 None] Flow 'volume_create_manager' (2f2908ef-1146-45ef-8ecc-004c402f99f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-cfb9d4d2-5e6b-4f86-8fa7-3b1ca353ad39 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d7f7e6-1e35-47a9-b41b-1fff75138275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-cfb9d4d2-5e6b-4f86-8fa7-3b1ca353ad39 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d7f7e6-1e35-47a9-b41b-1fff75138275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1288590827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=123b90e8-cf0f-4d01-a46d-fea32fdf8160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3d1ef1e06f442e3b9ab1198a0dd3cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:23:11Z,use_quota=True,user_id='80d8ba02482c43cb8502ce327f3ec5d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-cfb9d4d2-5e6b-4f86-8fa7-3b1ca353ad39 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88537a5c-932d-42cb-8aab-037d55088777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-cfb9d4d2-5e6b-4f86-8fa7-3b1ca353ad39 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88537a5c-932d-42cb-8aab-037d55088777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-cfb9d4d2-5e6b-4f86-8fa7-3b1ca353ad39 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b767f742-0af2-4161-a320-59b5452ade26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-cfb9d4d2-5e6b-4f86-8fa7-3b1ca353ad39 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b767f742-0af2-4161-a320-59b5452ade26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '123b90e8-cf0f-4d01-a46d-fea32fdf8160', 'volume_name': 'volume-123b90e8-cf0f-4d01-a46d-fea32fdf8160', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-cfb9d4d2-5e6b-4f86-8fa7-3b1ca353ad39 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d03fff4d-de7b-42d2-b94b-a1c26648b214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-cfb9d4d2-5e6b-4f86-8fa7-3b1ca353ad39 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d03fff4d-de7b-42d2-b94b-a1c26648b214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-cfb9d4d2-5e6b-4f86-8fa7-3b1ca353ad39 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92623cfb-b66d-4337-ba88-3cf53d746656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:11 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-cfb9d4d2-5e6b-4f86-8fa7-3b1ca353ad39 tempest-VolumesActionsTest-389113780 None] Volume 123b90e8-cf0f-4d01-a46d-fea32fdf8160: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-123b90e8-cf0f-4d01-a46d-fea32fdf8160', 'volume_size': 1} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-cfb9d4d2-5e6b-4f86-8fa7-3b1ca353ad39 tempest-VolumesActionsTest-389113780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-cfb9d4d2-5e6b-4f86-8fa7-3b1ca353ad39 tempest-VolumesActionsTest-389113780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-cfb9d4d2-5e6b-4f86-8fa7-3b1ca353ad39 tempest-VolumesActionsTest-389113780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1288590827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=123b90e8-cf0f-4d01-a46d-fea32fdf8160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3d1ef1e06f442e3b9ab1198a0dd3cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:23:11Z,use_quota=True,user_id='80d8ba02482c43cb8502ce327f3ec5d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-cfb9d4d2-5e6b-4f86-8fa7-3b1ca353ad39 tempest-VolumesActionsTest-389113780 None] Creating volume 123b90e8-cf0f-4d01-a46d-fea32fdf8160 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-cfb9d4d2-5e6b-4f86-8fa7-3b1ca353ad39 tempest-VolumesActionsTest-389113780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-cfb9d4d2-5e6b-4f86-8fa7-3b1ca353ad39 tempest-VolumesActionsTest-389113780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-cfb9d4d2-5e6b-4f86-8fa7-3b1ca353ad39 tempest-VolumesActionsTest-389113780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-cfb9d4d2-5e6b-4f86-8fa7-3b1ca353ad39 tempest-VolumesActionsTest-389113780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-cfb9d4d2-5e6b-4f86-8fa7-3b1ca353ad39 tempest-VolumesActionsTest-389113780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-cfb9d4d2-5e6b-4f86-8fa7-3b1ca353ad39 tempest-VolumesActionsTest-389113780 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:23:11 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-cfb9d4d2-5e6b-4f86-8fa7-3b1ca353ad39 tempest-VolumesActionsTest-389113780 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cfb9d4d2-5e6b-4f86-8fa7-3b1ca353ad39 tempest-VolumesActionsTest-389113780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-123b90e8-cf0f-4d01-a46d-fea32fdf8160 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:11 devstack sudo[94560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-123b90e8-cf0f-4d01-a46d-fea32fdf8160 1073741824 Jun 02 03:23:11 devstack sudo[94560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ec0c491-e4e0-42b0-af87-fa49ebb848fd tempest-AttachVolumeNegativeTest-1165991087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2ec0c491-e4e0-42b0-af87-fa49ebb848fd tempest-AttachVolumeNegativeTest-1165991087 None] Flow 'volume_create_manager' (186787c8-241e-4486-aa0b-308d35ca0a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2ec0c491-e4e0-42b0-af87-fa49ebb848fd tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fced593d-3172-4db3-a9d5-0719ed725d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2ec0c491-e4e0-42b0-af87-fa49ebb848fd tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fced593d-3172-4db3-a9d5-0719ed725d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1826818488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c87359e-b916-4c7d-9d37-76e9e7a68b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b41b7af4a304478994e2e229f097aac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:23:11Z,use_quota=True,user_id='1bd56ed743484b4389ae541fd4268448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2ec0c491-e4e0-42b0-af87-fa49ebb848fd tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e0eff5-06cd-4b81-9a48-ad654ffb658c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2ec0c491-e4e0-42b0-af87-fa49ebb848fd tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e0eff5-06cd-4b81-9a48-ad654ffb658c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2ec0c491-e4e0-42b0-af87-fa49ebb848fd tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf60da42-6ba4-4887-8adc-b8506b3d6ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2ec0c491-e4e0-42b0-af87-fa49ebb848fd tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf60da42-6ba4-4887-8adc-b8506b3d6ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c87359e-b916-4c7d-9d37-76e9e7a68b47', 'volume_name': 'volume-2c87359e-b916-4c7d-9d37-76e9e7a68b47', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2ec0c491-e4e0-42b0-af87-fa49ebb848fd tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be7b18f8-4091-4f06-a5e7-87155fbadb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2ec0c491-e4e0-42b0-af87-fa49ebb848fd tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be7b18f8-4091-4f06-a5e7-87155fbadb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2ec0c491-e4e0-42b0-af87-fa49ebb848fd tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a015511e-4cf5-468b-894f-bf548676046f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:11 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-2ec0c491-e4e0-42b0-af87-fa49ebb848fd tempest-AttachVolumeNegativeTest-1165991087 None] Volume 2c87359e-b916-4c7d-9d37-76e9e7a68b47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c87359e-b916-4c7d-9d37-76e9e7a68b47', 'volume_size': 1} Jun 02 03:23:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2ec0c491-e4e0-42b0-af87-fa49ebb848fd tempest-AttachVolumeNegativeTest-1165991087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:23:12 devstack sudo[94557]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20.e798c232-7cbc-445b-8e00-cc0786dc8b31" returned: 0 in 0.828s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:12 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f038ab4a-889c-40de-808a-1383bfee2f20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:23:12 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee18ba5-0202-4d24-91cd-d9ca9293dfd9]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:23:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:12 devstack sudo[94568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20 Jun 02 03:23:12 devstack sudo[94568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:12 devstack sudo[94560]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cfb9d4d2-5e6b-4f86-8fa7-3b1ca353ad39 tempest-VolumesActionsTest-389113780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-123b90e8-cf0f-4d01-a46d-fea32fdf8160 1073741824" returned: 0 in 0.887s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cfb9d4d2-5e6b-4f86-8fa7-3b1ca353ad39 tempest-VolumesActionsTest-389113780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-123b90e8-cf0f-4d01-a46d-fea32fdf8160 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:12 devstack sudo[94573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-123b90e8-cf0f-4d01-a46d-fea32fdf8160 Jun 02 03:23:12 devstack sudo[94573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:12 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-9c64bfe5-41fb-41db-b504-3b990b5adf5b req-5c1fd3c7-cea3-44af-99af-627c5c596c68 tempest-AttachVolumeShelveTestJSON-808950028 None] No connector for attachment 5b5b262e-b1c3-4d57-a9ec-1e14ceb2c889; skipping storage backend terminate_connection call. {{(pid=86431) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5011}} Jun 02 03:23:12 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-9c64bfe5-41fb-41db-b504-3b990b5adf5b req-5c1fd3c7-cea3-44af-99af-627c5c596c68 tempest-AttachVolumeShelveTestJSON-808950028 None] Deleting attachment 5b5b262e-b1c3-4d57-a9ec-1e14ceb2c889. {{(pid=86431) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 02 03:23:12 devstack sudo[94568]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20" returned: 0 in 0.787s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20.e798c232-7cbc-445b-8e00-cc0786dc8b31 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:12 devstack sudo[94579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20.e798c232-7cbc-445b-8e00-cc0786dc8b31 Jun 02 03:23:12 devstack sudo[94579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:13 devstack sudo[94573]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cfb9d4d2-5e6b-4f86-8fa7-3b1ca353ad39 tempest-VolumesActionsTest-389113780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-123b90e8-cf0f-4d01-a46d-fea32fdf8160" returned: 0 in 0.612s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:13 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-cfb9d4d2-5e6b-4f86-8fa7-3b1ca353ad39 tempest-VolumesActionsTest-389113780 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:23:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-cfb9d4d2-5e6b-4f86-8fa7-3b1ca353ad39 tempest-VolumesActionsTest-389113780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:23:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2ec0c491-e4e0-42b0-af87-fa49ebb848fd tempest-AttachVolumeNegativeTest-1165991087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.435s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:23:13 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-2ec0c491-e4e0-42b0-af87-fa49ebb848fd tempest-AttachVolumeNegativeTest-1165991087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1826818488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c87359e-b916-4c7d-9d37-76e9e7a68b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b41b7af4a304478994e2e229f097aac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:23:11Z,use_quota=True,user_id='1bd56ed743484b4389ae541fd4268448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:23:13 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-2ec0c491-e4e0-42b0-af87-fa49ebb848fd tempest-AttachVolumeNegativeTest-1165991087 None] Creating volume 2c87359e-b916-4c7d-9d37-76e9e7a68b47 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:23:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2ec0c491-e4e0-42b0-af87-fa49ebb848fd tempest-AttachVolumeNegativeTest-1165991087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:23:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2ec0c491-e4e0-42b0-af87-fa49ebb848fd tempest-AttachVolumeNegativeTest-1165991087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:23:13 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-2ec0c491-e4e0-42b0-af87-fa49ebb848fd tempest-AttachVolumeNegativeTest-1165991087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:23:13 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-2ec0c491-e4e0-42b0-af87-fa49ebb848fd tempest-AttachVolumeNegativeTest-1165991087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:23:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2ec0c491-e4e0-42b0-af87-fa49ebb848fd tempest-AttachVolumeNegativeTest-1165991087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:23:13 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-2ec0c491-e4e0-42b0-af87-fa49ebb848fd tempest-AttachVolumeNegativeTest-1165991087 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:23:13 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-2ec0c491-e4e0-42b0-af87-fa49ebb848fd tempest-AttachVolumeNegativeTest-1165991087 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:23:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2ec0c491-e4e0-42b0-af87-fa49ebb848fd tempest-AttachVolumeNegativeTest-1165991087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2c87359e-b916-4c7d-9d37-76e9e7a68b47 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-cfb9d4d2-5e6b-4f86-8fa7-3b1ca353ad39 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92623cfb-b66d-4337-ba88-3cf53d746656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-123b90e8-cf0f-4d01-a46d-fea32fdf8160', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:13 devstack sudo[94582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2c87359e-b916-4c7d-9d37-76e9e7a68b47 1073741824 Jun 02 03:23:13 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-cfb9d4d2-5e6b-4f86-8fa7-3b1ca353ad39 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a3febc4-4b3a-4f6c-a58f-aaef7ff22560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:13 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-cfb9d4d2-5e6b-4f86-8fa7-3b1ca353ad39 tempest-VolumesActionsTest-389113780 None] Volume volume-123b90e8-cf0f-4d01-a46d-fea32fdf8160 (123b90e8-cf0f-4d01-a46d-fea32fdf8160): created successfully Jun 02 03:23:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-cfb9d4d2-5e6b-4f86-8fa7-3b1ca353ad39 tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a3febc4-4b3a-4f6c-a58f-aaef7ff22560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-cfb9d4d2-5e6b-4f86-8fa7-3b1ca353ad39 tempest-VolumesActionsTest-389113780 None] Flow 'volume_create_manager' (2f2908ef-1146-45ef-8ecc-004c402f99f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:23:13 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-cfb9d4d2-5e6b-4f86-8fa7-3b1ca353ad39 tempest-VolumesActionsTest-389113780 None] Created volume successfully. Jun 02 03:23:13 devstack sudo[94579]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20.e798c232-7cbc-445b-8e00-cc0786dc8b31" returned: 0 in 0.874s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20.e798c232-7cbc-445b-8e00-cc0786dc8b31 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:13 devstack sudo[94588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20.e798c232-7cbc-445b-8e00-cc0786dc8b31 Jun 02 03:23:13 devstack sudo[94588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:13 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d81f4af7-bf58-40ac-b144-028442645749 tempest-VolumesActionsTest-2009514611 None] Acquiring lock "cinder-123b90e8-cf0f-4d01-a46d-fea32fdf8160-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:23:13 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d81f4af7-bf58-40ac-b144-028442645749 tempest-VolumesActionsTest-2009514611 None] Lock "cinder-123b90e8-cf0f-4d01-a46d-fea32fdf8160-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:23:13 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d81f4af7-bf58-40ac-b144-028442645749 tempest-VolumesActionsTest-2009514611 None] Acquiring lock "cinder-quobyte-123b90e8-cf0f-4d01-a46d-fea32fdf8160" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:23:13 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d81f4af7-bf58-40ac-b144-028442645749 tempest-VolumesActionsTest-2009514611 None] Lock "cinder-quobyte-123b90e8-cf0f-4d01-a46d-fea32fdf8160" acquired by "delete_volume" :: waited 0.021s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:23:13 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3be379f-1822-4798-908e-f8f1f8e11f14]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:23:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d81f4af7-bf58-40ac-b144-028442645749 tempest-VolumesActionsTest-2009514611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-123b90e8-cf0f-4d01-a46d-fea32fdf8160 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:14 devstack sudo[94595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-123b90e8-cf0f-4d01-a46d-fea32fdf8160 Jun 02 03:23:14 devstack sudo[94595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:14 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2ec0c491-e4e0-42b0-af87-fa49ebb848fd tempest-AttachVolumeNegativeTest-1165991087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2c87359e-b916-4c7d-9d37-76e9e7a68b47 1073741824" returned: 0 in 1.069s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2ec0c491-e4e0-42b0-af87-fa49ebb848fd tempest-AttachVolumeNegativeTest-1165991087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2c87359e-b916-4c7d-9d37-76e9e7a68b47 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:14 devstack sudo[94597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2c87359e-b916-4c7d-9d37-76e9e7a68b47 Jun 02 03:23:14 devstack sudo[94597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:14 devstack sudo[94588]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20.e798c232-7cbc-445b-8e00-cc0786dc8b31" returned: 0 in 0.711s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:14 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] Lock "cinder-quobyte-e798c232-7cbc-445b-8e00-cc0786dc8b31" released by "_delete_snapshot" :: held 3.325s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:23:14 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] Lock "cinder-quobyte-f038ab4a-889c-40de-808a-1383bfee2f20" released by "delete_snapshot" :: held 3.355s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:23:14 devstack cinder-volume[86431]: WARNING cinder.quota [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-874923675 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-874923675, it is now deprecated. Please use the default quota class for default quota. Jun 02 03:23:14 devstack cinder-volume[86431]: WARNING cinder.quota [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-874923675 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-874923675, it is now deprecated. Please use the default quota class for default quota. Jun 02 03:23:14 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] Created reservations ['9661cadc-6014-4a6b-84f3-456093b16631', '6833f35f-1dff-4a32-8036-fe12f07ea6c7', '5dc701e7-77dc-48b2-944c-1e24c737bdaa', '51d0ddd8-b5f4-4a9b-9ebe-407514133ff2'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:23:14 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] Created reservations ['84615f99-ac83-4c80-b3b4-dd45a5fedb0c', 'b5d3be63-0c2b-4e37-960e-eea46187e43e', 'b1852f00-f8a4-4b1d-a8c5-03bd3cdaa35e', 'b7f087f8-122a-4bbf-93f8-6c05ea82aaa8'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:23:14 devstack sudo[94597]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2ec0c491-e4e0-42b0-af87-fa49ebb848fd tempest-AttachVolumeNegativeTest-1165991087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2c87359e-b916-4c7d-9d37-76e9e7a68b47" returned: 0 in 0.681s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:14 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-2ec0c491-e4e0-42b0-af87-fa49ebb848fd tempest-AttachVolumeNegativeTest-1165991087 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:23:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2ec0c491-e4e0-42b0-af87-fa49ebb848fd tempest-AttachVolumeNegativeTest-1165991087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:23:14 devstack sudo[94595]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:14 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-ddf985a0-647f-4c8c-89ec-e7ea08714c4b tempest-GroupSnapshotsTest-408043841 None] group_snapshot a1a793d4-a7c3-4506-a868-6b3f9d6c877f: deleted successfully Jun 02 03:23:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d81f4af7-bf58-40ac-b144-028442645749 tempest-VolumesActionsTest-2009514611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-123b90e8-cf0f-4d01-a46d-fea32fdf8160" returned: 0 in 0.900s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d81f4af7-bf58-40ac-b144-028442645749 tempest-VolumesActionsTest-2009514611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-123b90e8-cf0f-4d01-a46d-fea32fdf8160 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:14 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2ec0c491-e4e0-42b0-af87-fa49ebb848fd tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a015511e-4cf5-468b-894f-bf548676046f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c87359e-b916-4c7d-9d37-76e9e7a68b47', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:14 devstack sudo[94606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-123b90e8-cf0f-4d01-a46d-fea32fdf8160 Jun 02 03:23:14 devstack sudo[94606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:14 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2ec0c491-e4e0-42b0-af87-fa49ebb848fd tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e813aa0e-8880-4cc8-9f14-2adac911f17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:14 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-2ec0c491-e4e0-42b0-af87-fa49ebb848fd tempest-AttachVolumeNegativeTest-1165991087 None] Volume volume-2c87359e-b916-4c7d-9d37-76e9e7a68b47 (2c87359e-b916-4c7d-9d37-76e9e7a68b47): created successfully Jun 02 03:23:14 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2ec0c491-e4e0-42b0-af87-fa49ebb848fd tempest-AttachVolumeNegativeTest-1165991087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e813aa0e-8880-4cc8-9f14-2adac911f17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:14 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2ec0c491-e4e0-42b0-af87-fa49ebb848fd tempest-AttachVolumeNegativeTest-1165991087 None] Flow 'volume_create_manager' (186787c8-241e-4486-aa0b-308d35ca0a07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:23:14 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-2ec0c491-e4e0-42b0-af87-fa49ebb848fd tempest-AttachVolumeNegativeTest-1165991087 None] Created volume successfully. Jun 02 03:23:15 devstack sudo[94606]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d81f4af7-bf58-40ac-b144-028442645749 tempest-VolumesActionsTest-2009514611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-123b90e8-cf0f-4d01-a46d-fea32fdf8160" returned: 0 in 0.601s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:15 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d81f4af7-bf58-40ac-b144-028442645749 tempest-VolumesActionsTest-2009514611 None] Lock "cinder-quobyte-123b90e8-cf0f-4d01-a46d-fea32fdf8160" released by "delete_volume" :: held 1.550s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:23:15 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-d81f4af7-bf58-40ac-b144-028442645749 tempest-VolumesActionsTest-2009514611 None] Created reservations ['7f9e80d9-cff4-4d62-8e8e-0d23d1549a70', '16b036e4-2337-4688-b118-e36147dbafff', 'feef9d6c-b052-4474-ba61-1c7cf40e714b', '4e606b94-7948-48aa-8677-4d4b2a95606e'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:23:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d81f4af7-bf58-40ac-b144-028442645749 tempest-VolumesActionsTest-2009514611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:23:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d81f4af7-bf58-40ac-b144-028442645749 tempest-VolumesActionsTest-2009514611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:23:15 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-d81f4af7-bf58-40ac-b144-028442645749 tempest-VolumesActionsTest-2009514611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:23:15 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-d81f4af7-bf58-40ac-b144-028442645749 tempest-VolumesActionsTest-2009514611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:23:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d81f4af7-bf58-40ac-b144-028442645749 tempest-VolumesActionsTest-2009514611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:23:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d81f4af7-bf58-40ac-b144-028442645749 tempest-VolumesActionsTest-2009514611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:15 devstack sudo[94609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:23:15 devstack sudo[94609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:15 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-495fad83-081b-4ad5-9a3b-d0ada941d922 tempest-GroupSnapshotsTest-408043841 None] Acquiring lock "cinder-quobyte-c5afdd75-2490-4c49-b629-38428fa2b589" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:23:15 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-495fad83-081b-4ad5-9a3b-d0ada941d922 tempest-GroupSnapshotsTest-408043841 None] Lock "cinder-quobyte-c5afdd75-2490-4c49-b629-38428fa2b589" acquired by "delete_volume" :: waited 0.019s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:23:15 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e75690-3507-483a-80d0-2d997b17a0ed]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:23:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-495fad83-081b-4ad5-9a3b-d0ada941d922 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:15 devstack sudo[94611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589 Jun 02 03:23:15 devstack sudo[94611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:16 devstack sudo[94609]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d81f4af7-bf58-40ac-b144-028442645749 tempest-VolumesActionsTest-2009514611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.652s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:16 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-d81f4af7-bf58-40ac-b144-028442645749 tempest-VolumesActionsTest-2009514611 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:23:16 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-d81f4af7-bf58-40ac-b144-028442645749 tempest-VolumesActionsTest-2009514611 None] Deleted volume successfully. Jun 02 03:23:16 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d81f4af7-bf58-40ac-b144-028442645749 tempest-VolumesActionsTest-2009514611 None] Lock "cinder-123b90e8-cf0f-4d01-a46d-fea32fdf8160-delete_volume" released by "delete_volume" :: held 2.409s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:23:16 devstack sudo[94611]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:16 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5eb89b9-45f0-48fe-8600-bcd0ffbbecff tempest-VolumesActionsTest-389113780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:23:16 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e5eb89b9-45f0-48fe-8600-bcd0ffbbecff tempest-VolumesActionsTest-389113780 None] Flow 'volume_create_manager' (096ffbc0-db3f-429d-bd4a-7d6d38166aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:23:16 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e5eb89b9-45f0-48fe-8600-bcd0ffbbecff tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (739b2ce5-310a-4bed-a59d-6f21f139d005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-495fad83-081b-4ad5-9a3b-d0ada941d922 tempest-GroupSnapshotsTest-408043841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589" returned: 0 in 0.854s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-495fad83-081b-4ad5-9a3b-d0ada941d922 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:16 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e5eb89b9-45f0-48fe-8600-bcd0ffbbecff tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (739b2ce5-310a-4bed-a59d-6f21f139d005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1420532043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e3c2463-7875-4eff-ae2a-b729e32f11ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3d1ef1e06f442e3b9ab1198a0dd3cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:23:17Z,use_quota=True,user_id='80d8ba02482c43cb8502ce327f3ec5d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:16 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e5eb89b9-45f0-48fe-8600-bcd0ffbbecff tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03fcd73c-ed45-4dde-8ec4-c55f4a96b99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:16 devstack sudo[94618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589 Jun 02 03:23:16 devstack sudo[94618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:16 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e5eb89b9-45f0-48fe-8600-bcd0ffbbecff tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03fcd73c-ed45-4dde-8ec4-c55f4a96b99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:16 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e5eb89b9-45f0-48fe-8600-bcd0ffbbecff tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bef4b366-5493-4f63-bfdc-c76194875c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:16 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e5eb89b9-45f0-48fe-8600-bcd0ffbbecff tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bef4b366-5493-4f63-bfdc-c76194875c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e3c2463-7875-4eff-ae2a-b729e32f11ce', 'volume_name': 'volume-7e3c2463-7875-4eff-ae2a-b729e32f11ce', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:16 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e5eb89b9-45f0-48fe-8600-bcd0ffbbecff tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e05027-5f3d-4059-aab8-6a1ce26b6bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:16 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e5eb89b9-45f0-48fe-8600-bcd0ffbbecff tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e05027-5f3d-4059-aab8-6a1ce26b6bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:16 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e5eb89b9-45f0-48fe-8600-bcd0ffbbecff tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6cd354b-db52-4467-8660-e59eeed2b21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:16 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-e5eb89b9-45f0-48fe-8600-bcd0ffbbecff tempest-VolumesActionsTest-389113780 None] Volume 7e3c2463-7875-4eff-ae2a-b729e32f11ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e3c2463-7875-4eff-ae2a-b729e32f11ce', 'volume_size': 1} Jun 02 03:23:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e5eb89b9-45f0-48fe-8600-bcd0ffbbecff tempest-VolumesActionsTest-389113780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:23:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e5eb89b9-45f0-48fe-8600-bcd0ffbbecff tempest-VolumesActionsTest-389113780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:23:16 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e5eb89b9-45f0-48fe-8600-bcd0ffbbecff tempest-VolumesActionsTest-389113780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1420532043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e3c2463-7875-4eff-ae2a-b729e32f11ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3d1ef1e06f442e3b9ab1198a0dd3cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:23:17Z,use_quota=True,user_id='80d8ba02482c43cb8502ce327f3ec5d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:23:16 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-e5eb89b9-45f0-48fe-8600-bcd0ffbbecff tempest-VolumesActionsTest-389113780 None] Creating volume 7e3c2463-7875-4eff-ae2a-b729e32f11ce {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:23:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e5eb89b9-45f0-48fe-8600-bcd0ffbbecff tempest-VolumesActionsTest-389113780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:23:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e5eb89b9-45f0-48fe-8600-bcd0ffbbecff tempest-VolumesActionsTest-389113780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:23:16 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e5eb89b9-45f0-48fe-8600-bcd0ffbbecff tempest-VolumesActionsTest-389113780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:23:16 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e5eb89b9-45f0-48fe-8600-bcd0ffbbecff tempest-VolumesActionsTest-389113780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:23:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e5eb89b9-45f0-48fe-8600-bcd0ffbbecff tempest-VolumesActionsTest-389113780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:23:16 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e5eb89b9-45f0-48fe-8600-bcd0ffbbecff tempest-VolumesActionsTest-389113780 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:23:16 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-e5eb89b9-45f0-48fe-8600-bcd0ffbbecff tempest-VolumesActionsTest-389113780 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:23:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e5eb89b9-45f0-48fe-8600-bcd0ffbbecff tempest-VolumesActionsTest-389113780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7e3c2463-7875-4eff-ae2a-b729e32f11ce 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:16 devstack sudo[94620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7e3c2463-7875-4eff-ae2a-b729e32f11ce 1073741824 Jun 02 03:23:16 devstack sudo[94620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:17 devstack sudo[94618]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-495fad83-081b-4ad5-9a3b-d0ada941d922 tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c5afdd75-2490-4c49-b629-38428fa2b589" returned: 0 in 0.611s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:17 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-495fad83-081b-4ad5-9a3b-d0ada941d922 tempest-GroupSnapshotsTest-408043841 None] Lock "cinder-quobyte-c5afdd75-2490-4c49-b629-38428fa2b589" released by "delete_volume" :: held 1.538s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:23:17 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-495fad83-081b-4ad5-9a3b-d0ada941d922 tempest-GroupSnapshotsTest-408043841 None] Acquiring lock "cinder-quobyte-f038ab4a-889c-40de-808a-1383bfee2f20" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:23:17 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-495fad83-081b-4ad5-9a3b-d0ada941d922 tempest-GroupSnapshotsTest-408043841 None] Lock "cinder-quobyte-f038ab4a-889c-40de-808a-1383bfee2f20" acquired by "delete_volume" :: waited 0.013s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:23:17 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d18e2af-4fbd-414f-8576-1f73a591ea4c]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:23:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-495fad83-081b-4ad5-9a3b-d0ada941d922 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:17 devstack sudo[94627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20 Jun 02 03:23:17 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:17 devstack sudo[94620]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e5eb89b9-45f0-48fe-8600-bcd0ffbbecff tempest-VolumesActionsTest-389113780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7e3c2463-7875-4eff-ae2a-b729e32f11ce 1073741824" returned: 0 in 0.805s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e5eb89b9-45f0-48fe-8600-bcd0ffbbecff tempest-VolumesActionsTest-389113780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7e3c2463-7875-4eff-ae2a-b729e32f11ce {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:17 devstack sudo[94629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7e3c2463-7875-4eff-ae2a-b729e32f11ce Jun 02 03:23:17 devstack sudo[94629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:18 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-495fad83-081b-4ad5-9a3b-d0ada941d922 tempest-GroupSnapshotsTest-408043841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20" returned: 0 in 0.811s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-495fad83-081b-4ad5-9a3b-d0ada941d922 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:18 devstack sudo[94670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20 Jun 02 03:23:18 devstack sudo[94670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:18 devstack sudo[94629]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e5eb89b9-45f0-48fe-8600-bcd0ffbbecff tempest-VolumesActionsTest-389113780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7e3c2463-7875-4eff-ae2a-b729e32f11ce" returned: 0 in 0.748s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:18 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e5eb89b9-45f0-48fe-8600-bcd0ffbbecff tempest-VolumesActionsTest-389113780 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:23:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e5eb89b9-45f0-48fe-8600-bcd0ffbbecff tempest-VolumesActionsTest-389113780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:23:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e5eb89b9-45f0-48fe-8600-bcd0ffbbecff tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6cd354b-db52-4467-8660-e59eeed2b21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e3c2463-7875-4eff-ae2a-b729e32f11ce', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e5eb89b9-45f0-48fe-8600-bcd0ffbbecff tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c856624c-dbd2-435f-89d2-d454fb3a2545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:18 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-e5eb89b9-45f0-48fe-8600-bcd0ffbbecff tempest-VolumesActionsTest-389113780 None] Volume volume-7e3c2463-7875-4eff-ae2a-b729e32f11ce (7e3c2463-7875-4eff-ae2a-b729e32f11ce): created successfully Jun 02 03:23:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e5eb89b9-45f0-48fe-8600-bcd0ffbbecff tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c856624c-dbd2-435f-89d2-d454fb3a2545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e5eb89b9-45f0-48fe-8600-bcd0ffbbecff tempest-VolumesActionsTest-389113780 None] Flow 'volume_create_manager' (096ffbc0-db3f-429d-bd4a-7d6d38166aff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:23:18 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-e5eb89b9-45f0-48fe-8600-bcd0ffbbecff tempest-VolumesActionsTest-389113780 None] Created volume successfully. Jun 02 03:23:18 devstack sudo[94670]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-495fad83-081b-4ad5-9a3b-d0ada941d922 tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f038ab4a-889c-40de-808a-1383bfee2f20" returned: 0 in 0.723s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:18 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-495fad83-081b-4ad5-9a3b-d0ada941d922 tempest-GroupSnapshotsTest-408043841 None] Lock "cinder-quobyte-f038ab4a-889c-40de-808a-1383bfee2f20" released by "delete_volume" :: held 1.598s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:23:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-280531a6-d467-4ef9-9ab6-e8011749f255 req-a9a68363-f68a-4a25-92db-10147bdd0fd5 tempest-AttachVolumeNegativeTest-1165991087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:23:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-280531a6-d467-4ef9-9ab6-e8011749f255 req-a9a68363-f68a-4a25-92db-10147bdd0fd5 tempest-AttachVolumeNegativeTest-1165991087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:23:19 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[0538bdfc-feed-4108-a83e-ea622d876f7d]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:23:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-280531a6-d467-4ef9-9ab6-e8011749f255 req-a9a68363-f68a-4a25-92db-10147bdd0fd5 tempest-AttachVolumeNegativeTest-1165991087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2c87359e-b916-4c7d-9d37-76e9e7a68b47 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:19 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-a246b7b7-fa92-4e0d-9075-6c01fac3be95 tempest-VolumesActionsTest-2009514611 None] Acquiring lock "cinder-7e3c2463-7875-4eff-ae2a-b729e32f11ce-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:23:19 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-495fad83-081b-4ad5-9a3b-d0ada941d922 tempest-GroupSnapshotsTest-408043841 None] Created reservations ['a81974bf-4577-49cd-b927-722fdf4ebb9b'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:23:19 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-a246b7b7-fa92-4e0d-9075-6c01fac3be95 tempest-VolumesActionsTest-2009514611 None] Lock "cinder-7e3c2463-7875-4eff-ae2a-b729e32f11ce-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:23:19 devstack cinder-volume[86431]: WARNING cinder.quota [None req-495fad83-081b-4ad5-9a3b-d0ada941d922 tempest-GroupSnapshotsTest-408043841 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-874923675 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-874923675, it is now deprecated. Please use the default quota class for default quota. Jun 02 03:23:19 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-a246b7b7-fa92-4e0d-9075-6c01fac3be95 tempest-VolumesActionsTest-2009514611 None] Acquiring lock "cinder-quobyte-7e3c2463-7875-4eff-ae2a-b729e32f11ce" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:23:19 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-495fad83-081b-4ad5-9a3b-d0ada941d922 tempest-GroupSnapshotsTest-408043841 None] Created reservations ['754c1eac-e723-4c11-801a-c29f610f9ae1', 'a5f32ecf-84c4-4ccc-802d-2d127433d850', 'c9e83c6a-d07a-4f2d-ba68-b212401b83b2', 'f4e116f7-f96f-4c27-9a99-3a500c7ba3d9'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:23:19 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-a246b7b7-fa92-4e0d-9075-6c01fac3be95 tempest-VolumesActionsTest-2009514611 None] Lock "cinder-quobyte-7e3c2463-7875-4eff-ae2a-b729e32f11ce" acquired by "delete_volume" :: waited 0.050s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:23:19 devstack sudo[94682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2c87359e-b916-4c7d-9d37-76e9e7a68b47 Jun 02 03:23:19 devstack sudo[94682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:19 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fa0124-3547-4959-b84b-a92b6ff8f5f9]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:23:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a246b7b7-fa92-4e0d-9075-6c01fac3be95 tempest-VolumesActionsTest-2009514611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7e3c2463-7875-4eff-ae2a-b729e32f11ce {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:19 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-495fad83-081b-4ad5-9a3b-d0ada941d922 tempest-GroupSnapshotsTest-408043841 None] Created reservations ['6928b4c6-ae95-481e-80c9-908e684c7b5b', 'be96d463-4cd9-4268-8d8e-7e459fa089ed', 'ffa14908-9b92-4524-8b3b-2dd9f4a33cc1', '59ef5bff-ea0e-4136-994f-1bc4993526f3'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:23:19 devstack sudo[94684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7e3c2463-7875-4eff-ae2a-b729e32f11ce Jun 02 03:23:19 devstack sudo[94684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-495fad83-081b-4ad5-9a3b-d0ada941d922 tempest-GroupSnapshotsTest-408043841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:23:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-495fad83-081b-4ad5-9a3b-d0ada941d922 tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:23:19 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-495fad83-081b-4ad5-9a3b-d0ada941d922 tempest-GroupSnapshotsTest-408043841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:23:19 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-495fad83-081b-4ad5-9a3b-d0ada941d922 tempest-GroupSnapshotsTest-408043841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:23:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-495fad83-081b-4ad5-9a3b-d0ada941d922 tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:23:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-495fad83-081b-4ad5-9a3b-d0ada941d922 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:19 devstack sudo[94686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:23:19 devstack sudo[94686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:19 devstack sudo[94682]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-280531a6-d467-4ef9-9ab6-e8011749f255 req-a9a68363-f68a-4a25-92db-10147bdd0fd5 tempest-AttachVolumeNegativeTest-1165991087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2c87359e-b916-4c7d-9d37-76e9e7a68b47" returned: 0 in 0.809s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-280531a6-d467-4ef9-9ab6-e8011749f255 req-a9a68363-f68a-4a25-92db-10147bdd0fd5 tempest-AttachVolumeNegativeTest-1165991087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.833s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:23:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-280531a6-d467-4ef9-9ab6-e8011749f255 req-a9a68363-f68a-4a25-92db-10147bdd0fd5 tempest-AttachVolumeNegativeTest-1165991087 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1', 'name': 'volume-2c87359e-b916-4c7d-9d37-76e9e7a68b47', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0b1b1585-0cd4-48c3-b2c6-139324f8e260', 'enforce_multipath': True} {{(pid=86431) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 02 03:23:19 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-280531a6-d467-4ef9-9ab6-e8011749f255 req-a9a68363-f68a-4a25-92db-10147bdd0fd5 tempest-AttachVolumeNegativeTest-1165991087 None] attachment_update completed successfully. Jun 02 03:23:20 devstack sudo[94684]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a246b7b7-fa92-4e0d-9075-6c01fac3be95 tempest-VolumesActionsTest-2009514611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7e3c2463-7875-4eff-ae2a-b729e32f11ce" returned: 0 in 0.817s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a246b7b7-fa92-4e0d-9075-6c01fac3be95 tempest-VolumesActionsTest-2009514611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7e3c2463-7875-4eff-ae2a-b729e32f11ce {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:20 devstack sudo[94696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7e3c2463-7875-4eff-ae2a-b729e32f11ce Jun 02 03:23:20 devstack sudo[94696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:20 devstack sudo[94686]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-495fad83-081b-4ad5-9a3b-d0ada941d922 tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.713s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:20 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-495fad83-081b-4ad5-9a3b-d0ada941d922 tempest-GroupSnapshotsTest-408043841 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:23:20 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-495fad83-081b-4ad5-9a3b-d0ada941d922 tempest-GroupSnapshotsTest-408043841 None] Delete group completed successfully. Jun 02 03:23:20 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-b02b8a8d-16d4-491f-86b5-a3d79f3b76a6 tempest-GroupSnapshotsTest-408043841 None] Group tempest-GroupSnapshotsTest-Group-1839630246: creating Jun 02 03:23:20 devstack sudo[94696]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a246b7b7-fa92-4e0d-9075-6c01fac3be95 tempest-VolumesActionsTest-2009514611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7e3c2463-7875-4eff-ae2a-b729e32f11ce" returned: 0 in 0.776s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:20 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-a246b7b7-fa92-4e0d-9075-6c01fac3be95 tempest-VolumesActionsTest-2009514611 None] Lock "cinder-quobyte-7e3c2463-7875-4eff-ae2a-b729e32f11ce" released by "delete_volume" :: held 1.651s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:23:20 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-b02b8a8d-16d4-491f-86b5-a3d79f3b76a6 tempest-GroupSnapshotsTest-408043841 None] Group tempest-GroupSnapshotsTest-Group-1839630246: created successfully Jun 02 03:23:20 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-b02b8a8d-16d4-491f-86b5-a3d79f3b76a6 tempest-GroupSnapshotsTest-408043841 None] Create group completed successfully. Jun 02 03:23:20 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-a246b7b7-fa92-4e0d-9075-6c01fac3be95 tempest-VolumesActionsTest-2009514611 None] Created reservations ['6e769887-1123-4a2d-923b-2b36fe60061a', 'a33a0061-453e-4a42-a815-628f3a9126ab', 'b1fa56d5-c66f-42ad-a206-261708d41527', '34fe28ac-0a0f-4479-be29-b167362095ff'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:23:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a246b7b7-fa92-4e0d-9075-6c01fac3be95 tempest-VolumesActionsTest-2009514611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:23:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a246b7b7-fa92-4e0d-9075-6c01fac3be95 tempest-VolumesActionsTest-2009514611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:23:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a246b7b7-fa92-4e0d-9075-6c01fac3be95 tempest-VolumesActionsTest-2009514611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:23:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a246b7b7-fa92-4e0d-9075-6c01fac3be95 tempest-VolumesActionsTest-2009514611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:23:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a246b7b7-fa92-4e0d-9075-6c01fac3be95 tempest-VolumesActionsTest-2009514611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:23:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a246b7b7-fa92-4e0d-9075-6c01fac3be95 tempest-VolumesActionsTest-2009514611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:20 devstack sudo[95079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:23:20 devstack sudo[95079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:21 devstack sudo[95079]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a246b7b7-fa92-4e0d-9075-6c01fac3be95 tempest-VolumesActionsTest-2009514611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.613s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:21 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-a246b7b7-fa92-4e0d-9075-6c01fac3be95 tempest-VolumesActionsTest-2009514611 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:23:21 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-a246b7b7-fa92-4e0d-9075-6c01fac3be95 tempest-VolumesActionsTest-2009514611 None] Deleted volume successfully. Jun 02 03:23:21 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-a246b7b7-fa92-4e0d-9075-6c01fac3be95 tempest-VolumesActionsTest-2009514611 None] Lock "cinder-7e3c2463-7875-4eff-ae2a-b729e32f11ce-delete_volume" released by "delete_volume" :: held 2.523s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:23:21 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c275b0c-24dc-4b2b-b6e9-3683e20f51dd tempest-VolumesActionsTest-389113780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:23:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8c275b0c-24dc-4b2b-b6e9-3683e20f51dd tempest-VolumesActionsTest-389113780 None] Flow 'volume_create_manager' (cb494995-31fa-48c2-a41a-6b1893e2851c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:23:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8c275b0c-24dc-4b2b-b6e9-3683e20f51dd tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd64bb65-0f0e-4f93-8843-02a51bd26bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8c275b0c-24dc-4b2b-b6e9-3683e20f51dd tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd64bb65-0f0e-4f93-8843-02a51bd26bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1075368322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f1db6ad-b0a4-44d9-80d8-fba1fcbf477a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3d1ef1e06f442e3b9ab1198a0dd3cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:23:22Z,use_quota=True,user_id='80d8ba02482c43cb8502ce327f3ec5d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8c275b0c-24dc-4b2b-b6e9-3683e20f51dd tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1edcc821-51bf-47a1-ae3f-3bb5dd266c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8c275b0c-24dc-4b2b-b6e9-3683e20f51dd tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1edcc821-51bf-47a1-ae3f-3bb5dd266c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8c275b0c-24dc-4b2b-b6e9-3683e20f51dd tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87726663-22f3-404f-b785-02254f134196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8c275b0c-24dc-4b2b-b6e9-3683e20f51dd tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87726663-22f3-404f-b785-02254f134196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f1db6ad-b0a4-44d9-80d8-fba1fcbf477a', 'volume_name': 'volume-2f1db6ad-b0a4-44d9-80d8-fba1fcbf477a', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8c275b0c-24dc-4b2b-b6e9-3683e20f51dd tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (836aaded-1e71-4f27-bdaf-b03f76ab1e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8c275b0c-24dc-4b2b-b6e9-3683e20f51dd tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (836aaded-1e71-4f27-bdaf-b03f76ab1e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8c275b0c-24dc-4b2b-b6e9-3683e20f51dd tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (755a5ac6-0aab-4f4f-be9c-854838b64273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:22 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-8c275b0c-24dc-4b2b-b6e9-3683e20f51dd tempest-VolumesActionsTest-389113780 None] Volume 2f1db6ad-b0a4-44d9-80d8-fba1fcbf477a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f1db6ad-b0a4-44d9-80d8-fba1fcbf477a', 'volume_size': 1} Jun 02 03:23:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8c275b0c-24dc-4b2b-b6e9-3683e20f51dd tempest-VolumesActionsTest-389113780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:23:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8c275b0c-24dc-4b2b-b6e9-3683e20f51dd tempest-VolumesActionsTest-389113780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:23:22 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-8c275b0c-24dc-4b2b-b6e9-3683e20f51dd tempest-VolumesActionsTest-389113780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1075368322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f1db6ad-b0a4-44d9-80d8-fba1fcbf477a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3d1ef1e06f442e3b9ab1198a0dd3cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:23:22Z,use_quota=True,user_id='80d8ba02482c43cb8502ce327f3ec5d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:23:22 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-8c275b0c-24dc-4b2b-b6e9-3683e20f51dd tempest-VolumesActionsTest-389113780 None] Creating volume 2f1db6ad-b0a4-44d9-80d8-fba1fcbf477a {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:23:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8c275b0c-24dc-4b2b-b6e9-3683e20f51dd tempest-VolumesActionsTest-389113780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:23:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8c275b0c-24dc-4b2b-b6e9-3683e20f51dd tempest-VolumesActionsTest-389113780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:23:22 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-8c275b0c-24dc-4b2b-b6e9-3683e20f51dd tempest-VolumesActionsTest-389113780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:23:22 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-8c275b0c-24dc-4b2b-b6e9-3683e20f51dd tempest-VolumesActionsTest-389113780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:23:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8c275b0c-24dc-4b2b-b6e9-3683e20f51dd tempest-VolumesActionsTest-389113780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:23:22 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-8c275b0c-24dc-4b2b-b6e9-3683e20f51dd tempest-VolumesActionsTest-389113780 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:23:22 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-8c275b0c-24dc-4b2b-b6e9-3683e20f51dd tempest-VolumesActionsTest-389113780 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:23:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8c275b0c-24dc-4b2b-b6e9-3683e20f51dd tempest-VolumesActionsTest-389113780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2f1db6ad-b0a4-44d9-80d8-fba1fcbf477a 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:22 devstack sudo[95085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2f1db6ad-b0a4-44d9-80d8-fba1fcbf477a 1073741824 Jun 02 03:23:22 devstack sudo[95085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:22 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-34d34f11-e43e-463e-a3a5-62f4e5ca70d0 tempest-GroupSnapshotsTest-408043841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:23:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-34d34f11-e43e-463e-a3a5-62f4e5ca70d0 tempest-GroupSnapshotsTest-408043841 None] Flow 'volume_create_manager' (95971d83-b8ae-4afe-b38d-a12a4c2f41f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:23:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-34d34f11-e43e-463e-a3a5-62f4e5ca70d0 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdcbe1d8-c5f4-4639-98a0-3fd12dc7aecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-34d34f11-e43e-463e-a3a5-62f4e5ca70d0 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdcbe1d8-c5f4-4639-98a0-3fd12dc7aecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-370807351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9a6d1346-b169-480d-8a3a-019eefa24a25,host='devstack@QuobyteHD#QuobyteHD',id=400389b3-f586-4a4f-85fa-a27d075dc427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050054a4bf054b39996d9b0f83376446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:23:22Z,use_quota=True,user_id='394e6c3efc954d1b86b030d05e8c2e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(19849474-315a-4697-b7ca-ff6c8855fb64),volume_type_id=19849474-315a-4697-b7ca-ff6c8855fb64)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-34d34f11-e43e-463e-a3a5-62f4e5ca70d0 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b2e4256-0bdf-4dac-9802-665e189c40f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-34d34f11-e43e-463e-a3a5-62f4e5ca70d0 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b2e4256-0bdf-4dac-9802-665e189c40f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-34d34f11-e43e-463e-a3a5-62f4e5ca70d0 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc68e8dd-8f52-407c-bace-c7aa453fb795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-34d34f11-e43e-463e-a3a5-62f4e5ca70d0 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc68e8dd-8f52-407c-bace-c7aa453fb795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '400389b3-f586-4a4f-85fa-a27d075dc427', 'volume_name': 'volume-400389b3-f586-4a4f-85fa-a27d075dc427', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-34d34f11-e43e-463e-a3a5-62f4e5ca70d0 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b68646b-f422-4216-8340-2a75fb557d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-34d34f11-e43e-463e-a3a5-62f4e5ca70d0 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b68646b-f422-4216-8340-2a75fb557d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-34d34f11-e43e-463e-a3a5-62f4e5ca70d0 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e47559-f520-4a6e-9138-006faf684c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:22 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-34d34f11-e43e-463e-a3a5-62f4e5ca70d0 tempest-GroupSnapshotsTest-408043841 None] Volume 400389b3-f586-4a4f-85fa-a27d075dc427: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-400389b3-f586-4a4f-85fa-a27d075dc427', 'volume_size': 1} Jun 02 03:23:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-34d34f11-e43e-463e-a3a5-62f4e5ca70d0 tempest-GroupSnapshotsTest-408043841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:23:22 devstack sudo[95085]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8c275b0c-24dc-4b2b-b6e9-3683e20f51dd tempest-VolumesActionsTest-389113780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2f1db6ad-b0a4-44d9-80d8-fba1fcbf477a 1073741824" returned: 0 in 0.847s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8c275b0c-24dc-4b2b-b6e9-3683e20f51dd tempest-VolumesActionsTest-389113780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2f1db6ad-b0a4-44d9-80d8-fba1fcbf477a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:22 devstack sudo[95092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2f1db6ad-b0a4-44d9-80d8-fba1fcbf477a Jun 02 03:23:22 devstack sudo[95092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:23 devstack sudo[95092]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8c275b0c-24dc-4b2b-b6e9-3683e20f51dd tempest-VolumesActionsTest-389113780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2f1db6ad-b0a4-44d9-80d8-fba1fcbf477a" returned: 0 in 0.606s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:23 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-8c275b0c-24dc-4b2b-b6e9-3683e20f51dd tempest-VolumesActionsTest-389113780 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:23:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8c275b0c-24dc-4b2b-b6e9-3683e20f51dd tempest-VolumesActionsTest-389113780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:23:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-34d34f11-e43e-463e-a3a5-62f4e5ca70d0 tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.127s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:23:23 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-34d34f11-e43e-463e-a3a5-62f4e5ca70d0 tempest-GroupSnapshotsTest-408043841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9a6d1346-b169-480d-8a3a-019eefa24a25,created_at=2026-06-02T01:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-370807351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9a6d1346-b169-480d-8a3a-019eefa24a25,host='devstack@QuobyteHD#QuobyteHD',id=400389b3-f586-4a4f-85fa-a27d075dc427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050054a4bf054b39996d9b0f83376446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:23:22Z,use_quota=True,user_id='394e6c3efc954d1b86b030d05e8c2e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(19849474-315a-4697-b7ca-ff6c8855fb64),volume_type_id=19849474-315a-4697-b7ca-ff6c8855fb64)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:23:23 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-34d34f11-e43e-463e-a3a5-62f4e5ca70d0 tempest-GroupSnapshotsTest-408043841 None] Creating volume 400389b3-f586-4a4f-85fa-a27d075dc427 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:23:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-34d34f11-e43e-463e-a3a5-62f4e5ca70d0 tempest-GroupSnapshotsTest-408043841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:23:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-34d34f11-e43e-463e-a3a5-62f4e5ca70d0 tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:23:23 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-34d34f11-e43e-463e-a3a5-62f4e5ca70d0 tempest-GroupSnapshotsTest-408043841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:23:23 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-34d34f11-e43e-463e-a3a5-62f4e5ca70d0 tempest-GroupSnapshotsTest-408043841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:23:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-34d34f11-e43e-463e-a3a5-62f4e5ca70d0 tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:23:23 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-34d34f11-e43e-463e-a3a5-62f4e5ca70d0 tempest-GroupSnapshotsTest-408043841 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:23:23 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-34d34f11-e43e-463e-a3a5-62f4e5ca70d0 tempest-GroupSnapshotsTest-408043841 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:23:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-34d34f11-e43e-463e-a3a5-62f4e5ca70d0 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:23 devstack sudo[95095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427 1073741824 Jun 02 03:23:23 devstack sudo[95095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:23 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8c275b0c-24dc-4b2b-b6e9-3683e20f51dd tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (755a5ac6-0aab-4f4f-be9c-854838b64273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f1db6ad-b0a4-44d9-80d8-fba1fcbf477a', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:23 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8c275b0c-24dc-4b2b-b6e9-3683e20f51dd tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b691d25-0150-49f6-b9bb-3729119364ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:23 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-8c275b0c-24dc-4b2b-b6e9-3683e20f51dd tempest-VolumesActionsTest-389113780 None] Volume volume-2f1db6ad-b0a4-44d9-80d8-fba1fcbf477a (2f1db6ad-b0a4-44d9-80d8-fba1fcbf477a): created successfully Jun 02 03:23:23 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8c275b0c-24dc-4b2b-b6e9-3683e20f51dd tempest-VolumesActionsTest-389113780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b691d25-0150-49f6-b9bb-3729119364ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:23 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8c275b0c-24dc-4b2b-b6e9-3683e20f51dd tempest-VolumesActionsTest-389113780 None] Flow 'volume_create_manager' (cb494995-31fa-48c2-a41a-6b1893e2851c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:23:23 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-8c275b0c-24dc-4b2b-b6e9-3683e20f51dd tempest-VolumesActionsTest-389113780 None] Created volume successfully. Jun 02 03:23:24 devstack sudo[95095]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-34d34f11-e43e-463e-a3a5-62f4e5ca70d0 tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427 1073741824" returned: 0 in 1.086s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-34d34f11-e43e-463e-a3a5-62f4e5ca70d0 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:24 devstack sudo[95101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427 Jun 02 03:23:24 devstack sudo[95101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:24 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7dc3c259-cc4b-481e-90fb-298cdbc416c0 tempest-VolumesActionsTest-389113780 None] Acquiring lock "cinder-2f1db6ad-b0a4-44d9-80d8-fba1fcbf477a-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:23:24 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7dc3c259-cc4b-481e-90fb-298cdbc416c0 tempest-VolumesActionsTest-389113780 None] Lock "cinder-2f1db6ad-b0a4-44d9-80d8-fba1fcbf477a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:23:24 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7dc3c259-cc4b-481e-90fb-298cdbc416c0 tempest-VolumesActionsTest-389113780 None] Acquiring lock "cinder-quobyte-2f1db6ad-b0a4-44d9-80d8-fba1fcbf477a" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:23:25 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7dc3c259-cc4b-481e-90fb-298cdbc416c0 tempest-VolumesActionsTest-389113780 None] Lock "cinder-quobyte-2f1db6ad-b0a4-44d9-80d8-fba1fcbf477a" acquired by "delete_volume" :: waited 0.022s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:23:25 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58c593b-b5ba-454a-a205-0242fed32f02]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:23:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7dc3c259-cc4b-481e-90fb-298cdbc416c0 tempest-VolumesActionsTest-389113780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2f1db6ad-b0a4-44d9-80d8-fba1fcbf477a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:25 devstack sudo[95109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2f1db6ad-b0a4-44d9-80d8-fba1fcbf477a Jun 02 03:23:25 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:25 devstack sudo[95101]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-34d34f11-e43e-463e-a3a5-62f4e5ca70d0 tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427" returned: 0 in 0.706s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:25 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-34d34f11-e43e-463e-a3a5-62f4e5ca70d0 tempest-GroupSnapshotsTest-408043841 None] <== create_volume: return (1847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:23:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-34d34f11-e43e-463e-a3a5-62f4e5ca70d0 tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.850s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:23:25 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-34d34f11-e43e-463e-a3a5-62f4e5ca70d0 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e47559-f520-4a6e-9138-006faf684c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-400389b3-f586-4a4f-85fa-a27d075dc427', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:25 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-34d34f11-e43e-463e-a3a5-62f4e5ca70d0 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c9dd5de-386f-4e75-ab6e-38fe193eba26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:25 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-34d34f11-e43e-463e-a3a5-62f4e5ca70d0 tempest-GroupSnapshotsTest-408043841 None] Volume volume-400389b3-f586-4a4f-85fa-a27d075dc427 (400389b3-f586-4a4f-85fa-a27d075dc427): created successfully Jun 02 03:23:25 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-34d34f11-e43e-463e-a3a5-62f4e5ca70d0 tempest-GroupSnapshotsTest-408043841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c9dd5de-386f-4e75-ab6e-38fe193eba26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:25 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-34d34f11-e43e-463e-a3a5-62f4e5ca70d0 tempest-GroupSnapshotsTest-408043841 None] Flow 'volume_create_manager' (95971d83-b8ae-4afe-b38d-a12a4c2f41f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:23:25 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-34d34f11-e43e-463e-a3a5-62f4e5ca70d0 tempest-GroupSnapshotsTest-408043841 None] Created volume successfully. Jun 02 03:23:25 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7dc3c259-cc4b-481e-90fb-298cdbc416c0 tempest-VolumesActionsTest-389113780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2f1db6ad-b0a4-44d9-80d8-fba1fcbf477a" returned: 0 in 0.832s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7dc3c259-cc4b-481e-90fb-298cdbc416c0 tempest-VolumesActionsTest-389113780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2f1db6ad-b0a4-44d9-80d8-fba1fcbf477a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:25 devstack sudo[95137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2f1db6ad-b0a4-44d9-80d8-fba1fcbf477a Jun 02 03:23:25 devstack sudo[95137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:25 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-a3829d39-1eaf-47be-b65c-346208660d85 tempest-GroupSnapshotsTest-408043841 None] GroupSnapshot 1f39c02a-de7c-49df-8bb9-d6368c063dc2: creating. Jun 02 03:23:25 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a3829d39-1eaf-47be-b65c-346208660d85 tempest-GroupSnapshotsTest-408043841 None] Group snapshot 1f39c02a-de7c-49df-8bb9-d6368c063dc2: creating. {{(pid=86431) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Jun 02 03:23:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a3829d39-1eaf-47be-b65c-346208660d85 tempest-GroupSnapshotsTest-408043841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:23:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a3829d39-1eaf-47be-b65c-346208660d85 tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:23:26 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-a3829d39-1eaf-47be-b65c-346208660d85 tempest-GroupSnapshotsTest-408043841 None] Creating offline snapshot 88a1555c-fb4d-496b-83b1-02cdbd3b7e2c of volume 400389b3-f586-4a4f-85fa-a27d075dc427 {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:23:26 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc871356-37d9-4960-b2ce-3012cdf8106a]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:23:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a3829d39-1eaf-47be-b65c-346208660d85 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:26 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-3c7f9d78-f497-45c9-8051-ca77505b7ea9 req-7765f6a1-62ea-4342-8931-8e46fb3659bd tempest-AttachVolumeNegativeTest-1165991087 None] Terminate volume connection completed successfully. Jun 02 03:23:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-3c7f9d78-f497-45c9-8051-ca77505b7ea9 req-7765f6a1-62ea-4342-8931-8e46fb3659bd tempest-AttachVolumeNegativeTest-1165991087 None] Deleting attachment 0b1b1585-0cd4-48c3-b2c6-139324f8e260. {{(pid=86431) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 02 03:23:26 devstack sudo[95166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427 Jun 02 03:23:26 devstack sudo[95166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:26 devstack sudo[95137]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7dc3c259-cc4b-481e-90fb-298cdbc416c0 tempest-VolumesActionsTest-389113780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2f1db6ad-b0a4-44d9-80d8-fba1fcbf477a" returned: 0 in 0.632s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:26 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7dc3c259-cc4b-481e-90fb-298cdbc416c0 tempest-VolumesActionsTest-389113780 None] Lock "cinder-quobyte-2f1db6ad-b0a4-44d9-80d8-fba1fcbf477a" released by "delete_volume" :: held 1.512s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:23:26 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-7dc3c259-cc4b-481e-90fb-298cdbc416c0 tempest-VolumesActionsTest-389113780 None] Created reservations ['42a2b5e2-54bd-444d-a97f-3691229bd7df', '47bdcb70-a5ce-488d-ac2a-48a1f48f559d', '5b182ede-645b-466d-a288-1e5aee1c0bc3', 'b3a822e7-98bb-45d7-8599-7258bc85e0d2'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:23:26 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:UPDATE=158,cinder:SELECT=157,cinder:INSERT=26,cinder:DELETE=5 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:23:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7dc3c259-cc4b-481e-90fb-298cdbc416c0 tempest-VolumesActionsTest-389113780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:23:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7dc3c259-cc4b-481e-90fb-298cdbc416c0 tempest-VolumesActionsTest-389113780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:23:26 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-7dc3c259-cc4b-481e-90fb-298cdbc416c0 tempest-VolumesActionsTest-389113780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:23:26 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-7dc3c259-cc4b-481e-90fb-298cdbc416c0 tempest-VolumesActionsTest-389113780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:23:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7dc3c259-cc4b-481e-90fb-298cdbc416c0 tempest-VolumesActionsTest-389113780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:23:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7dc3c259-cc4b-481e-90fb-298cdbc416c0 tempest-VolumesActionsTest-389113780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:26 devstack sudo[95177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:23:26 devstack sudo[95177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:26 devstack sudo[95166]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a3829d39-1eaf-47be-b65c-346208660d85 tempest-GroupSnapshotsTest-408043841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427" returned: 0 in 0.861s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a3829d39-1eaf-47be-b65c-346208660d85 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427.88a1555c-fb4d-496b-83b1-02cdbd3b7e2c 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:26 devstack sudo[95185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427.88a1555c-fb4d-496b-83b1-02cdbd3b7e2c 1G Jun 02 03:23:26 devstack sudo[95185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:27 devstack sudo[95177]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7dc3c259-cc4b-481e-90fb-298cdbc416c0 tempest-VolumesActionsTest-389113780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.718s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:27 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-7dc3c259-cc4b-481e-90fb-298cdbc416c0 tempest-VolumesActionsTest-389113780 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:23:27 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-7dc3c259-cc4b-481e-90fb-298cdbc416c0 tempest-VolumesActionsTest-389113780 None] Deleted volume successfully. Jun 02 03:23:27 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7dc3c259-cc4b-481e-90fb-298cdbc416c0 tempest-VolumesActionsTest-389113780 None] Lock "cinder-2f1db6ad-b0a4-44d9-80d8-fba1fcbf477a-delete_volume" released by "delete_volume" :: held 2.496s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:23:27 devstack sudo[95185]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a3829d39-1eaf-47be-b65c-346208660d85 tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427.88a1555c-fb4d-496b-83b1-02cdbd3b7e2c 1G" returned: 0 in 1.032s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a3829d39-1eaf-47be-b65c-346208660d85 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-400389b3-f586-4a4f-85fa-a27d075dc427 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427.88a1555c-fb4d-496b-83b1-02cdbd3b7e2c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:27 devstack sudo[95191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-400389b3-f586-4a4f-85fa-a27d075dc427 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427.88a1555c-fb4d-496b-83b1-02cdbd3b7e2c Jun 02 03:23:27 devstack sudo[95191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:28 devstack sudo[95191]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a3829d39-1eaf-47be-b65c-346208660d85 tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-400389b3-f586-4a4f-85fa-a27d075dc427 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427.88a1555c-fb4d-496b-83b1-02cdbd3b7e2c" returned: 0 in 0.922s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:28 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-a3829d39-1eaf-47be-b65c-346208660d85 tempest-GroupSnapshotsTest-408043841 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427.88a1555c-fb4d-496b-83b1-02cdbd3b7e2c is being set with open permissions: ugo+rw: NotImplementedError Jun 02 03:23:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a3829d39-1eaf-47be-b65c-346208660d85 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427.88a1555c-fb4d-496b-83b1-02cdbd3b7e2c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:28 devstack sudo[95204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427.88a1555c-fb4d-496b-83b1-02cdbd3b7e2c Jun 02 03:23:28 devstack sudo[95204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:29 devstack sudo[95204]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a3829d39-1eaf-47be-b65c-346208660d85 tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427.88a1555c-fb4d-496b-83b1-02cdbd3b7e2c" returned: 0 in 0.757s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:29 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:UPDATE=153,cinder:SELECT=128,cinder:INSERT=44,cinder:DELETE=11 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:23:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a3829d39-1eaf-47be-b65c-346208660d85 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:29 devstack sudo[95249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427.info Jun 02 03:23:29 devstack sudo[95249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:30 devstack sudo[95249]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a3829d39-1eaf-47be-b65c-346208660d85 tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427.info" returned: 0 in 0.751s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:30 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-a3829d39-1eaf-47be-b65c-346208660d85 tempest-GroupSnapshotsTest-408043841 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427.info is being set with open permissions: ugo+rw: NotImplementedError Jun 02 03:23:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a3829d39-1eaf-47be-b65c-346208660d85 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:30 devstack sudo[95263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427.info Jun 02 03:23:30 devstack sudo[95263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:31 devstack sudo[95263]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a3829d39-1eaf-47be-b65c-346208660d85 tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427.info" returned: 0 in 0.631s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a3829d39-1eaf-47be-b65c-346208660d85 tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.068s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:23:31 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-a3829d39-1eaf-47be-b65c-346208660d85 tempest-GroupSnapshotsTest-408043841 None] group_snapshot 1f39c02a-de7c-49df-8bb9-d6368c063dc2: created successfully Jun 02 03:23:31 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-9fbbd2f6-5e81-4fb0-8c09-5e4c3f6aa905 tempest-GroupSnapshotsTest-408043841 None] group_snapshot 1f39c02a-de7c-49df-8bb9-d6368c063dc2: deleting Jun 02 03:23:31 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9fbbd2f6-5e81-4fb0-8c09-5e4c3f6aa905 tempest-GroupSnapshotsTest-408043841 None] group_snapshot 1f39c02a-de7c-49df-8bb9-d6368c063dc2: deleting {{(pid=86431) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Jun 02 03:23:31 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-9fbbd2f6-5e81-4fb0-8c09-5e4c3f6aa905 tempest-GroupSnapshotsTest-408043841 None] Acquiring lock "cinder-quobyte-400389b3-f586-4a4f-85fa-a27d075dc427" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:23:31 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-9fbbd2f6-5e81-4fb0-8c09-5e4c3f6aa905 tempest-GroupSnapshotsTest-408043841 None] Lock "cinder-quobyte-400389b3-f586-4a4f-85fa-a27d075dc427" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:23:31 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-9fbbd2f6-5e81-4fb0-8c09-5e4c3f6aa905 tempest-GroupSnapshotsTest-408043841 None] Acquiring lock "cinder-quobyte-88a1555c-fb4d-496b-83b1-02cdbd3b7e2c" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:23:31 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-9fbbd2f6-5e81-4fb0-8c09-5e4c3f6aa905 tempest-GroupSnapshotsTest-408043841 None] Lock "cinder-quobyte-88a1555c-fb4d-496b-83b1-02cdbd3b7e2c" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:23:31 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-9fbbd2f6-5e81-4fb0-8c09-5e4c3f6aa905 tempest-GroupSnapshotsTest-408043841 None] Deleting offline snapshot 88a1555c-fb4d-496b-83b1-02cdbd3b7e2c of volume 400389b3-f586-4a4f-85fa-a27d075dc427 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:23:31 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-9fbbd2f6-5e81-4fb0-8c09-5e4c3f6aa905 tempest-GroupSnapshotsTest-408043841 None] snapshot_file for this snap is: volume-400389b3-f586-4a4f-85fa-a27d075dc427.88a1555c-fb4d-496b-83b1-02cdbd3b7e2c {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:23:32 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a83600-d2c8-4847-bd1f-79a95bbf2546]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:23:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9fbbd2f6-5e81-4fb0-8c09-5e4c3f6aa905 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427.88a1555c-fb4d-496b-83b1-02cdbd3b7e2c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:32 devstack sudo[95315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427.88a1555c-fb4d-496b-83b1-02cdbd3b7e2c Jun 02 03:23:32 devstack sudo[95315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:32 devstack sudo[95315]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9fbbd2f6-5e81-4fb0-8c09-5e4c3f6aa905 tempest-GroupSnapshotsTest-408043841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427.88a1555c-fb4d-496b-83b1-02cdbd3b7e2c" returned: 0 in 0.951s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:32 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-9fbbd2f6-5e81-4fb0-8c09-5e4c3f6aa905 tempest-GroupSnapshotsTest-408043841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-400389b3-f586-4a4f-85fa-a27d075dc427(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:23:33 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a205dd1-7b85-4236-b218-81d9980eac3d]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:23:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9fbbd2f6-5e81-4fb0-8c09-5e4c3f6aa905 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:33 devstack sudo[95336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427 Jun 02 03:23:33 devstack sudo[95336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:33 devstack sudo[95336]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9fbbd2f6-5e81-4fb0-8c09-5e4c3f6aa905 tempest-GroupSnapshotsTest-408043841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427" returned: 0 in 0.866s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9fbbd2f6-5e81-4fb0-8c09-5e4c3f6aa905 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427.88a1555c-fb4d-496b-83b1-02cdbd3b7e2c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:33 devstack sudo[95341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427.88a1555c-fb4d-496b-83b1-02cdbd3b7e2c Jun 02 03:23:33 devstack sudo[95341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:35 devstack sudo[95341]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9fbbd2f6-5e81-4fb0-8c09-5e4c3f6aa905 tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427.88a1555c-fb4d-496b-83b1-02cdbd3b7e2c" returned: 0 in 1.131s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9fbbd2f6-5e81-4fb0-8c09-5e4c3f6aa905 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427.88a1555c-fb4d-496b-83b1-02cdbd3b7e2c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:35 devstack sudo[95347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427.88a1555c-fb4d-496b-83b1-02cdbd3b7e2c Jun 02 03:23:35 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:35 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9fbbd2f6-5e81-4fb0-8c09-5e4c3f6aa905 tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427.88a1555c-fb4d-496b-83b1-02cdbd3b7e2c" returned: 0 in 0.800s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:35 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-9fbbd2f6-5e81-4fb0-8c09-5e4c3f6aa905 tempest-GroupSnapshotsTest-408043841 None] Lock "cinder-quobyte-88a1555c-fb4d-496b-83b1-02cdbd3b7e2c" released by "_delete_snapshot" :: held 3.983s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:23:35 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-9fbbd2f6-5e81-4fb0-8c09-5e4c3f6aa905 tempest-GroupSnapshotsTest-408043841 None] Lock "cinder-quobyte-400389b3-f586-4a4f-85fa-a27d075dc427" released by "delete_snapshot" :: held 4.038s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:23:36 devstack cinder-volume[86431]: WARNING cinder.quota [None req-9fbbd2f6-5e81-4fb0-8c09-5e4c3f6aa905 tempest-GroupSnapshotsTest-408043841 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-231852689 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-231852689, it is now deprecated. Please use the default quota class for default quota. Jun 02 03:23:36 devstack cinder-volume[86431]: WARNING cinder.quota [None req-9fbbd2f6-5e81-4fb0-8c09-5e4c3f6aa905 tempest-GroupSnapshotsTest-408043841 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-231852689 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-231852689, it is now deprecated. Please use the default quota class for default quota. Jun 02 03:23:36 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-9fbbd2f6-5e81-4fb0-8c09-5e4c3f6aa905 tempest-GroupSnapshotsTest-408043841 None] Created reservations ['41b69329-1c75-4e55-a6a6-d09597133909', 'b1537fa2-4893-4847-b2b6-f762d0d18161', 'fb7c48dd-1f00-4f21-abc8-75b53b07d2a1', 'ddc2c713-1371-4064-9af3-f67183a28cbc'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:23:36 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-9fbbd2f6-5e81-4fb0-8c09-5e4c3f6aa905 tempest-GroupSnapshotsTest-408043841 None] group_snapshot 1f39c02a-de7c-49df-8bb9-d6368c063dc2: deleted successfully Jun 02 03:23:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-62568c5a-ce12-4129-bb95-ac6ff652ca17 tempest-GroupSnapshotsTest-408043841 None] Acquiring lock "cinder-quobyte-400389b3-f586-4a4f-85fa-a27d075dc427" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:23:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-62568c5a-ce12-4129-bb95-ac6ff652ca17 tempest-GroupSnapshotsTest-408043841 None] Lock "cinder-quobyte-400389b3-f586-4a4f-85fa-a27d075dc427" acquired by "delete_volume" :: waited 0.033s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:23:36 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bd8ffa-ee21-40dd-9bc7-cdb9a44cabc7]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:23:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-62568c5a-ce12-4129-bb95-ac6ff652ca17 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1385f323-676f-4690-aea1-7bfe505781fc tempest-AttachVolumeNegativeTest-1165991087 None] Acquiring lock "cinder-2c87359e-b916-4c7d-9d37-76e9e7a68b47-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:23:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1385f323-676f-4690-aea1-7bfe505781fc tempest-AttachVolumeNegativeTest-1165991087 None] Lock "cinder-2c87359e-b916-4c7d-9d37-76e9e7a68b47-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:23:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1385f323-676f-4690-aea1-7bfe505781fc tempest-AttachVolumeNegativeTest-1165991087 None] Acquiring lock "cinder-quobyte-2c87359e-b916-4c7d-9d37-76e9e7a68b47" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:23:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1385f323-676f-4690-aea1-7bfe505781fc tempest-AttachVolumeNegativeTest-1165991087 None] Lock "cinder-quobyte-2c87359e-b916-4c7d-9d37-76e9e7a68b47" acquired by "delete_volume" :: waited 0.023s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:23:36 devstack sudo[95351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427 Jun 02 03:23:36 devstack sudo[95351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:36 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5372a5-66a4-4564-8946-96cd0c38472a]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:23:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1385f323-676f-4690-aea1-7bfe505781fc tempest-AttachVolumeNegativeTest-1165991087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2c87359e-b916-4c7d-9d37-76e9e7a68b47 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:37 devstack sudo[95353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2c87359e-b916-4c7d-9d37-76e9e7a68b47 Jun 02 03:23:37 devstack sudo[95353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:37 devstack sudo[95351]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-62568c5a-ce12-4129-bb95-ac6ff652ca17 tempest-GroupSnapshotsTest-408043841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427" returned: 0 in 1.155s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-62568c5a-ce12-4129-bb95-ac6ff652ca17 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:37 devstack sudo[95359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427 Jun 02 03:23:37 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:38 devstack sudo[95353]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1385f323-676f-4690-aea1-7bfe505781fc tempest-AttachVolumeNegativeTest-1165991087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2c87359e-b916-4c7d-9d37-76e9e7a68b47" returned: 0 in 1.082s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1385f323-676f-4690-aea1-7bfe505781fc tempest-AttachVolumeNegativeTest-1165991087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2c87359e-b916-4c7d-9d37-76e9e7a68b47 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:38 devstack sudo[95363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2c87359e-b916-4c7d-9d37-76e9e7a68b47 Jun 02 03:23:38 devstack sudo[95363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:38 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-62568c5a-ce12-4129-bb95-ac6ff652ca17 tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-400389b3-f586-4a4f-85fa-a27d075dc427" returned: 0 in 0.819s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:38 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-62568c5a-ce12-4129-bb95-ac6ff652ca17 tempest-GroupSnapshotsTest-408043841 None] Lock "cinder-quobyte-400389b3-f586-4a4f-85fa-a27d075dc427" released by "delete_volume" :: held 2.055s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:23:38 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-62568c5a-ce12-4129-bb95-ac6ff652ca17 tempest-GroupSnapshotsTest-408043841 None] Created reservations ['3f701706-02f6-42b1-9829-ba77dbea3a3d'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:23:38 devstack cinder-volume[86431]: WARNING cinder.quota [None req-62568c5a-ce12-4129-bb95-ac6ff652ca17 tempest-GroupSnapshotsTest-408043841 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-231852689 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-231852689, it is now deprecated. Please use the default quota class for default quota. Jun 02 03:23:38 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-62568c5a-ce12-4129-bb95-ac6ff652ca17 tempest-GroupSnapshotsTest-408043841 None] Created reservations ['e4585df6-2c50-4c47-a5dd-a9cb70f2f16a', '989a7106-b2a4-4940-ace0-5648dcefcda3', '0af33782-7b25-4a1b-ae18-a8d29f9dc56b', 'c87d7229-0b47-4056-9288-958a9dc52e16'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:23:38 devstack sudo[95363]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1385f323-676f-4690-aea1-7bfe505781fc tempest-AttachVolumeNegativeTest-1165991087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2c87359e-b916-4c7d-9d37-76e9e7a68b47" returned: 0 in 0.830s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:38 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1385f323-676f-4690-aea1-7bfe505781fc tempest-AttachVolumeNegativeTest-1165991087 None] Lock "cinder-quobyte-2c87359e-b916-4c7d-9d37-76e9e7a68b47" released by "delete_volume" :: held 2.007s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:23:39 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-1385f323-676f-4690-aea1-7bfe505781fc tempest-AttachVolumeNegativeTest-1165991087 None] Created reservations ['fac8ba84-0bba-4524-afe5-4dad57ffb736', 'af8a5006-1875-4152-aa81-41e32884b762', '7d3b88da-0617-4bba-babb-555fb6883e17', '26c302d1-b2c7-4457-bab6-69a1e5f7a587'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:23:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-62568c5a-ce12-4129-bb95-ac6ff652ca17 tempest-GroupSnapshotsTest-408043841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:23:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-62568c5a-ce12-4129-bb95-ac6ff652ca17 tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:23:39 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-62568c5a-ce12-4129-bb95-ac6ff652ca17 tempest-GroupSnapshotsTest-408043841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:23:39 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-62568c5a-ce12-4129-bb95-ac6ff652ca17 tempest-GroupSnapshotsTest-408043841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:23:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-62568c5a-ce12-4129-bb95-ac6ff652ca17 tempest-GroupSnapshotsTest-408043841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:23:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-62568c5a-ce12-4129-bb95-ac6ff652ca17 tempest-GroupSnapshotsTest-408043841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:39 devstack sudo[95368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:23:39 devstack sudo[95368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1385f323-676f-4690-aea1-7bfe505781fc tempest-AttachVolumeNegativeTest-1165991087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:23:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1385f323-676f-4690-aea1-7bfe505781fc tempest-AttachVolumeNegativeTest-1165991087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:23:39 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-1385f323-676f-4690-aea1-7bfe505781fc tempest-AttachVolumeNegativeTest-1165991087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:23:39 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-1385f323-676f-4690-aea1-7bfe505781fc tempest-AttachVolumeNegativeTest-1165991087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:23:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1385f323-676f-4690-aea1-7bfe505781fc tempest-AttachVolumeNegativeTest-1165991087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:23:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1385f323-676f-4690-aea1-7bfe505781fc tempest-AttachVolumeNegativeTest-1165991087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:39 devstack sudo[95370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:23:39 devstack sudo[95370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:39 devstack sudo[95370]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1385f323-676f-4690-aea1-7bfe505781fc tempest-AttachVolumeNegativeTest-1165991087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.671s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:39 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-1385f323-676f-4690-aea1-7bfe505781fc tempest-AttachVolumeNegativeTest-1165991087 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:23:39 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-1385f323-676f-4690-aea1-7bfe505781fc tempest-AttachVolumeNegativeTest-1165991087 None] Deleted volume successfully. Jun 02 03:23:39 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1385f323-676f-4690-aea1-7bfe505781fc tempest-AttachVolumeNegativeTest-1165991087 None] Lock "cinder-2c87359e-b916-4c7d-9d37-76e9e7a68b47-delete_volume" released by "delete_volume" :: held 3.036s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:23:40 devstack sudo[95368]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-62568c5a-ce12-4129-bb95-ac6ff652ca17 tempest-GroupSnapshotsTest-408043841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.998s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:40 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-62568c5a-ce12-4129-bb95-ac6ff652ca17 tempest-GroupSnapshotsTest-408043841 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:23:40 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-62568c5a-ce12-4129-bb95-ac6ff652ca17 tempest-GroupSnapshotsTest-408043841 None] Delete group completed successfully. Jun 02 03:23:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4ca528df-377f-4294-951e-7aa24bf1dbc0 tempest-AttachVolumeNegativeTest-1165991087 None] Acquiring lock "cinder-d68953c0-006f-4ed1-be97-5343f0c3d53e-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:23:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4ca528df-377f-4294-951e-7aa24bf1dbc0 tempest-AttachVolumeNegativeTest-1165991087 None] Lock "cinder-d68953c0-006f-4ed1-be97-5343f0c3d53e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:23:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4ca528df-377f-4294-951e-7aa24bf1dbc0 tempest-AttachVolumeNegativeTest-1165991087 None] Acquiring lock "cinder-quobyte-d68953c0-006f-4ed1-be97-5343f0c3d53e" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:23:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4ca528df-377f-4294-951e-7aa24bf1dbc0 tempest-AttachVolumeNegativeTest-1165991087 None] Lock "cinder-quobyte-d68953c0-006f-4ed1-be97-5343f0c3d53e" acquired by "delete_volume" :: waited 0.033s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:23:40 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[56193c83-b850-4d47-849f-06c7132e52ed]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:23:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4ca528df-377f-4294-951e-7aa24bf1dbc0 tempest-AttachVolumeNegativeTest-1165991087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d68953c0-006f-4ed1-be97-5343f0c3d53e {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:40 devstack sudo[95374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d68953c0-006f-4ed1-be97-5343f0c3d53e Jun 02 03:23:40 devstack sudo[95374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:41 devstack sudo[95374]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4ca528df-377f-4294-951e-7aa24bf1dbc0 tempest-AttachVolumeNegativeTest-1165991087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d68953c0-006f-4ed1-be97-5343f0c3d53e" returned: 0 in 0.775s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4ca528df-377f-4294-951e-7aa24bf1dbc0 tempest-AttachVolumeNegativeTest-1165991087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d68953c0-006f-4ed1-be97-5343f0c3d53e {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:41 devstack sudo[95379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d68953c0-006f-4ed1-be97-5343f0c3d53e Jun 02 03:23:41 devstack sudo[95379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:42 devstack sudo[95379]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4ca528df-377f-4294-951e-7aa24bf1dbc0 tempest-AttachVolumeNegativeTest-1165991087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d68953c0-006f-4ed1-be97-5343f0c3d53e" returned: 0 in 0.840s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:42 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4ca528df-377f-4294-951e-7aa24bf1dbc0 tempest-AttachVolumeNegativeTest-1165991087 None] Lock "cinder-quobyte-d68953c0-006f-4ed1-be97-5343f0c3d53e" released by "delete_volume" :: held 1.681s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:23:42 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-4ca528df-377f-4294-951e-7aa24bf1dbc0 tempest-AttachVolumeNegativeTest-1165991087 None] Created reservations ['c39be21f-ae05-49a5-bc24-5bfc1b13a671', '1a26404c-c4d3-4578-ae28-4c36e0155fd8', '6cd60bb2-cc53-41d5-9a08-c9240168f14f', '18ea2d45-141e-4db2-b5c4-5df1ad828ce8'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:23:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4ca528df-377f-4294-951e-7aa24bf1dbc0 tempest-AttachVolumeNegativeTest-1165991087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:23:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4ca528df-377f-4294-951e-7aa24bf1dbc0 tempest-AttachVolumeNegativeTest-1165991087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:23:42 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-4ca528df-377f-4294-951e-7aa24bf1dbc0 tempest-AttachVolumeNegativeTest-1165991087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:23:42 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-4ca528df-377f-4294-951e-7aa24bf1dbc0 tempest-AttachVolumeNegativeTest-1165991087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:23:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4ca528df-377f-4294-951e-7aa24bf1dbc0 tempest-AttachVolumeNegativeTest-1165991087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:23:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4ca528df-377f-4294-951e-7aa24bf1dbc0 tempest-AttachVolumeNegativeTest-1165991087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:42 devstack sudo[95383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:23:42 devstack sudo[95383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:43 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f95614a9-8280-4d43-bd2a-5a9cae783dfb tempest-AttachVolumeNegativeTest-1165991087 None] Acquiring lock "cinder-3f3824c7-901d-4494-8faf-5027c3245ad8-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:23:43 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f95614a9-8280-4d43-bd2a-5a9cae783dfb tempest-AttachVolumeNegativeTest-1165991087 None] Lock "cinder-3f3824c7-901d-4494-8faf-5027c3245ad8-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:23:43 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f95614a9-8280-4d43-bd2a-5a9cae783dfb tempest-AttachVolumeNegativeTest-1165991087 None] Acquiring lock "cinder-quobyte-3f3824c7-901d-4494-8faf-5027c3245ad8" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:23:43 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f95614a9-8280-4d43-bd2a-5a9cae783dfb tempest-AttachVolumeNegativeTest-1165991087 None] Lock "cinder-quobyte-3f3824c7-901d-4494-8faf-5027c3245ad8" acquired by "delete_volume" :: waited 0.054s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:23:43 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[03234be6-0414-4aa6-aea3-80284276674a]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:23:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f95614a9-8280-4d43-bd2a-5a9cae783dfb tempest-AttachVolumeNegativeTest-1165991087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3f3824c7-901d-4494-8faf-5027c3245ad8 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:43 devstack sudo[95383]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4ca528df-377f-4294-951e-7aa24bf1dbc0 tempest-AttachVolumeNegativeTest-1165991087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 1.101s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:43 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-4ca528df-377f-4294-951e-7aa24bf1dbc0 tempest-AttachVolumeNegativeTest-1165991087 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:23:43 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-4ca528df-377f-4294-951e-7aa24bf1dbc0 tempest-AttachVolumeNegativeTest-1165991087 None] Deleted volume successfully. Jun 02 03:23:43 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4ca528df-377f-4294-951e-7aa24bf1dbc0 tempest-AttachVolumeNegativeTest-1165991087 None] Lock "cinder-d68953c0-006f-4ed1-be97-5343f0c3d53e-delete_volume" released by "delete_volume" :: held 3.175s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:23:43 devstack sudo[95386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3f3824c7-901d-4494-8faf-5027c3245ad8 Jun 02 03:23:43 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:44 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-5283e734-afe9-401f-b3cd-a1816624d2b7 tempest-AbsoluteLimitsTests-1538435796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:23:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-5283e734-afe9-401f-b3cd-a1816624d2b7 tempest-AbsoluteLimitsTests-1538435796 None] Flow 'volume_create_manager' (2efe8e1a-e5de-480e-84f1-da273e6c2dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:23:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-5283e734-afe9-401f-b3cd-a1816624d2b7 tempest-AbsoluteLimitsTests-1538435796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b812ef7-c985-47e4-9f81-c3af282b68c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-5283e734-afe9-401f-b3cd-a1816624d2b7 tempest-AbsoluteLimitsTests-1538435796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b812ef7-c985-47e4-9f81-c3af282b68c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1213767074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1ed311a-e639-4fda-abe3-b557daf23af8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9be8ffc788a44c96a0961528568e3f61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:23:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:23:44Z,use_quota=True,user_id='79b75895ee944393a52ca6f5c5bda991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-5283e734-afe9-401f-b3cd-a1816624d2b7 tempest-AbsoluteLimitsTests-1538435796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77eb2aef-bc1a-4970-aa07-7d464738b0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-5283e734-afe9-401f-b3cd-a1816624d2b7 tempest-AbsoluteLimitsTests-1538435796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77eb2aef-bc1a-4970-aa07-7d464738b0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-5283e734-afe9-401f-b3cd-a1816624d2b7 tempest-AbsoluteLimitsTests-1538435796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2849b20-c02f-4c18-9196-b6ff734e39a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-5283e734-afe9-401f-b3cd-a1816624d2b7 tempest-AbsoluteLimitsTests-1538435796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2849b20-c02f-4c18-9196-b6ff734e39a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1ed311a-e639-4fda-abe3-b557daf23af8', 'volume_name': 'volume-e1ed311a-e639-4fda-abe3-b557daf23af8', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-5283e734-afe9-401f-b3cd-a1816624d2b7 tempest-AbsoluteLimitsTests-1538435796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0063ea51-1848-4da2-8a57-675dfe781069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-5283e734-afe9-401f-b3cd-a1816624d2b7 tempest-AbsoluteLimitsTests-1538435796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0063ea51-1848-4da2-8a57-675dfe781069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-5283e734-afe9-401f-b3cd-a1816624d2b7 tempest-AbsoluteLimitsTests-1538435796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (155010ef-b3bc-4944-8e97-23982cc579c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:44 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-5283e734-afe9-401f-b3cd-a1816624d2b7 tempest-AbsoluteLimitsTests-1538435796 None] Volume e1ed311a-e639-4fda-abe3-b557daf23af8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1ed311a-e639-4fda-abe3-b557daf23af8', 'volume_size': 1} Jun 02 03:23:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5283e734-afe9-401f-b3cd-a1816624d2b7 tempest-AbsoluteLimitsTests-1538435796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:23:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5283e734-afe9-401f-b3cd-a1816624d2b7 tempest-AbsoluteLimitsTests-1538435796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:23:44 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-5283e734-afe9-401f-b3cd-a1816624d2b7 tempest-AbsoluteLimitsTests-1538435796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1213767074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1ed311a-e639-4fda-abe3-b557daf23af8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9be8ffc788a44c96a0961528568e3f61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:23:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:23:44Z,use_quota=True,user_id='79b75895ee944393a52ca6f5c5bda991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:23:44 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-5283e734-afe9-401f-b3cd-a1816624d2b7 tempest-AbsoluteLimitsTests-1538435796 None] Creating volume e1ed311a-e639-4fda-abe3-b557daf23af8 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:23:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5283e734-afe9-401f-b3cd-a1816624d2b7 tempest-AbsoluteLimitsTests-1538435796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:23:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5283e734-afe9-401f-b3cd-a1816624d2b7 tempest-AbsoluteLimitsTests-1538435796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:23:44 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-5283e734-afe9-401f-b3cd-a1816624d2b7 tempest-AbsoluteLimitsTests-1538435796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:23:44 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-5283e734-afe9-401f-b3cd-a1816624d2b7 tempest-AbsoluteLimitsTests-1538435796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:23:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5283e734-afe9-401f-b3cd-a1816624d2b7 tempest-AbsoluteLimitsTests-1538435796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:23:44 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-5283e734-afe9-401f-b3cd-a1816624d2b7 tempest-AbsoluteLimitsTests-1538435796 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:23:44 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-5283e734-afe9-401f-b3cd-a1816624d2b7 tempest-AbsoluteLimitsTests-1538435796 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:23:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5283e734-afe9-401f-b3cd-a1816624d2b7 tempest-AbsoluteLimitsTests-1538435796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e1ed311a-e639-4fda-abe3-b557daf23af8 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:44 devstack sudo[95390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e1ed311a-e639-4fda-abe3-b557daf23af8 1073741824 Jun 02 03:23:44 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:44 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f95614a9-8280-4d43-bd2a-5a9cae783dfb tempest-AttachVolumeNegativeTest-1165991087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3f3824c7-901d-4494-8faf-5027c3245ad8" returned: 0 in 1.195s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f95614a9-8280-4d43-bd2a-5a9cae783dfb tempest-AttachVolumeNegativeTest-1165991087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3f3824c7-901d-4494-8faf-5027c3245ad8 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:44 devstack sudo[95393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3f3824c7-901d-4494-8faf-5027c3245ad8 Jun 02 03:23:44 devstack sudo[95393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:45 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5283e734-afe9-401f-b3cd-a1816624d2b7 tempest-AbsoluteLimitsTests-1538435796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e1ed311a-e639-4fda-abe3-b557daf23af8 1073741824" returned: 0 in 0.892s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5283e734-afe9-401f-b3cd-a1816624d2b7 tempest-AbsoluteLimitsTests-1538435796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e1ed311a-e639-4fda-abe3-b557daf23af8 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:45 devstack sudo[95400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e1ed311a-e639-4fda-abe3-b557daf23af8 Jun 02 03:23:45 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:45 devstack sudo[95393]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f95614a9-8280-4d43-bd2a-5a9cae783dfb tempest-AttachVolumeNegativeTest-1165991087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3f3824c7-901d-4494-8faf-5027c3245ad8" returned: 0 in 0.774s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:45 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f95614a9-8280-4d43-bd2a-5a9cae783dfb tempest-AttachVolumeNegativeTest-1165991087 None] Lock "cinder-quobyte-3f3824c7-901d-4494-8faf-5027c3245ad8" released by "delete_volume" :: held 2.050s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:23:45 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-f95614a9-8280-4d43-bd2a-5a9cae783dfb tempest-AttachVolumeNegativeTest-1165991087 None] Created reservations ['0a14c400-cc86-48cc-8b4c-f13636925b54', 'cd12e16d-c3f2-46e6-b468-3d9def70ad4e', 'aa820c8e-0f2f-4fc9-a3a0-057e3e2eaa76', 'ba8b0a38-0a65-413a-a059-a78e51f5c822'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:23:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-f95614a9-8280-4d43-bd2a-5a9cae783dfb tempest-AttachVolumeNegativeTest-1165991087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:23:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-f95614a9-8280-4d43-bd2a-5a9cae783dfb tempest-AttachVolumeNegativeTest-1165991087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:23:45 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-f95614a9-8280-4d43-bd2a-5a9cae783dfb tempest-AttachVolumeNegativeTest-1165991087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:23:45 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-f95614a9-8280-4d43-bd2a-5a9cae783dfb tempest-AttachVolumeNegativeTest-1165991087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:23:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-f95614a9-8280-4d43-bd2a-5a9cae783dfb tempest-AttachVolumeNegativeTest-1165991087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:23:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f95614a9-8280-4d43-bd2a-5a9cae783dfb tempest-AttachVolumeNegativeTest-1165991087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:45 devstack sudo[95402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:23:45 devstack sudo[95402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:45 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5283e734-afe9-401f-b3cd-a1816624d2b7 tempest-AbsoluteLimitsTests-1538435796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e1ed311a-e639-4fda-abe3-b557daf23af8" returned: 0 in 0.725s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:45 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-5283e734-afe9-401f-b3cd-a1816624d2b7 tempest-AbsoluteLimitsTests-1538435796 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:23:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5283e734-afe9-401f-b3cd-a1816624d2b7 tempest-AbsoluteLimitsTests-1538435796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:23:46 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-5283e734-afe9-401f-b3cd-a1816624d2b7 tempest-AbsoluteLimitsTests-1538435796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (155010ef-b3bc-4944-8e97-23982cc579c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1ed311a-e639-4fda-abe3-b557daf23af8', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:46 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-5283e734-afe9-401f-b3cd-a1816624d2b7 tempest-AbsoluteLimitsTests-1538435796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f7ba8d0-c6b2-44a3-ba3e-f7a79b51b20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:46 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-5283e734-afe9-401f-b3cd-a1816624d2b7 tempest-AbsoluteLimitsTests-1538435796 None] Volume volume-e1ed311a-e639-4fda-abe3-b557daf23af8 (e1ed311a-e639-4fda-abe3-b557daf23af8): created successfully Jun 02 03:23:46 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-5283e734-afe9-401f-b3cd-a1816624d2b7 tempest-AbsoluteLimitsTests-1538435796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f7ba8d0-c6b2-44a3-ba3e-f7a79b51b20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:46 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-5283e734-afe9-401f-b3cd-a1816624d2b7 tempest-AbsoluteLimitsTests-1538435796 None] Flow 'volume_create_manager' (2efe8e1a-e5de-480e-84f1-da273e6c2dd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:23:46 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-5283e734-afe9-401f-b3cd-a1816624d2b7 tempest-AbsoluteLimitsTests-1538435796 None] Created volume successfully. Jun 02 03:23:46 devstack sudo[95402]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f95614a9-8280-4d43-bd2a-5a9cae783dfb tempest-AttachVolumeNegativeTest-1165991087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.718s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:46 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-f95614a9-8280-4d43-bd2a-5a9cae783dfb tempest-AttachVolumeNegativeTest-1165991087 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:23:46 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-f95614a9-8280-4d43-bd2a-5a9cae783dfb tempest-AttachVolumeNegativeTest-1165991087 None] Deleted volume successfully. Jun 02 03:23:46 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f95614a9-8280-4d43-bd2a-5a9cae783dfb tempest-AttachVolumeNegativeTest-1165991087 None] Lock "cinder-3f3824c7-901d-4494-8faf-5027c3245ad8-delete_volume" released by "delete_volume" :: held 3.180s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:23:46 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-37375ee9-3ce8-452d-ac5a-375b75b0aa5d tempest-AbsoluteLimitsTests-1538435796 None] Acquiring lock "cinder-e1ed311a-e639-4fda-abe3-b557daf23af8-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:23:46 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-37375ee9-3ce8-452d-ac5a-375b75b0aa5d tempest-AbsoluteLimitsTests-1538435796 None] Lock "cinder-e1ed311a-e639-4fda-abe3-b557daf23af8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:23:46 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-37375ee9-3ce8-452d-ac5a-375b75b0aa5d tempest-AbsoluteLimitsTests-1538435796 None] Acquiring lock "cinder-quobyte-e1ed311a-e639-4fda-abe3-b557daf23af8" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:23:46 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-37375ee9-3ce8-452d-ac5a-375b75b0aa5d tempest-AbsoluteLimitsTests-1538435796 None] Lock "cinder-quobyte-e1ed311a-e639-4fda-abe3-b557daf23af8" acquired by "delete_volume" :: waited 0.023s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:23:46 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[351cb9f6-069b-427a-8982-a528cb581942]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:23:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-37375ee9-3ce8-452d-ac5a-375b75b0aa5d tempest-AbsoluteLimitsTests-1538435796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e1ed311a-e639-4fda-abe3-b557daf23af8 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:46 devstack sudo[95408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e1ed311a-e639-4fda-abe3-b557daf23af8 Jun 02 03:23:46 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:47 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-37375ee9-3ce8-452d-ac5a-375b75b0aa5d tempest-AbsoluteLimitsTests-1538435796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e1ed311a-e639-4fda-abe3-b557daf23af8" returned: 0 in 0.884s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-37375ee9-3ce8-452d-ac5a-375b75b0aa5d tempest-AbsoluteLimitsTests-1538435796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e1ed311a-e639-4fda-abe3-b557daf23af8 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:47 devstack sudo[95413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e1ed311a-e639-4fda-abe3-b557daf23af8 Jun 02 03:23:47 devstack sudo[95413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:48 devstack sudo[95413]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-37375ee9-3ce8-452d-ac5a-375b75b0aa5d tempest-AbsoluteLimitsTests-1538435796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e1ed311a-e639-4fda-abe3-b557daf23af8" returned: 0 in 0.607s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:48 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-37375ee9-3ce8-452d-ac5a-375b75b0aa5d tempest-AbsoluteLimitsTests-1538435796 None] Lock "cinder-quobyte-e1ed311a-e639-4fda-abe3-b557daf23af8" released by "delete_volume" :: held 1.547s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:23:48 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-37375ee9-3ce8-452d-ac5a-375b75b0aa5d tempest-AbsoluteLimitsTests-1538435796 None] Created reservations ['e416745b-c67a-4bd3-b8f7-21745953f88e', '08a1afe1-8a65-42bd-96fc-fe0184c57bf3', '257d562a-34f2-49e3-8271-cebf98095697', '32da2b52-6616-4a97-b8e4-4777ff43ef41'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:23:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-37375ee9-3ce8-452d-ac5a-375b75b0aa5d tempest-AbsoluteLimitsTests-1538435796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:23:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-37375ee9-3ce8-452d-ac5a-375b75b0aa5d tempest-AbsoluteLimitsTests-1538435796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:23:48 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-37375ee9-3ce8-452d-ac5a-375b75b0aa5d tempest-AbsoluteLimitsTests-1538435796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:23:48 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-37375ee9-3ce8-452d-ac5a-375b75b0aa5d tempest-AbsoluteLimitsTests-1538435796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:23:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-37375ee9-3ce8-452d-ac5a-375b75b0aa5d tempest-AbsoluteLimitsTests-1538435796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:23:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-37375ee9-3ce8-452d-ac5a-375b75b0aa5d tempest-AbsoluteLimitsTests-1538435796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:48 devstack sudo[95417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:23:48 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:49 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-37375ee9-3ce8-452d-ac5a-375b75b0aa5d tempest-AbsoluteLimitsTests-1538435796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.715s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:49 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-37375ee9-3ce8-452d-ac5a-375b75b0aa5d tempest-AbsoluteLimitsTests-1538435796 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:23:49 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-37375ee9-3ce8-452d-ac5a-375b75b0aa5d tempest-AbsoluteLimitsTests-1538435796 None] Deleted volume successfully. Jun 02 03:23:49 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-37375ee9-3ce8-452d-ac5a-375b75b0aa5d tempest-AbsoluteLimitsTests-1538435796 None] Lock "cinder-e1ed311a-e639-4fda-abe3-b557daf23af8-delete_volume" released by "delete_volume" :: held 2.579s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:23:53 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-224873d0-6f3c-4d7a-942c-bb8884cb78b9 tempest-VolumesCloneNegativeTest-1598141060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:23:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-224873d0-6f3c-4d7a-942c-bb8884cb78b9 tempest-VolumesCloneNegativeTest-1598141060 None] Flow 'volume_create_manager' (14d70cc2-7656-4703-8d3e-10304da38ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:23:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-224873d0-6f3c-4d7a-942c-bb8884cb78b9 tempest-VolumesCloneNegativeTest-1598141060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4c08089-2ab8-402c-8f9a-5287777caed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-224873d0-6f3c-4d7a-942c-bb8884cb78b9 tempest-VolumesCloneNegativeTest-1598141060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4c08089-2ab8-402c-8f9a-5287777caed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1599414474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d476101f-189a-4d0b-9865-a1fc66088a40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca16e820f014d01947af120de712064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:23:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:23:54Z,use_quota=True,user_id='e58c43cd0bc444c7a0f24168db6922ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-224873d0-6f3c-4d7a-942c-bb8884cb78b9 tempest-VolumesCloneNegativeTest-1598141060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b99bf6a-bd8f-4a1e-bc17-7e0a7b698043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-224873d0-6f3c-4d7a-942c-bb8884cb78b9 tempest-VolumesCloneNegativeTest-1598141060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b99bf6a-bd8f-4a1e-bc17-7e0a7b698043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-224873d0-6f3c-4d7a-942c-bb8884cb78b9 tempest-VolumesCloneNegativeTest-1598141060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91201804-f1f9-44f4-9b1f-b56102099c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-224873d0-6f3c-4d7a-942c-bb8884cb78b9 tempest-VolumesCloneNegativeTest-1598141060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91201804-f1f9-44f4-9b1f-b56102099c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd476101f-189a-4d0b-9865-a1fc66088a40', 'volume_name': 'volume-d476101f-189a-4d0b-9865-a1fc66088a40', 'volume_size': 2}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-224873d0-6f3c-4d7a-942c-bb8884cb78b9 tempest-VolumesCloneNegativeTest-1598141060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (540783b2-1648-4e1f-bca0-65d489fae425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-224873d0-6f3c-4d7a-942c-bb8884cb78b9 tempest-VolumesCloneNegativeTest-1598141060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (540783b2-1648-4e1f-bca0-65d489fae425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-224873d0-6f3c-4d7a-942c-bb8884cb78b9 tempest-VolumesCloneNegativeTest-1598141060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e181497-8f6f-4f89-883a-854ef6a60734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:53 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-224873d0-6f3c-4d7a-942c-bb8884cb78b9 tempest-VolumesCloneNegativeTest-1598141060 None] Volume d476101f-189a-4d0b-9865-a1fc66088a40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d476101f-189a-4d0b-9865-a1fc66088a40', 'volume_size': 2} Jun 02 03:23:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-224873d0-6f3c-4d7a-942c-bb8884cb78b9 tempest-VolumesCloneNegativeTest-1598141060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:23:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-224873d0-6f3c-4d7a-942c-bb8884cb78b9 tempest-VolumesCloneNegativeTest-1598141060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:23:53 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-224873d0-6f3c-4d7a-942c-bb8884cb78b9 tempest-VolumesCloneNegativeTest-1598141060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1599414474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d476101f-189a-4d0b-9865-a1fc66088a40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca16e820f014d01947af120de712064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:23:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:23:54Z,use_quota=True,user_id='e58c43cd0bc444c7a0f24168db6922ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:23:53 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-224873d0-6f3c-4d7a-942c-bb8884cb78b9 tempest-VolumesCloneNegativeTest-1598141060 None] Creating volume d476101f-189a-4d0b-9865-a1fc66088a40 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:23:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-224873d0-6f3c-4d7a-942c-bb8884cb78b9 tempest-VolumesCloneNegativeTest-1598141060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:23:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-224873d0-6f3c-4d7a-942c-bb8884cb78b9 tempest-VolumesCloneNegativeTest-1598141060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:23:53 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-224873d0-6f3c-4d7a-942c-bb8884cb78b9 tempest-VolumesCloneNegativeTest-1598141060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:23:53 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-224873d0-6f3c-4d7a-942c-bb8884cb78b9 tempest-VolumesCloneNegativeTest-1598141060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:23:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-224873d0-6f3c-4d7a-942c-bb8884cb78b9 tempest-VolumesCloneNegativeTest-1598141060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:23:53 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-224873d0-6f3c-4d7a-942c-bb8884cb78b9 tempest-VolumesCloneNegativeTest-1598141060 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:23:53 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-224873d0-6f3c-4d7a-942c-bb8884cb78b9 tempest-VolumesCloneNegativeTest-1598141060 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:23:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-224873d0-6f3c-4d7a-942c-bb8884cb78b9 tempest-VolumesCloneNegativeTest-1598141060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d476101f-189a-4d0b-9865-a1fc66088a40 2147483648 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:53 devstack sudo[95422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d476101f-189a-4d0b-9865-a1fc66088a40 2147483648 Jun 02 03:23:53 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:54 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-60a758ce-4a5e-40ea-a948-9bc6506c672b tempest-VolumesTestJSON-1541563253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:23:54 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-60a758ce-4a5e-40ea-a948-9bc6506c672b tempest-VolumesTestJSON-1541563253 None] Flow 'volume_create_manager' (ebbf1000-3168-4c64-8bc9-92341c45a2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:23:54 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-60a758ce-4a5e-40ea-a948-9bc6506c672b tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5550107-8de7-468e-b579-fd59bfd5792e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:54 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-224873d0-6f3c-4d7a-942c-bb8884cb78b9 tempest-VolumesCloneNegativeTest-1598141060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d476101f-189a-4d0b-9865-a1fc66088a40 2147483648" returned: 0 in 1.086s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:54 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-60a758ce-4a5e-40ea-a948-9bc6506c672b tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5550107-8de7-468e-b579-fd59bfd5792e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2057222760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8edbde7a-0688-4c1c-9530-86ef9ef8aa77,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2b0cdb0edc834f4ca637a13e5e6bf070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:23:55Z,use_quota=True,user_id='9156c668e7e04332940afcd9f89144dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:54 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-60a758ce-4a5e-40ea-a948-9bc6506c672b tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e138e688-5265-4188-8314-45fb920f1c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:54 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-60a758ce-4a5e-40ea-a948-9bc6506c672b tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e138e688-5265-4188-8314-45fb920f1c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:54 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-60a758ce-4a5e-40ea-a948-9bc6506c672b tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec9f59a8-2090-4183-aca5-29b0a056c3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:54 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-60a758ce-4a5e-40ea-a948-9bc6506c672b tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec9f59a8-2090-4183-aca5-29b0a056c3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8edbde7a-0688-4c1c-9530-86ef9ef8aa77', 'volume_name': 'volume-8edbde7a-0688-4c1c-9530-86ef9ef8aa77', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:54 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-60a758ce-4a5e-40ea-a948-9bc6506c672b tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a59ccdf3-45bf-4edc-bcd6-f07485ddfc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:54 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-60a758ce-4a5e-40ea-a948-9bc6506c672b tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a59ccdf3-45bf-4edc-bcd6-f07485ddfc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:54 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-60a758ce-4a5e-40ea-a948-9bc6506c672b tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (210c40ad-ef89-48bc-a983-d4c702bd88cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:54 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-60a758ce-4a5e-40ea-a948-9bc6506c672b tempest-VolumesTestJSON-1541563253 None] Volume 8edbde7a-0688-4c1c-9530-86ef9ef8aa77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8edbde7a-0688-4c1c-9530-86ef9ef8aa77', 'volume_size': 1} Jun 02 03:23:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-60a758ce-4a5e-40ea-a948-9bc6506c672b tempest-VolumesTestJSON-1541563253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:23:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-224873d0-6f3c-4d7a-942c-bb8884cb78b9 tempest-VolumesCloneNegativeTest-1598141060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d476101f-189a-4d0b-9865-a1fc66088a40 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:55 devstack sudo[95428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d476101f-189a-4d0b-9865-a1fc66088a40 Jun 02 03:23:55 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:55 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-224873d0-6f3c-4d7a-942c-bb8884cb78b9 tempest-VolumesCloneNegativeTest-1598141060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d476101f-189a-4d0b-9865-a1fc66088a40" returned: 0 in 0.683s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:55 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-224873d0-6f3c-4d7a-942c-bb8884cb78b9 tempest-VolumesCloneNegativeTest-1598141060 None] <== create_volume: return (1867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:23:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-224873d0-6f3c-4d7a-942c-bb8884cb78b9 tempest-VolumesCloneNegativeTest-1598141060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.871s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:23:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-60a758ce-4a5e-40ea-a948-9bc6506c672b tempest-VolumesTestJSON-1541563253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.711s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:23:55 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-60a758ce-4a5e-40ea-a948-9bc6506c672b tempest-VolumesTestJSON-1541563253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2057222760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8edbde7a-0688-4c1c-9530-86ef9ef8aa77,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2b0cdb0edc834f4ca637a13e5e6bf070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:23:55Z,use_quota=True,user_id='9156c668e7e04332940afcd9f89144dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:23:55 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-60a758ce-4a5e-40ea-a948-9bc6506c672b tempest-VolumesTestJSON-1541563253 None] Creating volume 8edbde7a-0688-4c1c-9530-86ef9ef8aa77 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:23:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-60a758ce-4a5e-40ea-a948-9bc6506c672b tempest-VolumesTestJSON-1541563253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:23:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-60a758ce-4a5e-40ea-a948-9bc6506c672b tempest-VolumesTestJSON-1541563253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:23:55 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-60a758ce-4a5e-40ea-a948-9bc6506c672b tempest-VolumesTestJSON-1541563253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:23:55 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-60a758ce-4a5e-40ea-a948-9bc6506c672b tempest-VolumesTestJSON-1541563253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:23:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-60a758ce-4a5e-40ea-a948-9bc6506c672b tempest-VolumesTestJSON-1541563253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:23:55 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-60a758ce-4a5e-40ea-a948-9bc6506c672b tempest-VolumesTestJSON-1541563253 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:23:55 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-60a758ce-4a5e-40ea-a948-9bc6506c672b tempest-VolumesTestJSON-1541563253 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:23:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-60a758ce-4a5e-40ea-a948-9bc6506c672b tempest-VolumesTestJSON-1541563253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8edbde7a-0688-4c1c-9530-86ef9ef8aa77 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:55 devstack sudo[95431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8edbde7a-0688-4c1c-9530-86ef9ef8aa77 1073741824 Jun 02 03:23:55 devstack sudo[95431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:55 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-224873d0-6f3c-4d7a-942c-bb8884cb78b9 tempest-VolumesCloneNegativeTest-1598141060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e181497-8f6f-4f89-883a-854ef6a60734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d476101f-189a-4d0b-9865-a1fc66088a40', 'volume_size': 2}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:55 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-224873d0-6f3c-4d7a-942c-bb8884cb78b9 tempest-VolumesCloneNegativeTest-1598141060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (475b1810-3f2a-4573-a387-1204f877c55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:55 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-224873d0-6f3c-4d7a-942c-bb8884cb78b9 tempest-VolumesCloneNegativeTest-1598141060 None] Volume volume-d476101f-189a-4d0b-9865-a1fc66088a40 (d476101f-189a-4d0b-9865-a1fc66088a40): created successfully Jun 02 03:23:55 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-224873d0-6f3c-4d7a-942c-bb8884cb78b9 tempest-VolumesCloneNegativeTest-1598141060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (475b1810-3f2a-4573-a387-1204f877c55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:55 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-224873d0-6f3c-4d7a-942c-bb8884cb78b9 tempest-VolumesCloneNegativeTest-1598141060 None] Flow 'volume_create_manager' (14d70cc2-7656-4703-8d3e-10304da38ef1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:23:55 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-224873d0-6f3c-4d7a-942c-bb8884cb78b9 tempest-VolumesCloneNegativeTest-1598141060 None] Created volume successfully. Jun 02 03:23:56 devstack sudo[95431]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-60a758ce-4a5e-40ea-a948-9bc6506c672b tempest-VolumesTestJSON-1541563253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8edbde7a-0688-4c1c-9530-86ef9ef8aa77 1073741824" returned: 0 in 0.901s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-60a758ce-4a5e-40ea-a948-9bc6506c672b tempest-VolumesTestJSON-1541563253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8edbde7a-0688-4c1c-9530-86ef9ef8aa77 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:56 devstack sudo[95439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8edbde7a-0688-4c1c-9530-86ef9ef8aa77 Jun 02 03:23:56 devstack sudo[95439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:57 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e5a1f504-baaf-4085-a6c5-7b8a64d2499a tempest-VolumesCloneNegativeTest-1598141060 None] Acquiring lock "cinder-d476101f-189a-4d0b-9865-a1fc66088a40-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:23:57 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e5a1f504-baaf-4085-a6c5-7b8a64d2499a tempest-VolumesCloneNegativeTest-1598141060 None] Lock "cinder-d476101f-189a-4d0b-9865-a1fc66088a40-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:23:57 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e5a1f504-baaf-4085-a6c5-7b8a64d2499a tempest-VolumesCloneNegativeTest-1598141060 None] Acquiring lock "cinder-quobyte-d476101f-189a-4d0b-9865-a1fc66088a40" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:23:57 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e5a1f504-baaf-4085-a6c5-7b8a64d2499a tempest-VolumesCloneNegativeTest-1598141060 None] Lock "cinder-quobyte-d476101f-189a-4d0b-9865-a1fc66088a40" acquired by "delete_volume" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:23:57 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[92858146-84fa-4eb8-8d40-e5d4a02ee0fa]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:23:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e5a1f504-baaf-4085-a6c5-7b8a64d2499a tempest-VolumesCloneNegativeTest-1598141060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d476101f-189a-4d0b-9865-a1fc66088a40 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:57 devstack sudo[95439]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-60a758ce-4a5e-40ea-a948-9bc6506c672b tempest-VolumesTestJSON-1541563253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8edbde7a-0688-4c1c-9530-86ef9ef8aa77" returned: 0 in 0.779s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:57 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-60a758ce-4a5e-40ea-a948-9bc6506c672b tempest-VolumesTestJSON-1541563253 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:23:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-60a758ce-4a5e-40ea-a948-9bc6506c672b tempest-VolumesTestJSON-1541563253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:23:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-60a758ce-4a5e-40ea-a948-9bc6506c672b tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (210c40ad-ef89-48bc-a983-d4c702bd88cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8edbde7a-0688-4c1c-9530-86ef9ef8aa77', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:57 devstack sudo[95444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d476101f-189a-4d0b-9865-a1fc66088a40 Jun 02 03:23:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-60a758ce-4a5e-40ea-a948-9bc6506c672b tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9933ab1-44aa-458f-8d5c-ab7bdee158ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:57 devstack sudo[95444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:57 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-60a758ce-4a5e-40ea-a948-9bc6506c672b tempest-VolumesTestJSON-1541563253 None] Volume volume-8edbde7a-0688-4c1c-9530-86ef9ef8aa77 (8edbde7a-0688-4c1c-9530-86ef9ef8aa77): created successfully Jun 02 03:23:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-60a758ce-4a5e-40ea-a948-9bc6506c672b tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9933ab1-44aa-458f-8d5c-ab7bdee158ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-60a758ce-4a5e-40ea-a948-9bc6506c672b tempest-VolumesTestJSON-1541563253 None] Flow 'volume_create_manager' (ebbf1000-3168-4c64-8bc9-92341c45a2f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:23:57 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-60a758ce-4a5e-40ea-a948-9bc6506c672b tempest-VolumesTestJSON-1541563253 None] Created volume successfully. Jun 02 03:23:58 devstack sudo[95444]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e5a1f504-baaf-4085-a6c5-7b8a64d2499a tempest-VolumesCloneNegativeTest-1598141060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d476101f-189a-4d0b-9865-a1fc66088a40" returned: 0 in 0.770s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e5a1f504-baaf-4085-a6c5-7b8a64d2499a tempest-VolumesCloneNegativeTest-1598141060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d476101f-189a-4d0b-9865-a1fc66088a40 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:58 devstack sudo[95449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d476101f-189a-4d0b-9865-a1fc66088a40 Jun 02 03:23:58 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:58 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a32454-98b4-46ad-bda4-bf9917405883 tempest-VolumesTestJSON-1541563253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:23:58 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-17a32454-98b4-46ad-bda4-bf9917405883 tempest-VolumesTestJSON-1541563253 None] Flow 'volume_create_manager' (39073204-b676-4a1d-a651-04265d0a3bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:23:58 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-17a32454-98b4-46ad-bda4-bf9917405883 tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c95ee4e-0d92-4e05-b2bc-01cd2515476b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:58 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-17a32454-98b4-46ad-bda4-bf9917405883 tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c95ee4e-0d92-4e05-b2bc-01cd2515476b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-727701773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff2a70a-eb8d-46eb-9306-22b9a2ca5c63,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2b0cdb0edc834f4ca637a13e5e6bf070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:23:59Z,use_quota=True,user_id='9156c668e7e04332940afcd9f89144dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:58 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-17a32454-98b4-46ad-bda4-bf9917405883 tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb2660ac-0fe1-4424-b535-ef614c407628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:58 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-17a32454-98b4-46ad-bda4-bf9917405883 tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb2660ac-0fe1-4424-b535-ef614c407628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:58 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-17a32454-98b4-46ad-bda4-bf9917405883 tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c63bf97e-85ec-4cc5-91ca-931ac8fc23fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:58 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-17a32454-98b4-46ad-bda4-bf9917405883 tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c63bf97e-85ec-4cc5-91ca-931ac8fc23fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ff2a70a-eb8d-46eb-9306-22b9a2ca5c63', 'volume_name': 'volume-9ff2a70a-eb8d-46eb-9306-22b9a2ca5c63', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:58 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-17a32454-98b4-46ad-bda4-bf9917405883 tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9808ff2f-e847-48cd-ae59-c52c88fdda45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:58 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-17a32454-98b4-46ad-bda4-bf9917405883 tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9808ff2f-e847-48cd-ae59-c52c88fdda45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:23:58 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-17a32454-98b4-46ad-bda4-bf9917405883 tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db59639-3776-4de0-8e3b-a3b465808d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:23:58 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-17a32454-98b4-46ad-bda4-bf9917405883 tempest-VolumesTestJSON-1541563253 None] Volume 9ff2a70a-eb8d-46eb-9306-22b9a2ca5c63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ff2a70a-eb8d-46eb-9306-22b9a2ca5c63', 'volume_size': 1} Jun 02 03:23:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-17a32454-98b4-46ad-bda4-bf9917405883 tempest-VolumesTestJSON-1541563253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:23:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-17a32454-98b4-46ad-bda4-bf9917405883 tempest-VolumesTestJSON-1541563253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:23:58 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-17a32454-98b4-46ad-bda4-bf9917405883 tempest-VolumesTestJSON-1541563253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-727701773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff2a70a-eb8d-46eb-9306-22b9a2ca5c63,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2b0cdb0edc834f4ca637a13e5e6bf070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:23:59Z,use_quota=True,user_id='9156c668e7e04332940afcd9f89144dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:23:58 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-17a32454-98b4-46ad-bda4-bf9917405883 tempest-VolumesTestJSON-1541563253 None] Creating volume 9ff2a70a-eb8d-46eb-9306-22b9a2ca5c63 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:23:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-17a32454-98b4-46ad-bda4-bf9917405883 tempest-VolumesTestJSON-1541563253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:23:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-17a32454-98b4-46ad-bda4-bf9917405883 tempest-VolumesTestJSON-1541563253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:23:58 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-17a32454-98b4-46ad-bda4-bf9917405883 tempest-VolumesTestJSON-1541563253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:23:58 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-17a32454-98b4-46ad-bda4-bf9917405883 tempest-VolumesTestJSON-1541563253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:23:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-17a32454-98b4-46ad-bda4-bf9917405883 tempest-VolumesTestJSON-1541563253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:23:58 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-17a32454-98b4-46ad-bda4-bf9917405883 tempest-VolumesTestJSON-1541563253 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:23:58 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-17a32454-98b4-46ad-bda4-bf9917405883 tempest-VolumesTestJSON-1541563253 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:23:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-17a32454-98b4-46ad-bda4-bf9917405883 tempest-VolumesTestJSON-1541563253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9ff2a70a-eb8d-46eb-9306-22b9a2ca5c63 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:58 devstack sudo[95492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9ff2a70a-eb8d-46eb-9306-22b9a2ca5c63 1073741824 Jun 02 03:23:58 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:23:59 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root Jun 02 03:23:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e5a1f504-baaf-4085-a6c5-7b8a64d2499a tempest-VolumesCloneNegativeTest-1598141060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d476101f-189a-4d0b-9865-a1fc66088a40" returned: 0 in 1.019s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:23:59 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e5a1f504-baaf-4085-a6c5-7b8a64d2499a tempest-VolumesCloneNegativeTest-1598141060 None] Lock "cinder-quobyte-d476101f-189a-4d0b-9865-a1fc66088a40" released by "delete_volume" :: held 1.849s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:23:59 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-e5a1f504-baaf-4085-a6c5-7b8a64d2499a tempest-VolumesCloneNegativeTest-1598141060 None] Created reservations ['d91d1e1c-64c6-46a8-980f-569d6072dde8', '271ae606-5fcb-4cdd-bb6d-f4d08040d8f6', 'a6dfdfaf-6187-4d7d-9b45-655c63686f0f', '84e19be5-60c7-416d-a445-62f474bc85ce'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:23:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e5a1f504-baaf-4085-a6c5-7b8a64d2499a tempest-VolumesCloneNegativeTest-1598141060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:23:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e5a1f504-baaf-4085-a6c5-7b8a64d2499a tempest-VolumesCloneNegativeTest-1598141060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:23:59 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e5a1f504-baaf-4085-a6c5-7b8a64d2499a tempest-VolumesCloneNegativeTest-1598141060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:23:59 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e5a1f504-baaf-4085-a6c5-7b8a64d2499a tempest-VolumesCloneNegativeTest-1598141060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:23:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e5a1f504-baaf-4085-a6c5-7b8a64d2499a tempest-VolumesCloneNegativeTest-1598141060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:23:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e5a1f504-baaf-4085-a6c5-7b8a64d2499a tempest-VolumesCloneNegativeTest-1598141060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:23:59 devstack sudo[95494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:23:59 devstack sudo[95494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:00 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-17a32454-98b4-46ad-bda4-bf9917405883 tempest-VolumesTestJSON-1541563253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9ff2a70a-eb8d-46eb-9306-22b9a2ca5c63 1073741824" returned: 0 in 1.076s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-17a32454-98b4-46ad-bda4-bf9917405883 tempest-VolumesTestJSON-1541563253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9ff2a70a-eb8d-46eb-9306-22b9a2ca5c63 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:00 devstack sudo[95502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9ff2a70a-eb8d-46eb-9306-22b9a2ca5c63 Jun 02 03:24:00 devstack sudo[95502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:00 devstack sudo[95494]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e5a1f504-baaf-4085-a6c5-7b8a64d2499a tempest-VolumesCloneNegativeTest-1598141060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.795s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:00 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-e5a1f504-baaf-4085-a6c5-7b8a64d2499a tempest-VolumesCloneNegativeTest-1598141060 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:24:00 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-e5a1f504-baaf-4085-a6c5-7b8a64d2499a tempest-VolumesCloneNegativeTest-1598141060 None] Deleted volume successfully. Jun 02 03:24:00 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e5a1f504-baaf-4085-a6c5-7b8a64d2499a tempest-VolumesCloneNegativeTest-1598141060 None] Lock "cinder-d476101f-189a-4d0b-9865-a1fc66088a40-delete_volume" released by "delete_volume" :: held 3.024s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:24:00 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-ae35507a-4b2e-4e8f-ba72-c0704677df95 tempest-GroupsV314Test-853933519 None] Group tempest-GroupsV314Test-Group-1031865310: creating Jun 02 03:24:00 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-ae35507a-4b2e-4e8f-ba72-c0704677df95 tempest-GroupsV314Test-853933519 None] Group tempest-GroupsV314Test-Group-1031865310: created successfully Jun 02 03:24:00 devstack sudo[95502]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:00 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-ae35507a-4b2e-4e8f-ba72-c0704677df95 tempest-GroupsV314Test-853933519 None] Create group completed successfully. Jun 02 03:24:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-17a32454-98b4-46ad-bda4-bf9917405883 tempest-VolumesTestJSON-1541563253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9ff2a70a-eb8d-46eb-9306-22b9a2ca5c63" returned: 0 in 0.864s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:00 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-17a32454-98b4-46ad-bda4-bf9917405883 tempest-VolumesTestJSON-1541563253 None] <== create_volume: return (2012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:24:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-17a32454-98b4-46ad-bda4-bf9917405883 tempest-VolumesTestJSON-1541563253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.018s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-17a32454-98b4-46ad-bda4-bf9917405883 tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db59639-3776-4de0-8e3b-a3b465808d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ff2a70a-eb8d-46eb-9306-22b9a2ca5c63', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-17a32454-98b4-46ad-bda4-bf9917405883 tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18e4547f-7a21-4e3d-8c29-345f55b76e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:00 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-17a32454-98b4-46ad-bda4-bf9917405883 tempest-VolumesTestJSON-1541563253 None] Volume volume-9ff2a70a-eb8d-46eb-9306-22b9a2ca5c63 (9ff2a70a-eb8d-46eb-9306-22b9a2ca5c63): created successfully Jun 02 03:24:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-17a32454-98b4-46ad-bda4-bf9917405883 tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18e4547f-7a21-4e3d-8c29-345f55b76e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-17a32454-98b4-46ad-bda4-bf9917405883 tempest-VolumesTestJSON-1541563253 None] Flow 'volume_create_manager' (39073204-b676-4a1d-a651-04265d0a3bd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:24:01 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-17a32454-98b4-46ad-bda4-bf9917405883 tempest-VolumesTestJSON-1541563253 None] Created volume successfully. Jun 02 03:24:02 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-23fd690a-713d-4c36-a109-09cb0356a2dd tempest-GroupsV314Test-853933519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:24:02 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-23fd690a-713d-4c36-a109-09cb0356a2dd tempest-GroupsV314Test-853933519 None] Flow 'volume_create_manager' (901f9206-a389-4e5d-9101-2dd2c6de5aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:24:02 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-23fd690a-713d-4c36-a109-09cb0356a2dd tempest-GroupsV314Test-853933519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (146e15f7-3003-4af8-afe6-b48fd3768cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:02 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-23fd690a-713d-4c36-a109-09cb0356a2dd tempest-GroupsV314Test-853933519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (146e15f7-3003-4af8-afe6-b48fd3768cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-7184867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=380e68aa-e47c-46b4-83dc-67f0e7ae2393,host='devstack@QuobyteHD#QuobyteHD',id=fa271cda-c9eb-4ffc-bce4-bd3394a59b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7643d94f15fa40878f064cf035a35241',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:24:02Z,use_quota=True,user_id='347b98c0d5b74a689d19bd038c95a177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5a69ca7-7751-4ec2-ae70-4fd64c148e75),volume_type_id=a5a69ca7-7751-4ec2-ae70-4fd64c148e75)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:02 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-23fd690a-713d-4c36-a109-09cb0356a2dd tempest-GroupsV314Test-853933519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b75b3fe-933b-45df-90e7-fdada67ab3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:02 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-23fd690a-713d-4c36-a109-09cb0356a2dd tempest-GroupsV314Test-853933519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b75b3fe-933b-45df-90e7-fdada67ab3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:02 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-23fd690a-713d-4c36-a109-09cb0356a2dd tempest-GroupsV314Test-853933519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15192e2b-6c37-4d3e-b65f-b685d294033a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:02 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-23fd690a-713d-4c36-a109-09cb0356a2dd tempest-GroupsV314Test-853933519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15192e2b-6c37-4d3e-b65f-b685d294033a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa271cda-c9eb-4ffc-bce4-bd3394a59b4c', 'volume_name': 'volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:02 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-23fd690a-713d-4c36-a109-09cb0356a2dd tempest-GroupsV314Test-853933519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (296884ae-ec6e-48fa-8514-964061ef991d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:02 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-23fd690a-713d-4c36-a109-09cb0356a2dd tempest-GroupsV314Test-853933519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (296884ae-ec6e-48fa-8514-964061ef991d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:02 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-23fd690a-713d-4c36-a109-09cb0356a2dd tempest-GroupsV314Test-853933519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4b9d100-1b5f-4870-b8c5-43458010834e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:02 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-23fd690a-713d-4c36-a109-09cb0356a2dd tempest-GroupsV314Test-853933519 None] Volume fa271cda-c9eb-4ffc-bce4-bd3394a59b4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c', 'volume_size': 1} Jun 02 03:24:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-23fd690a-713d-4c36-a109-09cb0356a2dd tempest-GroupsV314Test-853933519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-23fd690a-713d-4c36-a109-09cb0356a2dd tempest-GroupsV314Test-853933519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:02 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-23fd690a-713d-4c36-a109-09cb0356a2dd tempest-GroupsV314Test-853933519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=380e68aa-e47c-46b4-83dc-67f0e7ae2393,created_at=2026-06-02T01:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-7184867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=380e68aa-e47c-46b4-83dc-67f0e7ae2393,host='devstack@QuobyteHD#QuobyteHD',id=fa271cda-c9eb-4ffc-bce4-bd3394a59b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7643d94f15fa40878f064cf035a35241',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:24:02Z,use_quota=True,user_id='347b98c0d5b74a689d19bd038c95a177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5a69ca7-7751-4ec2-ae70-4fd64c148e75),volume_type_id=a5a69ca7-7751-4ec2-ae70-4fd64c148e75)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:24:02 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-23fd690a-713d-4c36-a109-09cb0356a2dd tempest-GroupsV314Test-853933519 None] Creating volume fa271cda-c9eb-4ffc-bce4-bd3394a59b4c {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:24:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-23fd690a-713d-4c36-a109-09cb0356a2dd tempest-GroupsV314Test-853933519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-23fd690a-713d-4c36-a109-09cb0356a2dd tempest-GroupsV314Test-853933519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:02 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-23fd690a-713d-4c36-a109-09cb0356a2dd tempest-GroupsV314Test-853933519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:24:02 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-23fd690a-713d-4c36-a109-09cb0356a2dd tempest-GroupsV314Test-853933519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:24:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-23fd690a-713d-4c36-a109-09cb0356a2dd tempest-GroupsV314Test-853933519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:02 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-23fd690a-713d-4c36-a109-09cb0356a2dd tempest-GroupsV314Test-853933519 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:24:02 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-23fd690a-713d-4c36-a109-09cb0356a2dd tempest-GroupsV314Test-853933519 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:24:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-23fd690a-713d-4c36-a109-09cb0356a2dd tempest-GroupsV314Test-853933519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:02 devstack sudo[95510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c 1073741824 Jun 02 03:24:02 devstack sudo[95510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:02 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f0cdd67-1833-4985-ab80-5b2039661467 tempest-VolumesTestJSON-1541563253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:24:02 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9f0cdd67-1833-4985-ab80-5b2039661467 tempest-VolumesTestJSON-1541563253 None] Flow 'volume_create_manager' (65fbb191-1b49-4315-9f85-96efc2d172a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:24:02 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9f0cdd67-1833-4985-ab80-5b2039661467 tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf4c495e-3133-4eeb-8a00-beaf89419593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:02 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9f0cdd67-1833-4985-ab80-5b2039661467 tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf4c495e-3133-4eeb-8a00-beaf89419593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-724097136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb67c07c-f318-4a56-85db-d20787f3161b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2b0cdb0edc834f4ca637a13e5e6bf070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:24:03Z,use_quota=True,user_id='9156c668e7e04332940afcd9f89144dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:02 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9f0cdd67-1833-4985-ab80-5b2039661467 tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb12a99f-7045-4eaf-b7f5-868d5f96fb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:02 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9f0cdd67-1833-4985-ab80-5b2039661467 tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb12a99f-7045-4eaf-b7f5-868d5f96fb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:02 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9f0cdd67-1833-4985-ab80-5b2039661467 tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (925f5bce-9973-4c6a-b6b2-63966c12becb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:02 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9f0cdd67-1833-4985-ab80-5b2039661467 tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (925f5bce-9973-4c6a-b6b2-63966c12becb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb67c07c-f318-4a56-85db-d20787f3161b', 'volume_name': 'volume-eb67c07c-f318-4a56-85db-d20787f3161b', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:02 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9f0cdd67-1833-4985-ab80-5b2039661467 tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fc2218e-7314-423d-a9e1-c32213a8d691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:02 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9f0cdd67-1833-4985-ab80-5b2039661467 tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fc2218e-7314-423d-a9e1-c32213a8d691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:02 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9f0cdd67-1833-4985-ab80-5b2039661467 tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c7e3b53-76e9-4f26-ae29-146e18ec6a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:02 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-9f0cdd67-1833-4985-ab80-5b2039661467 tempest-VolumesTestJSON-1541563253 None] Volume eb67c07c-f318-4a56-85db-d20787f3161b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb67c07c-f318-4a56-85db-d20787f3161b', 'volume_size': 1} Jun 02 03:24:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9f0cdd67-1833-4985-ab80-5b2039661467 tempest-VolumesTestJSON-1541563253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:03 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-63123fb8-11d0-45be-9507-6a0a7bb7ea0e tempest-VolumesListTestJSON-1821370474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:24:03 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63123fb8-11d0-45be-9507-6a0a7bb7ea0e tempest-VolumesListTestJSON-1821370474 None] Flow 'volume_create_manager' (a2a038f9-7eb1-4e4c-840b-59ea11f1a757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:24:03 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63123fb8-11d0-45be-9507-6a0a7bb7ea0e tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b395ef53-8410-4985-8d7d-49882ea6c6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:03 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63123fb8-11d0-45be-9507-6a0a7bb7ea0e tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b395ef53-8410-4985-8d7d-49882ea6c6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-937164216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94eca601-21cb-4359-89be-4d7dcefa80ab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1eecae34b93445ea8791e236e1c75222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:24:03Z,use_quota=True,user_id='48d07298b12d4c12b852ad7e8f1f69bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:03 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63123fb8-11d0-45be-9507-6a0a7bb7ea0e tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38fbf98f-a327-4111-90b5-5957e361b465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:03 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63123fb8-11d0-45be-9507-6a0a7bb7ea0e tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38fbf98f-a327-4111-90b5-5957e361b465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:03 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63123fb8-11d0-45be-9507-6a0a7bb7ea0e tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2e07608-beae-4e96-911c-1df1769ee867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:03 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63123fb8-11d0-45be-9507-6a0a7bb7ea0e tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2e07608-beae-4e96-911c-1df1769ee867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94eca601-21cb-4359-89be-4d7dcefa80ab', 'volume_name': 'volume-94eca601-21cb-4359-89be-4d7dcefa80ab', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:03 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63123fb8-11d0-45be-9507-6a0a7bb7ea0e tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c97097ad-a891-4eee-bc62-37cdb357b49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:03 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63123fb8-11d0-45be-9507-6a0a7bb7ea0e tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c97097ad-a891-4eee-bc62-37cdb357b49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:03 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63123fb8-11d0-45be-9507-6a0a7bb7ea0e tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c958df58-d10f-4398-b354-61b2fa6adbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:03 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-63123fb8-11d0-45be-9507-6a0a7bb7ea0e tempest-VolumesListTestJSON-1821370474 None] Volume 94eca601-21cb-4359-89be-4d7dcefa80ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94eca601-21cb-4359-89be-4d7dcefa80ab', 'volume_size': 1} Jun 02 03:24:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-63123fb8-11d0-45be-9507-6a0a7bb7ea0e tempest-VolumesListTestJSON-1821370474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:03 devstack sudo[95510]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-23fd690a-713d-4c36-a109-09cb0356a2dd tempest-GroupsV314Test-853933519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c 1073741824" returned: 0 in 0.830s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-23fd690a-713d-4c36-a109-09cb0356a2dd tempest-GroupsV314Test-853933519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:03 devstack sudo[95516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c Jun 02 03:24:03 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:04 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-23fd690a-713d-4c36-a109-09cb0356a2dd tempest-GroupsV314Test-853933519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c" returned: 0 in 0.595s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:04 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-23fd690a-713d-4c36-a109-09cb0356a2dd tempest-GroupsV314Test-853933519 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:24:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-23fd690a-713d-4c36-a109-09cb0356a2dd tempest-GroupsV314Test-853933519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9f0cdd67-1833-4985-ab80-5b2039661467 tempest-VolumesTestJSON-1541563253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.317s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:04 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9f0cdd67-1833-4985-ab80-5b2039661467 tempest-VolumesTestJSON-1541563253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-724097136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb67c07c-f318-4a56-85db-d20787f3161b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2b0cdb0edc834f4ca637a13e5e6bf070',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:24:03Z,use_quota=True,user_id='9156c668e7e04332940afcd9f89144dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:24:04 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-9f0cdd67-1833-4985-ab80-5b2039661467 tempest-VolumesTestJSON-1541563253 None] Creating volume eb67c07c-f318-4a56-85db-d20787f3161b {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:24:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9f0cdd67-1833-4985-ab80-5b2039661467 tempest-VolumesTestJSON-1541563253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9f0cdd67-1833-4985-ab80-5b2039661467 tempest-VolumesTestJSON-1541563253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:04 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9f0cdd67-1833-4985-ab80-5b2039661467 tempest-VolumesTestJSON-1541563253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:24:04 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9f0cdd67-1833-4985-ab80-5b2039661467 tempest-VolumesTestJSON-1541563253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:24:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9f0cdd67-1833-4985-ab80-5b2039661467 tempest-VolumesTestJSON-1541563253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:04 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9f0cdd67-1833-4985-ab80-5b2039661467 tempest-VolumesTestJSON-1541563253 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:24:04 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-9f0cdd67-1833-4985-ab80-5b2039661467 tempest-VolumesTestJSON-1541563253 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:24:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9f0cdd67-1833-4985-ab80-5b2039661467 tempest-VolumesTestJSON-1541563253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-eb67c07c-f318-4a56-85db-d20787f3161b 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:04 devstack sudo[95519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-eb67c07c-f318-4a56-85db-d20787f3161b 1073741824 Jun 02 03:24:04 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-23fd690a-713d-4c36-a109-09cb0356a2dd tempest-GroupsV314Test-853933519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4b9d100-1b5f-4870-b8c5-43458010834e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-23fd690a-713d-4c36-a109-09cb0356a2dd tempest-GroupsV314Test-853933519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (317d1b1a-c003-4d40-aaa7-926ef42a7890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:04 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-23fd690a-713d-4c36-a109-09cb0356a2dd tempest-GroupsV314Test-853933519 None] Volume volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c (fa271cda-c9eb-4ffc-bce4-bd3394a59b4c): created successfully Jun 02 03:24:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-23fd690a-713d-4c36-a109-09cb0356a2dd tempest-GroupsV314Test-853933519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (317d1b1a-c003-4d40-aaa7-926ef42a7890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-23fd690a-713d-4c36-a109-09cb0356a2dd tempest-GroupsV314Test-853933519 None] Flow 'volume_create_manager' (901f9206-a389-4e5d-9101-2dd2c6de5aac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:24:04 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-23fd690a-713d-4c36-a109-09cb0356a2dd tempest-GroupsV314Test-853933519 None] Created volume successfully. Jun 02 03:24:04 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9f0cdd67-1833-4985-ab80-5b2039661467 tempest-VolumesTestJSON-1541563253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-eb67c07c-f318-4a56-85db-d20787f3161b 1073741824" returned: 0 in 0.814s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9f0cdd67-1833-4985-ab80-5b2039661467 tempest-VolumesTestJSON-1541563253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-eb67c07c-f318-4a56-85db-d20787f3161b {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:04 devstack sudo[95525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-eb67c07c-f318-4a56-85db-d20787f3161b Jun 02 03:24:04 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:05 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9f0cdd67-1833-4985-ab80-5b2039661467 tempest-VolumesTestJSON-1541563253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-eb67c07c-f318-4a56-85db-d20787f3161b" returned: 0 in 0.599s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:05 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9f0cdd67-1833-4985-ab80-5b2039661467 tempest-VolumesTestJSON-1541563253 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:24:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9f0cdd67-1833-4985-ab80-5b2039661467 tempest-VolumesTestJSON-1541563253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-63123fb8-11d0-45be-9507-6a0a7bb7ea0e tempest-VolumesListTestJSON-1821370474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.348s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:05 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-63123fb8-11d0-45be-9507-6a0a7bb7ea0e tempest-VolumesListTestJSON-1821370474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-937164216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94eca601-21cb-4359-89be-4d7dcefa80ab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1eecae34b93445ea8791e236e1c75222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:24:03Z,use_quota=True,user_id='48d07298b12d4c12b852ad7e8f1f69bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:24:05 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-63123fb8-11d0-45be-9507-6a0a7bb7ea0e tempest-VolumesListTestJSON-1821370474 None] Creating volume 94eca601-21cb-4359-89be-4d7dcefa80ab {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:24:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-63123fb8-11d0-45be-9507-6a0a7bb7ea0e tempest-VolumesListTestJSON-1821370474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-63123fb8-11d0-45be-9507-6a0a7bb7ea0e tempest-VolumesListTestJSON-1821370474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:05 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-63123fb8-11d0-45be-9507-6a0a7bb7ea0e tempest-VolumesListTestJSON-1821370474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:24:05 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-63123fb8-11d0-45be-9507-6a0a7bb7ea0e tempest-VolumesListTestJSON-1821370474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:24:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-63123fb8-11d0-45be-9507-6a0a7bb7ea0e tempest-VolumesListTestJSON-1821370474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:05 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-63123fb8-11d0-45be-9507-6a0a7bb7ea0e tempest-VolumesListTestJSON-1821370474 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:24:05 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-63123fb8-11d0-45be-9507-6a0a7bb7ea0e tempest-VolumesListTestJSON-1821370474 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:24:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63123fb8-11d0-45be-9507-6a0a7bb7ea0e tempest-VolumesListTestJSON-1821370474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-94eca601-21cb-4359-89be-4d7dcefa80ab 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:05 devstack sudo[95528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-94eca601-21cb-4359-89be-4d7dcefa80ab 1073741824 Jun 02 03:24:05 devstack sudo[95528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9f0cdd67-1833-4985-ab80-5b2039661467 tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c7e3b53-76e9-4f26-ae29-146e18ec6a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb67c07c-f318-4a56-85db-d20787f3161b', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9f0cdd67-1833-4985-ab80-5b2039661467 tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2a1f239-8ac7-4d78-9802-cf343f8bbe3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:05 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-9f0cdd67-1833-4985-ab80-5b2039661467 tempest-VolumesTestJSON-1541563253 None] Volume volume-eb67c07c-f318-4a56-85db-d20787f3161b (eb67c07c-f318-4a56-85db-d20787f3161b): created successfully Jun 02 03:24:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9f0cdd67-1833-4985-ab80-5b2039661467 tempest-VolumesTestJSON-1541563253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2a1f239-8ac7-4d78-9802-cf343f8bbe3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9f0cdd67-1833-4985-ab80-5b2039661467 tempest-VolumesTestJSON-1541563253 None] Flow 'volume_create_manager' (65fbb191-1b49-4315-9f85-96efc2d172a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:24:05 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-9f0cdd67-1833-4985-ab80-5b2039661467 tempest-VolumesTestJSON-1541563253 None] Created volume successfully. Jun 02 03:24:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:06 devstack sudo[95528]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63123fb8-11d0-45be-9507-6a0a7bb7ea0e tempest-VolumesListTestJSON-1821370474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-94eca601-21cb-4359-89be-4d7dcefa80ab 1073741824" returned: 0 in 0.852s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63123fb8-11d0-45be-9507-6a0a7bb7ea0e tempest-VolumesListTestJSON-1821370474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-94eca601-21cb-4359-89be-4d7dcefa80ab {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:06 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-94eca601-21cb-4359-89be-4d7dcefa80ab Jun 02 03:24:06 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:06 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-85c42088-842e-45f3-bdb8-0e41c897e9de tempest-VolumesTestJSON-1541563253 None] Acquiring lock "cinder-eb67c07c-f318-4a56-85db-d20787f3161b-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:24:06 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-85c42088-842e-45f3-bdb8-0e41c897e9de tempest-VolumesTestJSON-1541563253 None] Lock "cinder-eb67c07c-f318-4a56-85db-d20787f3161b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:24:06 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-85c42088-842e-45f3-bdb8-0e41c897e9de tempest-VolumesTestJSON-1541563253 None] Acquiring lock "cinder-quobyte-eb67c07c-f318-4a56-85db-d20787f3161b" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:24:06 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-85c42088-842e-45f3-bdb8-0e41c897e9de tempest-VolumesTestJSON-1541563253 None] Lock "cinder-quobyte-eb67c07c-f318-4a56-85db-d20787f3161b" acquired by "delete_volume" :: waited 0.021s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:24:07 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eebdeec-c599-4258-a3b8-2366d7e21cf5]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:24:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-85c42088-842e-45f3-bdb8-0e41c897e9de tempest-VolumesTestJSON-1541563253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-eb67c07c-f318-4a56-85db-d20787f3161b {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:07 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63123fb8-11d0-45be-9507-6a0a7bb7ea0e tempest-VolumesListTestJSON-1821370474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-94eca601-21cb-4359-89be-4d7dcefa80ab" returned: 0 in 0.613s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:07 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-63123fb8-11d0-45be-9507-6a0a7bb7ea0e tempest-VolumesListTestJSON-1821370474 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:24:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-63123fb8-11d0-45be-9507-6a0a7bb7ea0e tempest-VolumesListTestJSON-1821370474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.257s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:07 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Cloning volume fa271cda-c9eb-4ffc-bce4-bd3394a59b4c to volume 03b5f2b0-1807-4650-b27c-e18c25b77f61 Jun 02 03:24:07 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63123fb8-11d0-45be-9507-6a0a7bb7ea0e tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c958df58-d10f-4398-b354-61b2fa6adbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94eca601-21cb-4359-89be-4d7dcefa80ab', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:07 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63123fb8-11d0-45be-9507-6a0a7bb7ea0e tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d55b86e4-cc40-4d0a-92ee-55cf15d28196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:07 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-63123fb8-11d0-45be-9507-6a0a7bb7ea0e tempest-VolumesListTestJSON-1821370474 None] Volume volume-94eca601-21cb-4359-89be-4d7dcefa80ab (94eca601-21cb-4359-89be-4d7dcefa80ab): created successfully Jun 02 03:24:07 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63123fb8-11d0-45be-9507-6a0a7bb7ea0e tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d55b86e4-cc40-4d0a-92ee-55cf15d28196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:07 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63123fb8-11d0-45be-9507-6a0a7bb7ea0e tempest-VolumesListTestJSON-1821370474 None] Flow 'volume_create_manager' (a2a038f9-7eb1-4e4c-840b-59ea11f1a757) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:24:07 devstack sudo[95537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-eb67c07c-f318-4a56-85db-d20787f3161b Jun 02 03:24:07 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Creating offline snapshot 71078ac8-5728-4835-9500-38fb0c84b3a4 of volume fa271cda-c9eb-4ffc-bce4-bd3394a59b4c {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:24:07 devstack sudo[95537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:07 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-63123fb8-11d0-45be-9507-6a0a7bb7ea0e tempest-VolumesListTestJSON-1821370474 None] Created volume successfully. Jun 02 03:24:07 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ad0bb9-2a31-4180-b34a-9333b31b85d2]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:24:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:07 devstack sudo[95539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c Jun 02 03:24:07 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:07 devstack sudo[95537]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-85c42088-842e-45f3-bdb8-0e41c897e9de tempest-VolumesTestJSON-1541563253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-eb67c07c-f318-4a56-85db-d20787f3161b" returned: 0 in 0.916s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-85c42088-842e-45f3-bdb8-0e41c897e9de tempest-VolumesTestJSON-1541563253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-eb67c07c-f318-4a56-85db-d20787f3161b {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:07 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-eb67c07c-f318-4a56-85db-d20787f3161b Jun 02 03:24:07 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:07 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e761a24-7975-49e9-a2d8-a48a36be9ce7 tempest-VolumesListTestJSON-1821370474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:24:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6e761a24-7975-49e9-a2d8-a48a36be9ce7 tempest-VolumesListTestJSON-1821370474 None] Flow 'volume_create_manager' (84272d9a-1e7d-409a-b46a-13bb5b21942f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:24:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6e761a24-7975-49e9-a2d8-a48a36be9ce7 tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36d6f054-93a9-4098-9040-63b19604c571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6e761a24-7975-49e9-a2d8-a48a36be9ce7 tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36d6f054-93a9-4098-9040-63b19604c571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-203947851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a172e6e-7e66-43ed-a462-977bc7d12152,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1eecae34b93445ea8791e236e1c75222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:24:08Z,use_quota=True,user_id='48d07298b12d4c12b852ad7e8f1f69bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6e761a24-7975-49e9-a2d8-a48a36be9ce7 tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c61acca2-dd6e-423e-9465-d38af17a765d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6e761a24-7975-49e9-a2d8-a48a36be9ce7 tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c61acca2-dd6e-423e-9465-d38af17a765d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6e761a24-7975-49e9-a2d8-a48a36be9ce7 tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a414bf56-5857-45fd-b114-7dc6b7a7eb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6e761a24-7975-49e9-a2d8-a48a36be9ce7 tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a414bf56-5857-45fd-b114-7dc6b7a7eb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a172e6e-7e66-43ed-a462-977bc7d12152', 'volume_name': 'volume-0a172e6e-7e66-43ed-a462-977bc7d12152', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6e761a24-7975-49e9-a2d8-a48a36be9ce7 tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18224235-43da-4de8-b7df-3ce3bf947eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6e761a24-7975-49e9-a2d8-a48a36be9ce7 tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18224235-43da-4de8-b7df-3ce3bf947eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6e761a24-7975-49e9-a2d8-a48a36be9ce7 tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a336b59b-9749-49dc-8ad1-83a370807a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:08 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-6e761a24-7975-49e9-a2d8-a48a36be9ce7 tempest-VolumesListTestJSON-1821370474 None] Volume 0a172e6e-7e66-43ed-a462-977bc7d12152: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a172e6e-7e66-43ed-a462-977bc7d12152', 'volume_size': 1} Jun 02 03:24:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6e761a24-7975-49e9-a2d8-a48a36be9ce7 tempest-VolumesListTestJSON-1821370474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:08 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c" returned: 0 in 0.933s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c.71078ac8-5728-4835-9500-38fb0c84b3a4 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:08 devstack sudo[95549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c.71078ac8-5728-4835-9500-38fb0c84b3a4 1G Jun 02 03:24:08 devstack sudo[95549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:08 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-47cc4a24-05ef-4386-a914-0b23ce18a9d1 tempest-AttachVolumeShelveTestJSON-808950028 None] Acquiring lock "cinder-ec95d7c6-af6b-4600-a2e9-db20a82a7590-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:24:08 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-47cc4a24-05ef-4386-a914-0b23ce18a9d1 tempest-AttachVolumeShelveTestJSON-808950028 None] Lock "cinder-ec95d7c6-af6b-4600-a2e9-db20a82a7590-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:24:08 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-47cc4a24-05ef-4386-a914-0b23ce18a9d1 tempest-AttachVolumeShelveTestJSON-808950028 None] Acquiring lock "cinder-quobyte-ec95d7c6-af6b-4600-a2e9-db20a82a7590" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:24:08 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-47cc4a24-05ef-4386-a914-0b23ce18a9d1 tempest-AttachVolumeShelveTestJSON-808950028 None] Lock "cinder-quobyte-ec95d7c6-af6b-4600-a2e9-db20a82a7590" acquired by "delete_volume" :: waited 0.029s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:24:08 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0c397a-60fc-4ba7-84d7-93f4e8c54d15]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:24:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-47cc4a24-05ef-4386-a914-0b23ce18a9d1 tempest-AttachVolumeShelveTestJSON-808950028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ec95d7c6-af6b-4600-a2e9-db20a82a7590 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:08 devstack sudo[95551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ec95d7c6-af6b-4600-a2e9-db20a82a7590 Jun 02 03:24:08 devstack sudo[95551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:08 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-85c42088-842e-45f3-bdb8-0e41c897e9de tempest-VolumesTestJSON-1541563253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-eb67c07c-f318-4a56-85db-d20787f3161b" returned: 0 in 0.721s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:08 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-85c42088-842e-45f3-bdb8-0e41c897e9de tempest-VolumesTestJSON-1541563253 None] Lock "cinder-quobyte-eb67c07c-f318-4a56-85db-d20787f3161b" released by "delete_volume" :: held 1.704s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:24:08 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-85c42088-842e-45f3-bdb8-0e41c897e9de tempest-VolumesTestJSON-1541563253 None] Created reservations ['99cab18e-0636-4185-a8b8-02e6940ee2aa', '9dee49f2-defb-42a6-ad63-954a8bdd4b31', '17daad13-cade-47dc-b6af-a832d6857a09', '28159885-3d82-4cc6-a0fb-992277d60f77'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:24:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-85c42088-842e-45f3-bdb8-0e41c897e9de tempest-VolumesTestJSON-1541563253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-85c42088-842e-45f3-bdb8-0e41c897e9de tempest-VolumesTestJSON-1541563253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:08 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-85c42088-842e-45f3-bdb8-0e41c897e9de tempest-VolumesTestJSON-1541563253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:24:08 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-85c42088-842e-45f3-bdb8-0e41c897e9de tempest-VolumesTestJSON-1541563253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:24:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-85c42088-842e-45f3-bdb8-0e41c897e9de tempest-VolumesTestJSON-1541563253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-85c42088-842e-45f3-bdb8-0e41c897e9de tempest-VolumesTestJSON-1541563253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:08 devstack sudo[95557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:24:08 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:08 devstack sudo[95549]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c.71078ac8-5728-4835-9500-38fb0c84b3a4 1G" returned: 0 in 0.868s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c.71078ac8-5728-4835-9500-38fb0c84b3a4 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:09 devstack sudo[95564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c.71078ac8-5728-4835-9500-38fb0c84b3a4 Jun 02 03:24:09 devstack sudo[95564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:09 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f8f29f4f-a41c-4070-8aa0-a5d990913210 tempest-VolumesTestJSON-1541563253 None] Acquiring lock "cinder-9ff2a70a-eb8d-46eb-9306-22b9a2ca5c63-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:24:09 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f8f29f4f-a41c-4070-8aa0-a5d990913210 tempest-VolumesTestJSON-1541563253 None] Lock "cinder-9ff2a70a-eb8d-46eb-9306-22b9a2ca5c63-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:24:09 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f8f29f4f-a41c-4070-8aa0-a5d990913210 tempest-VolumesTestJSON-1541563253 None] Acquiring lock "cinder-quobyte-9ff2a70a-eb8d-46eb-9306-22b9a2ca5c63" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:24:09 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f8f29f4f-a41c-4070-8aa0-a5d990913210 tempest-VolumesTestJSON-1541563253 None] Lock "cinder-quobyte-9ff2a70a-eb8d-46eb-9306-22b9a2ca5c63" acquired by "delete_volume" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:24:09 devstack sudo[95551]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-47cc4a24-05ef-4386-a914-0b23ce18a9d1 tempest-AttachVolumeShelveTestJSON-808950028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ec95d7c6-af6b-4600-a2e9-db20a82a7590" returned: 0 in 0.863s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-47cc4a24-05ef-4386-a914-0b23ce18a9d1 tempest-AttachVolumeShelveTestJSON-808950028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ec95d7c6-af6b-4600-a2e9-db20a82a7590 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:09 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d857a2-5c70-4fc5-a570-4c12befc4eee]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:24:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f8f29f4f-a41c-4070-8aa0-a5d990913210 tempest-VolumesTestJSON-1541563253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9ff2a70a-eb8d-46eb-9306-22b9a2ca5c63 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:09 devstack sudo[95569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ec95d7c6-af6b-4600-a2e9-db20a82a7590 Jun 02 03:24:09 devstack sudo[95569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:09 devstack sudo[95570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9ff2a70a-eb8d-46eb-9306-22b9a2ca5c63 Jun 02 03:24:09 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:09 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:24:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:24:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:24:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:09 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-85c42088-842e-45f3-bdb8-0e41c897e9de tempest-VolumesTestJSON-1541563253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.742s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:09 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-85c42088-842e-45f3-bdb8-0e41c897e9de tempest-VolumesTestJSON-1541563253 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:24:09 devstack sudo[95574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:24:09 devstack sudo[95574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:09 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-85c42088-842e-45f3-bdb8-0e41c897e9de tempest-VolumesTestJSON-1541563253 None] Deleted volume successfully. Jun 02 03:24:09 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-85c42088-842e-45f3-bdb8-0e41c897e9de tempest-VolumesTestJSON-1541563253 None] Lock "cinder-eb67c07c-f318-4a56-85db-d20787f3161b-delete_volume" released by "delete_volume" :: held 2.666s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:24:09 devstack sudo[95564]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c.71078ac8-5728-4835-9500-38fb0c84b3a4" returned: 0 in 0.790s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:09 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c.71078ac8-5728-4835-9500-38fb0c84b3a4 is being set with open permissions: ugo+rw: NotImplementedError Jun 02 03:24:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c.71078ac8-5728-4835-9500-38fb0c84b3a4 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:09 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c.71078ac8-5728-4835-9500-38fb0c84b3a4 Jun 02 03:24:09 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:09 devstack sudo[95569]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-47cc4a24-05ef-4386-a914-0b23ce18a9d1 tempest-AttachVolumeShelveTestJSON-808950028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ec95d7c6-af6b-4600-a2e9-db20a82a7590" returned: 0 in 0.716s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:10 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-47cc4a24-05ef-4386-a914-0b23ce18a9d1 tempest-AttachVolumeShelveTestJSON-808950028 None] Lock "cinder-quobyte-ec95d7c6-af6b-4600-a2e9-db20a82a7590" released by "delete_volume" :: held 1.620s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:24:10 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-47cc4a24-05ef-4386-a914-0b23ce18a9d1 tempest-AttachVolumeShelveTestJSON-808950028 None] Created reservations ['abeb17b0-6b6a-4778-88b1-cdc19eab77de', '72c76024-e1e4-48d1-bb35-21ba0ae67a13', '0098f2ad-7602-4cda-b32e-0d86965d2ab3', '8eebb619-4602-4bea-ac76-11da46b3f45e'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:24:10 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f8f29f4f-a41c-4070-8aa0-a5d990913210 tempest-VolumesTestJSON-1541563253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9ff2a70a-eb8d-46eb-9306-22b9a2ca5c63" returned: 0 in 0.851s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f8f29f4f-a41c-4070-8aa0-a5d990913210 tempest-VolumesTestJSON-1541563253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9ff2a70a-eb8d-46eb-9306-22b9a2ca5c63 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-47cc4a24-05ef-4386-a914-0b23ce18a9d1 tempest-AttachVolumeShelveTestJSON-808950028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-47cc4a24-05ef-4386-a914-0b23ce18a9d1 tempest-AttachVolumeShelveTestJSON-808950028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:10 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-47cc4a24-05ef-4386-a914-0b23ce18a9d1 tempest-AttachVolumeShelveTestJSON-808950028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:24:10 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-47cc4a24-05ef-4386-a914-0b23ce18a9d1 tempest-AttachVolumeShelveTestJSON-808950028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:24:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-47cc4a24-05ef-4386-a914-0b23ce18a9d1 tempest-AttachVolumeShelveTestJSON-808950028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-47cc4a24-05ef-4386-a914-0b23ce18a9d1 tempest-AttachVolumeShelveTestJSON-808950028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:10 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9ff2a70a-eb8d-46eb-9306-22b9a2ca5c63 Jun 02 03:24:10 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:10 devstack sudo[95574]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:10 devstack sudo[95588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:24:10 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.694s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:10 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:24:10 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager._thread_info {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:24:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread count: 8 {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 02 03:24:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread info: [<_MainThread(MainThread, started 138618128814208)>, , , , , , , ] {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 02 03:24:10 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c.71078ac8-5728-4835-9500-38fb0c84b3a4" returned: 0 in 0.715s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:10 devstack sudo[95592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c.info Jun 02 03:24:10 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:10 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1afc6899-5ad4-4c03-9e91-695459da5b07 tempest-AttachVolumeShelveTestJSON-808950028 None] Acquiring lock "cinder-77b4973f-4a88-4acd-b863-644ee283ea0b-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:24:10 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1afc6899-5ad4-4c03-9e91-695459da5b07 tempest-AttachVolumeShelveTestJSON-808950028 None] Lock "cinder-77b4973f-4a88-4acd-b863-644ee283ea0b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:24:10 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1afc6899-5ad4-4c03-9e91-695459da5b07 tempest-AttachVolumeShelveTestJSON-808950028 None] Acquiring lock "cinder-quobyte-77b4973f-4a88-4acd-b863-644ee283ea0b" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:24:10 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1afc6899-5ad4-4c03-9e91-695459da5b07 tempest-AttachVolumeShelveTestJSON-808950028 None] Lock "cinder-quobyte-77b4973f-4a88-4acd-b863-644ee283ea0b" acquired by "delete_volume" :: waited 0.020s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:24:10 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[4659fb8c-7423-4c1a-a6fe-8b9a0264fc38]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:24:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1afc6899-5ad4-4c03-9e91-695459da5b07 tempest-AttachVolumeShelveTestJSON-808950028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-77b4973f-4a88-4acd-b863-644ee283ea0b {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:10 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f8f29f4f-a41c-4070-8aa0-a5d990913210 tempest-VolumesTestJSON-1541563253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9ff2a70a-eb8d-46eb-9306-22b9a2ca5c63" returned: 0 in 0.722s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:10 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f8f29f4f-a41c-4070-8aa0-a5d990913210 tempest-VolumesTestJSON-1541563253 None] Lock "cinder-quobyte-9ff2a70a-eb8d-46eb-9306-22b9a2ca5c63" released by "delete_volume" :: held 1.653s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:24:10 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-47cc4a24-05ef-4386-a914-0b23ce18a9d1 tempest-AttachVolumeShelveTestJSON-808950028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.724s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:10 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-47cc4a24-05ef-4386-a914-0b23ce18a9d1 tempest-AttachVolumeShelveTestJSON-808950028 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:24:10 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-47cc4a24-05ef-4386-a914-0b23ce18a9d1 tempest-AttachVolumeShelveTestJSON-808950028 None] Deleted volume successfully. Jun 02 03:24:10 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-47cc4a24-05ef-4386-a914-0b23ce18a9d1 tempest-AttachVolumeShelveTestJSON-808950028 None] Lock "cinder-ec95d7c6-af6b-4600-a2e9-db20a82a7590-delete_volume" released by "delete_volume" :: held 2.604s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:24:10 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-f8f29f4f-a41c-4070-8aa0-a5d990913210 tempest-VolumesTestJSON-1541563253 None] Created reservations ['f6c7efc3-471f-48ca-ac47-847c8d860de8', 'f7efca54-63a6-44e2-b566-0e7b8f40e678', '8b18170b-8330-4c48-bf5d-7f9dfa380c82', '3703e6fa-dfee-4f21-aa0e-0162cc78c296'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:24:10 devstack sudo[95596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-77b4973f-4a88-4acd-b863-644ee283ea0b Jun 02 03:24:10 devstack sudo[95596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-f8f29f4f-a41c-4070-8aa0-a5d990913210 tempest-VolumesTestJSON-1541563253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-f8f29f4f-a41c-4070-8aa0-a5d990913210 tempest-VolumesTestJSON-1541563253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-f8f29f4f-a41c-4070-8aa0-a5d990913210 tempest-VolumesTestJSON-1541563253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:24:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-f8f29f4f-a41c-4070-8aa0-a5d990913210 tempest-VolumesTestJSON-1541563253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:24:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-f8f29f4f-a41c-4070-8aa0-a5d990913210 tempest-VolumesTestJSON-1541563253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f8f29f4f-a41c-4070-8aa0-a5d990913210 tempest-VolumesTestJSON-1541563253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:11 devstack sudo[95598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:24:11 devstack sudo[95598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:11 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c.info" returned: 0 in 0.676s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:11 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c.info is being set with open permissions: ugo+rw: NotImplementedError Jun 02 03:24:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:11 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c.info Jun 02 03:24:11 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:11 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-305188f0-2295-47be-97d4-98109e67d988 tempest-VolumesTestJSON-1541563253 None] Acquiring lock "cinder-8edbde7a-0688-4c1c-9530-86ef9ef8aa77-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:24:11 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-305188f0-2295-47be-97d4-98109e67d988 tempest-VolumesTestJSON-1541563253 None] Lock "cinder-8edbde7a-0688-4c1c-9530-86ef9ef8aa77-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:24:11 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-305188f0-2295-47be-97d4-98109e67d988 tempest-VolumesTestJSON-1541563253 None] Acquiring lock "cinder-quobyte-8edbde7a-0688-4c1c-9530-86ef9ef8aa77" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:24:11 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-305188f0-2295-47be-97d4-98109e67d988 tempest-VolumesTestJSON-1541563253 None] Lock "cinder-quobyte-8edbde7a-0688-4c1c-9530-86ef9ef8aa77" acquired by "delete_volume" :: waited 0.030s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:24:11 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[6308566a-7dba-4216-ab0b-eb058ee365bf]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:24:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-305188f0-2295-47be-97d4-98109e67d988 tempest-VolumesTestJSON-1541563253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8edbde7a-0688-4c1c-9530-86ef9ef8aa77 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:11 devstack sudo[95596]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1afc6899-5ad4-4c03-9e91-695459da5b07 tempest-AttachVolumeShelveTestJSON-808950028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-77b4973f-4a88-4acd-b863-644ee283ea0b" returned: 0 in 0.820s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1afc6899-5ad4-4c03-9e91-695459da5b07 tempest-AttachVolumeShelveTestJSON-808950028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-77b4973f-4a88-4acd-b863-644ee283ea0b {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:11 devstack sudo[95608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-77b4973f-4a88-4acd-b863-644ee283ea0b Jun 02 03:24:11 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:11 devstack sudo[95598]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f8f29f4f-a41c-4070-8aa0-a5d990913210 tempest-VolumesTestJSON-1541563253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.700s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:11 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-f8f29f4f-a41c-4070-8aa0-a5d990913210 tempest-VolumesTestJSON-1541563253 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:24:11 devstack sudo[95607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8edbde7a-0688-4c1c-9530-86ef9ef8aa77 Jun 02 03:24:11 devstack sudo[95607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:11 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-f8f29f4f-a41c-4070-8aa0-a5d990913210 tempest-VolumesTestJSON-1541563253 None] Deleted volume successfully. Jun 02 03:24:11 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f8f29f4f-a41c-4070-8aa0-a5d990913210 tempest-VolumesTestJSON-1541563253 None] Lock "cinder-9ff2a70a-eb8d-46eb-9306-22b9a2ca5c63-delete_volume" released by "delete_volume" :: held 2.606s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:24:11 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c.info" returned: 0 in 0.741s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:11 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Acquiring lock "cinder-quobyte-03b5f2b0-1807-4650-b27c-e18c25b77f61" by "_copy_volume_from_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:24:11 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Lock "cinder-quobyte-03b5f2b0-1807-4650-b27c-e18c25b77f61" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:24:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] snapshot: 71078ac8-5728-4835-9500-38fb0c84b3a4, volume: 03b5f2b0-1807-4650-b27c-e18c25b77f61, {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 03:24:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:12 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:24:12 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:24:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:12 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[4294cce5-c857-45ee-ad90-70099387c95d]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:24:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c.71078ac8-5728-4835-9500-38fb0c84b3a4 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:12 devstack sudo[95612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c.71078ac8-5728-4835-9500-38fb0c84b3a4 Jun 02 03:24:12 devstack sudo[95612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:12 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1afc6899-5ad4-4c03-9e91-695459da5b07 tempest-AttachVolumeShelveTestJSON-808950028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-77b4973f-4a88-4acd-b863-644ee283ea0b" returned: 0 in 0.647s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:12 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1afc6899-5ad4-4c03-9e91-695459da5b07 tempest-AttachVolumeShelveTestJSON-808950028 None] Lock "cinder-quobyte-77b4973f-4a88-4acd-b863-644ee283ea0b" released by "delete_volume" :: held 1.511s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:24:12 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-1afc6899-5ad4-4c03-9e91-695459da5b07 tempest-AttachVolumeShelveTestJSON-808950028 None] Created reservations ['5955a82f-7f20-4178-85c7-c17d1ab81bb3', 'b721bc81-132d-4c8d-8e01-b166377ea48e', 'b8d0ce31-2e9b-4cbf-a674-98f6c8f1eba3', '02903105-4e7b-4b6c-bad0-b76c3934dcc4'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:24:12 devstack sudo[95607]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-305188f0-2295-47be-97d4-98109e67d988 tempest-VolumesTestJSON-1541563253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8edbde7a-0688-4c1c-9530-86ef9ef8aa77" returned: 0 in 0.819s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-305188f0-2295-47be-97d4-98109e67d988 tempest-VolumesTestJSON-1541563253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8edbde7a-0688-4c1c-9530-86ef9ef8aa77 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:12 devstack sudo[95618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8edbde7a-0688-4c1c-9530-86ef9ef8aa77 Jun 02 03:24:12 devstack sudo[95618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1afc6899-5ad4-4c03-9e91-695459da5b07 tempest-AttachVolumeShelveTestJSON-808950028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1afc6899-5ad4-4c03-9e91-695459da5b07 tempest-AttachVolumeShelveTestJSON-808950028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:12 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-1afc6899-5ad4-4c03-9e91-695459da5b07 tempest-AttachVolumeShelveTestJSON-808950028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:24:12 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-1afc6899-5ad4-4c03-9e91-695459da5b07 tempest-AttachVolumeShelveTestJSON-808950028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:24:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1afc6899-5ad4-4c03-9e91-695459da5b07 tempest-AttachVolumeShelveTestJSON-808950028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1afc6899-5ad4-4c03-9e91-695459da5b07 tempest-AttachVolumeShelveTestJSON-808950028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:12 devstack sudo[95621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:24:12 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:12 devstack sudo[95612]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c.71078ac8-5728-4835-9500-38fb0c84b3a4" returned: 0 in 0.803s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:12 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:24:12 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 03:24:12 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Creating direct copy from snapshot {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 03:24:12 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca133add-446b-4d41-bfc2-93345c639cb5]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:24:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:12 devstack sudo[95626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c Jun 02 03:24:12 devstack sudo[95626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:13 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1afc6899-5ad4-4c03-9e91-695459da5b07 tempest-AttachVolumeShelveTestJSON-808950028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.621s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:13 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-1afc6899-5ad4-4c03-9e91-695459da5b07 tempest-AttachVolumeShelveTestJSON-808950028 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:24:13 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-1afc6899-5ad4-4c03-9e91-695459da5b07 tempest-AttachVolumeShelveTestJSON-808950028 None] Deleted volume successfully. Jun 02 03:24:13 devstack sudo[95618]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-305188f0-2295-47be-97d4-98109e67d988 tempest-VolumesTestJSON-1541563253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-8edbde7a-0688-4c1c-9530-86ef9ef8aa77" returned: 0 in 0.706s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:13 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1afc6899-5ad4-4c03-9e91-695459da5b07 tempest-AttachVolumeShelveTestJSON-808950028 None] Lock "cinder-77b4973f-4a88-4acd-b863-644ee283ea0b-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:24:13 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-305188f0-2295-47be-97d4-98109e67d988 tempest-VolumesTestJSON-1541563253 None] Lock "cinder-quobyte-8edbde7a-0688-4c1c-9530-86ef9ef8aa77" released by "delete_volume" :: held 1.593s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:24:13 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-305188f0-2295-47be-97d4-98109e67d988 tempest-VolumesTestJSON-1541563253 None] Created reservations ['afb27098-8d90-4fea-afbc-f6c39ca06815', '38b12086-e268-47af-91da-6c97449dfec9', 'd1668fb0-204d-48a6-9978-76a16fb1cbcf', '2347d7d4-a0c0-4bdb-a1ce-2f0c71e36a22'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:24:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-305188f0-2295-47be-97d4-98109e67d988 tempest-VolumesTestJSON-1541563253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-305188f0-2295-47be-97d4-98109e67d988 tempest-VolumesTestJSON-1541563253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:13 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-305188f0-2295-47be-97d4-98109e67d988 tempest-VolumesTestJSON-1541563253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:24:13 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-305188f0-2295-47be-97d4-98109e67d988 tempest-VolumesTestJSON-1541563253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:24:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-305188f0-2295-47be-97d4-98109e67d988 tempest-VolumesTestJSON-1541563253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-305188f0-2295-47be-97d4-98109e67d988 tempest-VolumesTestJSON-1541563253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:13 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:24:13 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:13 devstack sudo[95626]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c" returned: 0 in 0.798s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:13 devstack cinder-volume[86431]: DEBUG cinder.utils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Path /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-03b5f2b0-1807-4650-b27c-e18c25b77f61 not found in is_blk_device check {{(pid=86431) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 02 03:24:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-03b5f2b0-1807-4650-b27c-e18c25b77f61 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:13 devstack sudo[95635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-03b5f2b0-1807-4650-b27c-e18c25b77f61 Jun 02 03:24:13 devstack sudo[95635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:14 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-305188f0-2295-47be-97d4-98109e67d988 tempest-VolumesTestJSON-1541563253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.760s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:14 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-305188f0-2295-47be-97d4-98109e67d988 tempest-VolumesTestJSON-1541563253 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:24:14 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-305188f0-2295-47be-97d4-98109e67d988 tempest-VolumesTestJSON-1541563253 None] Deleted volume successfully. Jun 02 03:24:14 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-305188f0-2295-47be-97d4-98109e67d988 tempest-VolumesTestJSON-1541563253 None] Lock "cinder-8edbde7a-0688-4c1c-9530-86ef9ef8aa77-delete_volume" released by "delete_volume" :: held 2.642s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:24:19 devstack sudo[95635]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-03b5f2b0-1807-4650-b27c-e18c25b77f61" returned: 0 in 6.346s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:20 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af41415-4d69-48ef-b456-77f5a18d09ef]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:24:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:20 devstack sudo[95690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c Jun 02 03:24:20 devstack sudo[95690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:21 devstack sudo[95690]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c" returned: 0 in 0.994s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:21 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Image conversion details: src /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c, size 1024.00 MB, duration 6.35 sec, destination /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-03b5f2b0-1807-4650-b27c-e18c25b77f61 {{(pid=86431) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 02 03:24:21 devstack cinder-volume[86431]: INFO cinder.image.image_utils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Converted 1024.00 MB image at 161.34 MB/s Jun 02 03:24:21 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-03b5f2b0-1807-4650-b27c-e18c25b77f61 is being set with open permissions: ugo+rw: NotImplementedError Jun 02 03:24:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-03b5f2b0-1807-4650-b27c-e18c25b77f61 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:21 devstack sudo[95696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-03b5f2b0-1807-4650-b27c-e18c25b77f61 Jun 02 03:24:21 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:21 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-03b5f2b0-1807-4650-b27c-e18c25b77f61" returned: 0 in 0.646s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:21 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Lock "cinder-quobyte-03b5f2b0-1807-4650-b27c-e18c25b77f61" released by "_copy_volume_from_snapshot" :: held 9.676s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:24:21 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Acquiring lock "cinder-quobyte-71078ac8-5728-4835-9500-38fb0c84b3a4" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:24:21 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Lock "cinder-quobyte-71078ac8-5728-4835-9500-38fb0c84b3a4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:24:21 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Deleting offline snapshot 71078ac8-5728-4835-9500-38fb0c84b3a4 of volume fa271cda-c9eb-4ffc-bce4-bd3394a59b4c {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:24:21 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] snapshot_file for this snap is: volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c.71078ac8-5728-4835-9500-38fb0c84b3a4 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:24:21 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a551ffc-e504-4751-a17c-86c0c7d9e43c]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:24:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c.71078ac8-5728-4835-9500-38fb0c84b3a4 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:21 devstack sudo[95699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c.71078ac8-5728-4835-9500-38fb0c84b3a4 Jun 02 03:24:21 devstack sudo[95699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:22 devstack sudo[95699]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c.71078ac8-5728-4835-9500-38fb0c84b3a4" returned: 0 in 0.816s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:22 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:24:22 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d31687-1f03-4a26-a708-4a0bf7dba2c1]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:24:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:22 devstack sudo[95705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c Jun 02 03:24:22 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:23 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:UPDATE=127,cinder:SELECT=90,cinder:INSERT=30,cinder:DELETE=9 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:24:23 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c" returned: 0 in 0.786s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c.71078ac8-5728-4835-9500-38fb0c84b3a4 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:23 devstack sudo[95710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c.71078ac8-5728-4835-9500-38fb0c84b3a4 Jun 02 03:24:23 devstack sudo[95710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:23 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [req-c5f9905f-788e-4b26-a6de-b2f0230312ee req-a8b13176-ecb4-4f92-b75a-3a74e42153c1 tempest-VolumesSnapshotsTestJSON-1995513668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:24:23 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-c5f9905f-788e-4b26-a6de-b2f0230312ee req-a8b13176-ecb4-4f92-b75a-3a74e42153c1 tempest-VolumesSnapshotsTestJSON-1995513668 None] Flow 'volume_create_manager' (7ab9345b-8444-40fc-a040-941e7089b58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:24:23 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-c5f9905f-788e-4b26-a6de-b2f0230312ee req-a8b13176-ecb4-4f92-b75a-3a74e42153c1 tempest-VolumesSnapshotsTestJSON-1995513668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfcf122e-6116-4a42-999c-02bda83e0100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:23 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-c5f9905f-788e-4b26-a6de-b2f0230312ee req-a8b13176-ecb4-4f92-b75a-3a74e42153c1 tempest-VolumesSnapshotsTestJSON-1995513668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfcf122e-6116-4a42-999c-02bda83e0100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-636714317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5394cf1-d9c3-49ca-a995-79f6a5d14bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b06b159e2e044b499190789acff32e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:24:24Z,use_quota=True,user_id='dc002ee13af349f6a24216ab71e4801b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:23 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-c5f9905f-788e-4b26-a6de-b2f0230312ee req-a8b13176-ecb4-4f92-b75a-3a74e42153c1 tempest-VolumesSnapshotsTestJSON-1995513668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f466061-22f5-4e07-9aa9-428dda4bc366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:23 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-c5f9905f-788e-4b26-a6de-b2f0230312ee req-a8b13176-ecb4-4f92-b75a-3a74e42153c1 tempest-VolumesSnapshotsTestJSON-1995513668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f466061-22f5-4e07-9aa9-428dda4bc366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:23 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-c5f9905f-788e-4b26-a6de-b2f0230312ee req-a8b13176-ecb4-4f92-b75a-3a74e42153c1 tempest-VolumesSnapshotsTestJSON-1995513668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1603fc99-927b-4863-bcf5-fbcf680717bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:23 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-c5f9905f-788e-4b26-a6de-b2f0230312ee req-a8b13176-ecb4-4f92-b75a-3a74e42153c1 tempest-VolumesSnapshotsTestJSON-1995513668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1603fc99-927b-4863-bcf5-fbcf680717bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5394cf1-d9c3-49ca-a995-79f6a5d14bae', 'volume_name': 'volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:23 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-c5f9905f-788e-4b26-a6de-b2f0230312ee req-a8b13176-ecb4-4f92-b75a-3a74e42153c1 tempest-VolumesSnapshotsTestJSON-1995513668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0483a2c-ad2c-4dee-ac66-a8ef1df5c1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:23 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-c5f9905f-788e-4b26-a6de-b2f0230312ee req-a8b13176-ecb4-4f92-b75a-3a74e42153c1 tempest-VolumesSnapshotsTestJSON-1995513668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0483a2c-ad2c-4dee-ac66-a8ef1df5c1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:23 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-c5f9905f-788e-4b26-a6de-b2f0230312ee req-a8b13176-ecb4-4f92-b75a-3a74e42153c1 tempest-VolumesSnapshotsTestJSON-1995513668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d31ed65-6033-4337-9e83-5c171ce509d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:23 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [req-c5f9905f-788e-4b26-a6de-b2f0230312ee req-a8b13176-ecb4-4f92-b75a-3a74e42153c1 tempest-VolumesSnapshotsTestJSON-1995513668 None] Volume f5394cf1-d9c3-49ca-a995-79f6a5d14bae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae', 'volume_size': 1} Jun 02 03:24:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-c5f9905f-788e-4b26-a6de-b2f0230312ee req-a8b13176-ecb4-4f92-b75a-3a74e42153c1 tempest-VolumesSnapshotsTestJSON-1995513668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:24 devstack sudo[95710]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c.71078ac8-5728-4835-9500-38fb0c84b3a4" returned: 0 in 0.757s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c.71078ac8-5728-4835-9500-38fb0c84b3a4 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:24 devstack sudo[95715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c.71078ac8-5728-4835-9500-38fb0c84b3a4 Jun 02 03:24:24 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:24 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c.71078ac8-5728-4835-9500-38fb0c84b3a4" returned: 0 in 0.632s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:24 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Lock "cinder-quobyte-71078ac8-5728-4835-9500-38fb0c84b3a4" released by "_delete_snapshot" :: held 3.100s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:24:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.740s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6e761a24-7975-49e9-a2d8-a48a36be9ce7 tempest-VolumesListTestJSON-1821370474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.745s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:24 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6e761a24-7975-49e9-a2d8-a48a36be9ce7 tempest-VolumesListTestJSON-1821370474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-203947851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a172e6e-7e66-43ed-a462-977bc7d12152,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1eecae34b93445ea8791e236e1c75222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:24:08Z,use_quota=True,user_id='48d07298b12d4c12b852ad7e8f1f69bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:24:24 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-6e761a24-7975-49e9-a2d8-a48a36be9ce7 tempest-VolumesListTestJSON-1821370474 None] Creating volume 0a172e6e-7e66-43ed-a462-977bc7d12152 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:24:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6e761a24-7975-49e9-a2d8-a48a36be9ce7 tempest-VolumesListTestJSON-1821370474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6e761a24-7975-49e9-a2d8-a48a36be9ce7 tempest-VolumesListTestJSON-1821370474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:24 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6e761a24-7975-49e9-a2d8-a48a36be9ce7 tempest-VolumesListTestJSON-1821370474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:24:24 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6e761a24-7975-49e9-a2d8-a48a36be9ce7 tempest-VolumesListTestJSON-1821370474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:24:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6e761a24-7975-49e9-a2d8-a48a36be9ce7 tempest-VolumesListTestJSON-1821370474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:24 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6e761a24-7975-49e9-a2d8-a48a36be9ce7 tempest-VolumesListTestJSON-1821370474 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:24:24 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-6e761a24-7975-49e9-a2d8-a48a36be9ce7 tempest-VolumesListTestJSON-1821370474 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:24:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6e761a24-7975-49e9-a2d8-a48a36be9ce7 tempest-VolumesListTestJSON-1821370474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-0a172e6e-7e66-43ed-a462-977bc7d12152 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:24 devstack sudo[95718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-0a172e6e-7e66-43ed-a462-977bc7d12152 1073741824 Jun 02 03:24:24 devstack sudo[95718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:24 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-fb64e300-957d-49ae-8e8d-91bfd555242f tempest-GroupsV314Test-853933519 None] Create group from source-group-380e68aa-e47c-46b4-83dc-67f0e7ae2393 completed successfully. Jun 02 03:24:25 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-b2d188cf-0fc1-49f0-b2e0-e7883b8be77b tempest-GroupSnapshotsV319Test-53960984 None] Group tempest-GroupSnapshotsV319Test-Group-1353303750: creating Jun 02 03:24:25 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-b2d188cf-0fc1-49f0-b2e0-e7883b8be77b tempest-GroupSnapshotsV319Test-53960984 None] Group tempest-GroupSnapshotsV319Test-Group-1353303750: created successfully Jun 02 03:24:25 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-b2d188cf-0fc1-49f0-b2e0-e7883b8be77b tempest-GroupSnapshotsV319Test-53960984 None] Create group completed successfully. Jun 02 03:24:25 devstack sudo[95718]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6e761a24-7975-49e9-a2d8-a48a36be9ce7 tempest-VolumesListTestJSON-1821370474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-0a172e6e-7e66-43ed-a462-977bc7d12152 1073741824" returned: 0 in 0.798s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6e761a24-7975-49e9-a2d8-a48a36be9ce7 tempest-VolumesListTestJSON-1821370474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-0a172e6e-7e66-43ed-a462-977bc7d12152 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:25 devstack sudo[95723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-0a172e6e-7e66-43ed-a462-977bc7d12152 Jun 02 03:24:25 devstack sudo[95723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:25 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-c89d905a-594b-41eb-a79f-bc94d029295b tempest-GroupsV314Test-853933519 None] Acquiring lock "cinder-quobyte-03b5f2b0-1807-4650-b27c-e18c25b77f61" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:24:25 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-c89d905a-594b-41eb-a79f-bc94d029295b tempest-GroupsV314Test-853933519 None] Lock "cinder-quobyte-03b5f2b0-1807-4650-b27c-e18c25b77f61" acquired by "delete_volume" :: waited 0.019s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:24:25 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5ba87a-e1c1-4dce-95fc-2a69fb546837]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:24:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c89d905a-594b-41eb-a79f-bc94d029295b tempest-GroupsV314Test-853933519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-03b5f2b0-1807-4650-b27c-e18c25b77f61 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:26 devstack sudo[95725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-03b5f2b0-1807-4650-b27c-e18c25b77f61 Jun 02 03:24:26 devstack sudo[95725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:26 devstack sudo[95723]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6e761a24-7975-49e9-a2d8-a48a36be9ce7 tempest-VolumesListTestJSON-1821370474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-0a172e6e-7e66-43ed-a462-977bc7d12152" returned: 0 in 0.618s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:26 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6e761a24-7975-49e9-a2d8-a48a36be9ce7 tempest-VolumesListTestJSON-1821370474 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:24:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6e761a24-7975-49e9-a2d8-a48a36be9ce7 tempest-VolumesListTestJSON-1821370474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-c5f9905f-788e-4b26-a6de-b2f0230312ee req-a8b13176-ecb4-4f92-b75a-3a74e42153c1 tempest-VolumesSnapshotsTestJSON-1995513668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.330s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:26 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [req-c5f9905f-788e-4b26-a6de-b2f0230312ee req-a8b13176-ecb4-4f92-b75a-3a74e42153c1 tempest-VolumesSnapshotsTestJSON-1995513668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-636714317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5394cf1-d9c3-49ca-a995-79f6a5d14bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b06b159e2e044b499190789acff32e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:24:24Z,use_quota=True,user_id='dc002ee13af349f6a24216ab71e4801b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:24:26 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [req-c5f9905f-788e-4b26-a6de-b2f0230312ee req-a8b13176-ecb4-4f92-b75a-3a74e42153c1 tempest-VolumesSnapshotsTestJSON-1995513668 None] Creating volume f5394cf1-d9c3-49ca-a995-79f6a5d14bae {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:24:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-c5f9905f-788e-4b26-a6de-b2f0230312ee req-a8b13176-ecb4-4f92-b75a-3a74e42153c1 tempest-VolumesSnapshotsTestJSON-1995513668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-c5f9905f-788e-4b26-a6de-b2f0230312ee req-a8b13176-ecb4-4f92-b75a-3a74e42153c1 tempest-VolumesSnapshotsTestJSON-1995513668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:26 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [req-c5f9905f-788e-4b26-a6de-b2f0230312ee req-a8b13176-ecb4-4f92-b75a-3a74e42153c1 tempest-VolumesSnapshotsTestJSON-1995513668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:24:26 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [req-c5f9905f-788e-4b26-a6de-b2f0230312ee req-a8b13176-ecb4-4f92-b75a-3a74e42153c1 tempest-VolumesSnapshotsTestJSON-1995513668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:24:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-c5f9905f-788e-4b26-a6de-b2f0230312ee req-a8b13176-ecb4-4f92-b75a-3a74e42153c1 tempest-VolumesSnapshotsTestJSON-1995513668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:26 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [req-c5f9905f-788e-4b26-a6de-b2f0230312ee req-a8b13176-ecb4-4f92-b75a-3a74e42153c1 tempest-VolumesSnapshotsTestJSON-1995513668 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:24:26 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [req-c5f9905f-788e-4b26-a6de-b2f0230312ee req-a8b13176-ecb4-4f92-b75a-3a74e42153c1 tempest-VolumesSnapshotsTestJSON-1995513668 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:24:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-c5f9905f-788e-4b26-a6de-b2f0230312ee req-a8b13176-ecb4-4f92-b75a-3a74e42153c1 tempest-VolumesSnapshotsTestJSON-1995513668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6e761a24-7975-49e9-a2d8-a48a36be9ce7 tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a336b59b-9749-49dc-8ad1-83a370807a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a172e6e-7e66-43ed-a462-977bc7d12152', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6e761a24-7975-49e9-a2d8-a48a36be9ce7 tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7e4330-6f4e-439c-b361-bcedbf188ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:26 devstack sudo[95729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae 1073741824 Jun 02 03:24:26 devstack sudo[95729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:26 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-6e761a24-7975-49e9-a2d8-a48a36be9ce7 tempest-VolumesListTestJSON-1821370474 None] Volume volume-0a172e6e-7e66-43ed-a462-977bc7d12152 (0a172e6e-7e66-43ed-a462-977bc7d12152): created successfully Jun 02 03:24:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6e761a24-7975-49e9-a2d8-a48a36be9ce7 tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7e4330-6f4e-439c-b361-bcedbf188ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6e761a24-7975-49e9-a2d8-a48a36be9ce7 tempest-VolumesListTestJSON-1821370474 None] Flow 'volume_create_manager' (84272d9a-1e7d-409a-b46a-13bb5b21942f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:24:26 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-6e761a24-7975-49e9-a2d8-a48a36be9ce7 tempest-VolumesListTestJSON-1821370474 None] Created volume successfully. Jun 02 03:24:26 devstack sudo[95725]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c89d905a-594b-41eb-a79f-bc94d029295b tempest-GroupsV314Test-853933519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-03b5f2b0-1807-4650-b27c-e18c25b77f61" returned: 0 in 0.750s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c89d905a-594b-41eb-a79f-bc94d029295b tempest-GroupsV314Test-853933519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-03b5f2b0-1807-4650-b27c-e18c25b77f61 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:26 devstack sudo[95734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-03b5f2b0-1807-4650-b27c-e18c25b77f61 Jun 02 03:24:26 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:26 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:DELETE=10,cinder:UPDATE=129,cinder:SELECT=99,cinder:INSERT=29 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:24:26 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c1b8ca8-12c6-42ac-aad7-04730e6c440c tempest-GroupSnapshotsV319Test-53960984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:24:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8c1b8ca8-12c6-42ac-aad7-04730e6c440c tempest-GroupSnapshotsV319Test-53960984 None] Flow 'volume_create_manager' (8d2fe42f-1da9-464d-9298-bc65dc854536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:24:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8c1b8ca8-12c6-42ac-aad7-04730e6c440c tempest-GroupSnapshotsV319Test-53960984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e8a3654-3757-4be8-a114-2250663aa340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8c1b8ca8-12c6-42ac-aad7-04730e6c440c tempest-GroupSnapshotsV319Test-53960984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e8a3654-3757-4be8-a114-2250663aa340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1825317521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=432abafe-ddfd-4492-8ef7-86ff848fe6c7,host='devstack@QuobyteHD#QuobyteHD',id=6fff8bd1-c0bf-454b-b833-85ea7176abcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d062c6702b394e5db429ec36af4bb5ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:24:27Z,use_quota=True,user_id='03bafbeeee4d4226ab3b3ac944508d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0bb07f0-d47d-4fc3-86b9-17520a882d9b),volume_type_id=e0bb07f0-d47d-4fc3-86b9-17520a882d9b)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8c1b8ca8-12c6-42ac-aad7-04730e6c440c tempest-GroupSnapshotsV319Test-53960984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c78439-090e-4922-ba18-0067a3326795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8c1b8ca8-12c6-42ac-aad7-04730e6c440c tempest-GroupSnapshotsV319Test-53960984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c78439-090e-4922-ba18-0067a3326795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8c1b8ca8-12c6-42ac-aad7-04730e6c440c tempest-GroupSnapshotsV319Test-53960984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b9c6914-2a90-4a59-9afc-127dfac4eaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8c1b8ca8-12c6-42ac-aad7-04730e6c440c tempest-GroupSnapshotsV319Test-53960984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b9c6914-2a90-4a59-9afc-127dfac4eaad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fff8bd1-c0bf-454b-b833-85ea7176abcc', 'volume_name': 'volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8c1b8ca8-12c6-42ac-aad7-04730e6c440c tempest-GroupSnapshotsV319Test-53960984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c1b9cd-1f05-4593-934d-f442689825a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8c1b8ca8-12c6-42ac-aad7-04730e6c440c tempest-GroupSnapshotsV319Test-53960984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c1b9cd-1f05-4593-934d-f442689825a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8c1b8ca8-12c6-42ac-aad7-04730e6c440c tempest-GroupSnapshotsV319Test-53960984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c44d0330-2dc6-46d7-ba37-b96636bed32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:26 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-8c1b8ca8-12c6-42ac-aad7-04730e6c440c tempest-GroupSnapshotsV319Test-53960984 None] Volume 6fff8bd1-c0bf-454b-b833-85ea7176abcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc', 'volume_size': 1} Jun 02 03:24:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8c1b8ca8-12c6-42ac-aad7-04730e6c440c tempest-GroupSnapshotsV319Test-53960984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:27 devstack sudo[95729]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-c5f9905f-788e-4b26-a6de-b2f0230312ee req-a8b13176-ecb4-4f92-b75a-3a74e42153c1 tempest-VolumesSnapshotsTestJSON-1995513668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae 1073741824" returned: 0 in 0.940s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-c5f9905f-788e-4b26-a6de-b2f0230312ee req-a8b13176-ecb4-4f92-b75a-3a74e42153c1 tempest-VolumesSnapshotsTestJSON-1995513668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:27 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c89d905a-594b-41eb-a79f-bc94d029295b tempest-GroupsV314Test-853933519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-03b5f2b0-1807-4650-b27c-e18c25b77f61" returned: 0 in 0.656s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:27 devstack sudo[95741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae Jun 02 03:24:27 devstack sudo[95741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:27 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-c89d905a-594b-41eb-a79f-bc94d029295b tempest-GroupsV314Test-853933519 None] Lock "cinder-quobyte-03b5f2b0-1807-4650-b27c-e18c25b77f61" released by "delete_volume" :: held 1.464s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:24:27 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-c89d905a-594b-41eb-a79f-bc94d029295b tempest-GroupsV314Test-853933519 None] Created reservations ['86297d42-5dbb-44d6-9df5-9561ed6e1059'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:24:27 devstack cinder-volume[86431]: WARNING cinder.quota [None req-c89d905a-594b-41eb-a79f-bc94d029295b tempest-GroupsV314Test-853933519 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1090783447 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1090783447, it is now deprecated. Please use the default quota class for default quota. Jun 02 03:24:27 devstack cinder-volume[86431]: WARNING cinder.quota [None req-c89d905a-594b-41eb-a79f-bc94d029295b tempest-GroupsV314Test-853933519 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1090783447 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1090783447, it is now deprecated. Please use the default quota class for default quota. Jun 02 03:24:27 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-c89d905a-594b-41eb-a79f-bc94d029295b tempest-GroupsV314Test-853933519 None] Created reservations ['8b0c22af-8a4e-4121-a9f3-27fead8596cb', '462b2dea-b9a1-4a28-9b6d-f75119d8e10d', '3f5a22f3-fef0-4e38-a7bb-e68d855e604b', 'd1439bb4-2ddc-48d0-a5d3-8ab28cc0188d'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:24:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c89d905a-594b-41eb-a79f-bc94d029295b tempest-GroupsV314Test-853933519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c89d905a-594b-41eb-a79f-bc94d029295b tempest-GroupsV314Test-853933519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:27 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-c89d905a-594b-41eb-a79f-bc94d029295b tempest-GroupsV314Test-853933519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:24:27 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-c89d905a-594b-41eb-a79f-bc94d029295b tempest-GroupsV314Test-853933519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:24:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c89d905a-594b-41eb-a79f-bc94d029295b tempest-GroupsV314Test-853933519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c89d905a-594b-41eb-a79f-bc94d029295b tempest-GroupsV314Test-853933519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:27 devstack sudo[95743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:24:27 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:27 devstack sudo[95741]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-c5f9905f-788e-4b26-a6de-b2f0230312ee req-a8b13176-ecb4-4f92-b75a-3a74e42153c1 tempest-VolumesSnapshotsTestJSON-1995513668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae" returned: 0 in 0.614s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:27 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [req-c5f9905f-788e-4b26-a6de-b2f0230312ee req-a8b13176-ecb4-4f92-b75a-3a74e42153c1 tempest-VolumesSnapshotsTestJSON-1995513668 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:24:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-c5f9905f-788e-4b26-a6de-b2f0230312ee req-a8b13176-ecb4-4f92-b75a-3a74e42153c1 tempest-VolumesSnapshotsTestJSON-1995513668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8c1b8ca8-12c6-42ac-aad7-04730e6c440c tempest-GroupSnapshotsV319Test-53960984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.106s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:27 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-8c1b8ca8-12c6-42ac-aad7-04730e6c440c tempest-GroupSnapshotsV319Test-53960984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=432abafe-ddfd-4492-8ef7-86ff848fe6c7,created_at=2026-06-02T01:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1825317521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=432abafe-ddfd-4492-8ef7-86ff848fe6c7,host='devstack@QuobyteHD#QuobyteHD',id=6fff8bd1-c0bf-454b-b833-85ea7176abcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d062c6702b394e5db429ec36af4bb5ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:24:27Z,use_quota=True,user_id='03bafbeeee4d4226ab3b3ac944508d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0bb07f0-d47d-4fc3-86b9-17520a882d9b),volume_type_id=e0bb07f0-d47d-4fc3-86b9-17520a882d9b)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:24:27 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-8c1b8ca8-12c6-42ac-aad7-04730e6c440c tempest-GroupSnapshotsV319Test-53960984 None] Creating volume 6fff8bd1-c0bf-454b-b833-85ea7176abcc {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:24:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8c1b8ca8-12c6-42ac-aad7-04730e6c440c tempest-GroupSnapshotsV319Test-53960984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8c1b8ca8-12c6-42ac-aad7-04730e6c440c tempest-GroupSnapshotsV319Test-53960984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:27 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-8c1b8ca8-12c6-42ac-aad7-04730e6c440c tempest-GroupSnapshotsV319Test-53960984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:24:27 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-8c1b8ca8-12c6-42ac-aad7-04730e6c440c tempest-GroupSnapshotsV319Test-53960984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:24:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8c1b8ca8-12c6-42ac-aad7-04730e6c440c tempest-GroupSnapshotsV319Test-53960984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:27 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-8c1b8ca8-12c6-42ac-aad7-04730e6c440c tempest-GroupSnapshotsV319Test-53960984 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:24:27 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-8c1b8ca8-12c6-42ac-aad7-04730e6c440c tempest-GroupSnapshotsV319Test-53960984 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:24:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8c1b8ca8-12c6-42ac-aad7-04730e6c440c tempest-GroupSnapshotsV319Test-53960984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-c5f9905f-788e-4b26-a6de-b2f0230312ee req-a8b13176-ecb4-4f92-b75a-3a74e42153c1 tempest-VolumesSnapshotsTestJSON-1995513668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d31ed65-6033-4337-9e83-5c171ce509d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:27 devstack sudo[95746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc 1073741824 Jun 02 03:24:27 devstack sudo[95746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-c5f9905f-788e-4b26-a6de-b2f0230312ee req-a8b13176-ecb4-4f92-b75a-3a74e42153c1 tempest-VolumesSnapshotsTestJSON-1995513668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ac3a5a-eebc-471f-8ea2-2ecbed9f5181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:27 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [req-c5f9905f-788e-4b26-a6de-b2f0230312ee req-a8b13176-ecb4-4f92-b75a-3a74e42153c1 tempest-VolumesSnapshotsTestJSON-1995513668 None] Volume volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae (f5394cf1-d9c3-49ca-a995-79f6a5d14bae): created successfully Jun 02 03:24:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-c5f9905f-788e-4b26-a6de-b2f0230312ee req-a8b13176-ecb4-4f92-b75a-3a74e42153c1 tempest-VolumesSnapshotsTestJSON-1995513668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ac3a5a-eebc-471f-8ea2-2ecbed9f5181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-c5f9905f-788e-4b26-a6de-b2f0230312ee req-a8b13176-ecb4-4f92-b75a-3a74e42153c1 tempest-VolumesSnapshotsTestJSON-1995513668 None] Flow 'volume_create_manager' (7ab9345b-8444-40fc-a040-941e7089b58c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:24:28 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-c5f9905f-788e-4b26-a6de-b2f0230312ee req-a8b13176-ecb4-4f92-b75a-3a74e42153c1 tempest-VolumesSnapshotsTestJSON-1995513668 None] Created volume successfully. Jun 02 03:24:28 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d80a03a-0e03-4214-8a0b-65005e10e0d4 tempest-VolumesListTestJSON-1821370474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:24:28 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0d80a03a-0e03-4214-8a0b-65005e10e0d4 tempest-VolumesListTestJSON-1821370474 None] Flow 'volume_create_manager' (2b435905-974c-4586-b00c-f3ff97d07924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:24:28 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0d80a03a-0e03-4214-8a0b-65005e10e0d4 tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de6a2a72-1c8b-4402-98bb-151048418e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:28 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0d80a03a-0e03-4214-8a0b-65005e10e0d4 tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de6a2a72-1c8b-4402-98bb-151048418e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1178120892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c7e797a-486f-46e8-b346-1e61a0f3307c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1eecae34b93445ea8791e236e1c75222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:24:28Z,use_quota=True,user_id='48d07298b12d4c12b852ad7e8f1f69bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:28 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0d80a03a-0e03-4214-8a0b-65005e10e0d4 tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf302d8-ca4b-4374-bc7d-5a36bd2429df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:28 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0d80a03a-0e03-4214-8a0b-65005e10e0d4 tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf302d8-ca4b-4374-bc7d-5a36bd2429df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:28 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0d80a03a-0e03-4214-8a0b-65005e10e0d4 tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de22bf2-1b50-4dfd-ab92-8f60ce6f062f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:28 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0d80a03a-0e03-4214-8a0b-65005e10e0d4 tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de22bf2-1b50-4dfd-ab92-8f60ce6f062f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c7e797a-486f-46e8-b346-1e61a0f3307c', 'volume_name': 'volume-7c7e797a-486f-46e8-b346-1e61a0f3307c', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:28 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0d80a03a-0e03-4214-8a0b-65005e10e0d4 tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6301971-205f-4b98-9406-ba5bb2157db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:28 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0d80a03a-0e03-4214-8a0b-65005e10e0d4 tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6301971-205f-4b98-9406-ba5bb2157db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:28 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0d80a03a-0e03-4214-8a0b-65005e10e0d4 tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d37529ec-e634-4cbf-9292-be6bb94da1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:28 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-0d80a03a-0e03-4214-8a0b-65005e10e0d4 tempest-VolumesListTestJSON-1821370474 None] Volume 7c7e797a-486f-46e8-b346-1e61a0f3307c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c7e797a-486f-46e8-b346-1e61a0f3307c', 'volume_size': 1} Jun 02 03:24:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0d80a03a-0e03-4214-8a0b-65005e10e0d4 tempest-VolumesListTestJSON-1821370474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:28 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c89d905a-594b-41eb-a79f-bc94d029295b tempest-GroupsV314Test-853933519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.716s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:28 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-c89d905a-594b-41eb-a79f-bc94d029295b tempest-GroupsV314Test-853933519 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:24:28 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-c89d905a-594b-41eb-a79f-bc94d029295b tempest-GroupsV314Test-853933519 None] Delete group completed successfully. Jun 02 03:24:28 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-41ce396e-0478-41c3-97d4-fa402568de19 tempest-GroupsV314Test-853933519 None] Acquiring lock "cinder-quobyte-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:24:28 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-41ce396e-0478-41c3-97d4-fa402568de19 tempest-GroupsV314Test-853933519 None] Lock "cinder-quobyte-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c" acquired by "delete_volume" :: waited 0.029s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:24:28 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b4ded0-76eb-47c4-880a-36b2b437cd32]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:24:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-41ce396e-0478-41c3-97d4-fa402568de19 tempest-GroupsV314Test-853933519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:28 devstack sudo[95755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c Jun 02 03:24:28 devstack sudo[95755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-2c27895d-47dd-4b5f-a5a7-d34fc6d8f2b5 req-d645a0cd-af9d-49aa-9aa0-3f00c519d50b tempest-VolumesSnapshotsTestJSON-1995513668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:28 devstack sudo[95746]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8c1b8ca8-12c6-42ac-aad7-04730e6c440c tempest-GroupSnapshotsV319Test-53960984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc 1073741824" returned: 0 in 1.000s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8c1b8ca8-12c6-42ac-aad7-04730e6c440c tempest-GroupSnapshotsV319Test-53960984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:28 devstack sudo[95764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc Jun 02 03:24:28 devstack sudo[95764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:29 devstack sudo[95755]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-41ce396e-0478-41c3-97d4-fa402568de19 tempest-GroupsV314Test-853933519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c" returned: 0 in 0.748s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-41ce396e-0478-41c3-97d4-fa402568de19 tempest-GroupsV314Test-853933519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:29 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c Jun 02 03:24:29 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:29 devstack sudo[95764]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8c1b8ca8-12c6-42ac-aad7-04730e6c440c tempest-GroupSnapshotsV319Test-53960984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc" returned: 0 in 0.620s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:29 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-8c1b8ca8-12c6-42ac-aad7-04730e6c440c tempest-GroupSnapshotsV319Test-53960984 None] <== create_volume: return (1671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:24:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8c1b8ca8-12c6-42ac-aad7-04730e6c440c tempest-GroupSnapshotsV319Test-53960984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0d80a03a-0e03-4214-8a0b-65005e10e0d4 tempest-VolumesListTestJSON-1821370474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.416s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:29 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0d80a03a-0e03-4214-8a0b-65005e10e0d4 tempest-VolumesListTestJSON-1821370474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1178120892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c7e797a-486f-46e8-b346-1e61a0f3307c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1eecae34b93445ea8791e236e1c75222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:24:28Z,use_quota=True,user_id='48d07298b12d4c12b852ad7e8f1f69bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:24:29 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-0d80a03a-0e03-4214-8a0b-65005e10e0d4 tempest-VolumesListTestJSON-1821370474 None] Creating volume 7c7e797a-486f-46e8-b346-1e61a0f3307c {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:24:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0d80a03a-0e03-4214-8a0b-65005e10e0d4 tempest-VolumesListTestJSON-1821370474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0d80a03a-0e03-4214-8a0b-65005e10e0d4 tempest-VolumesListTestJSON-1821370474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:29 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0d80a03a-0e03-4214-8a0b-65005e10e0d4 tempest-VolumesListTestJSON-1821370474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:24:29 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0d80a03a-0e03-4214-8a0b-65005e10e0d4 tempest-VolumesListTestJSON-1821370474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:24:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0d80a03a-0e03-4214-8a0b-65005e10e0d4 tempest-VolumesListTestJSON-1821370474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:29 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0d80a03a-0e03-4214-8a0b-65005e10e0d4 tempest-VolumesListTestJSON-1821370474 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:24:29 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-0d80a03a-0e03-4214-8a0b-65005e10e0d4 tempest-VolumesListTestJSON-1821370474 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:24:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0d80a03a-0e03-4214-8a0b-65005e10e0d4 tempest-VolumesListTestJSON-1821370474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7c7e797a-486f-46e8-b346-1e61a0f3307c 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:29 devstack sudo[95772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7c7e797a-486f-46e8-b346-1e61a0f3307c 1073741824 Jun 02 03:24:29 devstack sudo[95772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:29 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8c1b8ca8-12c6-42ac-aad7-04730e6c440c tempest-GroupSnapshotsV319Test-53960984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c44d0330-2dc6-46d7-ba37-b96636bed32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:29 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8c1b8ca8-12c6-42ac-aad7-04730e6c440c tempest-GroupSnapshotsV319Test-53960984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15bedc77-a96b-439f-8fd1-130e075c4721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:29 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-8c1b8ca8-12c6-42ac-aad7-04730e6c440c tempest-GroupSnapshotsV319Test-53960984 None] Volume volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc (6fff8bd1-c0bf-454b-b833-85ea7176abcc): created successfully Jun 02 03:24:29 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8c1b8ca8-12c6-42ac-aad7-04730e6c440c tempest-GroupSnapshotsV319Test-53960984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15bedc77-a96b-439f-8fd1-130e075c4721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:29 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8c1b8ca8-12c6-42ac-aad7-04730e6c440c tempest-GroupSnapshotsV319Test-53960984 None] Flow 'volume_create_manager' (8d2fe42f-1da9-464d-9298-bc65dc854536) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:24:29 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-8c1b8ca8-12c6-42ac-aad7-04730e6c440c tempest-GroupSnapshotsV319Test-53960984 None] Created volume successfully. Jun 02 03:24:29 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-41ce396e-0478-41c3-97d4-fa402568de19 tempest-GroupsV314Test-853933519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c" returned: 0 in 0.600s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:29 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-41ce396e-0478-41c3-97d4-fa402568de19 tempest-GroupsV314Test-853933519 None] Lock "cinder-quobyte-fa271cda-c9eb-4ffc-bce4-bd3394a59b4c" released by "delete_volume" :: held 1.439s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:24:29 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-41ce396e-0478-41c3-97d4-fa402568de19 tempest-GroupsV314Test-853933519 None] Created reservations ['1d2a50c8-0d2d-4306-a5f4-ec5650421369'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:24:29 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-41ce396e-0478-41c3-97d4-fa402568de19 tempest-GroupsV314Test-853933519 None] Created reservations ['4ebe8a28-91d5-4aeb-a835-a25e4afdf235', 'ee7bc440-36dc-413f-90c7-30c984ea972e', '4fc5d318-7af8-4e3d-8968-1bf05de1559e', '492d5502-78ac-4aeb-89b8-b5d39f003a40'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:24:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-41ce396e-0478-41c3-97d4-fa402568de19 tempest-GroupsV314Test-853933519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-41ce396e-0478-41c3-97d4-fa402568de19 tempest-GroupsV314Test-853933519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:30 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-41ce396e-0478-41c3-97d4-fa402568de19 tempest-GroupsV314Test-853933519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:24:30 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-41ce396e-0478-41c3-97d4-fa402568de19 tempest-GroupsV314Test-853933519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:24:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-41ce396e-0478-41c3-97d4-fa402568de19 tempest-GroupsV314Test-853933519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-41ce396e-0478-41c3-97d4-fa402568de19 tempest-GroupsV314Test-853933519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:30 devstack sudo[95775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:24:30 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:30 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-685ca8a7-af0c-48c0-8978-828aec535419 tempest-GroupSnapshotsV319Test-53960984 None] GroupSnapshot 2193efec-c459-4783-a8a3-c126c5dac1a8: creating. Jun 02 03:24:30 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-685ca8a7-af0c-48c0-8978-828aec535419 tempest-GroupSnapshotsV319Test-53960984 None] Group snapshot 2193efec-c459-4783-a8a3-c126c5dac1a8: creating. {{(pid=86431) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Jun 02 03:24:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-685ca8a7-af0c-48c0-8978-828aec535419 tempest-GroupSnapshotsV319Test-53960984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:30 devstack sudo[95772]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0d80a03a-0e03-4214-8a0b-65005e10e0d4 tempest-VolumesListTestJSON-1821370474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7c7e797a-486f-46e8-b346-1e61a0f3307c 1073741824" returned: 0 in 0.837s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0d80a03a-0e03-4214-8a0b-65005e10e0d4 tempest-VolumesListTestJSON-1821370474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7c7e797a-486f-46e8-b346-1e61a0f3307c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:30 devstack sudo[95781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7c7e797a-486f-46e8-b346-1e61a0f3307c Jun 02 03:24:30 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:30 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-41ce396e-0478-41c3-97d4-fa402568de19 tempest-GroupsV314Test-853933519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.632s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:30 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-41ce396e-0478-41c3-97d4-fa402568de19 tempest-GroupsV314Test-853933519 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:24:30 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-41ce396e-0478-41c3-97d4-fa402568de19 tempest-GroupsV314Test-853933519 None] Delete group completed successfully. Jun 02 03:24:31 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0d80a03a-0e03-4214-8a0b-65005e10e0d4 tempest-VolumesListTestJSON-1821370474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7c7e797a-486f-46e8-b346-1e61a0f3307c" returned: 0 in 0.607s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:31 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0d80a03a-0e03-4214-8a0b-65005e10e0d4 tempest-VolumesListTestJSON-1821370474 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:24:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0d80a03a-0e03-4214-8a0b-65005e10e0d4 tempest-VolumesListTestJSON-1821370474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-2c27895d-47dd-4b5f-a5a7-d34fc6d8f2b5 req-d645a0cd-af9d-49aa-9aa0-3f00c519d50b tempest-VolumesSnapshotsTestJSON-1995513668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.466s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:31 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0d80a03a-0e03-4214-8a0b-65005e10e0d4 tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d37529ec-e634-4cbf-9292-be6bb94da1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c7e797a-486f-46e8-b346-1e61a0f3307c', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:31 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0d80a03a-0e03-4214-8a0b-65005e10e0d4 tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c1b8f46-58d1-46e8-83cb-c440e4d879a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:31 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [req-2c27895d-47dd-4b5f-a5a7-d34fc6d8f2b5 req-d645a0cd-af9d-49aa-9aa0-3f00c519d50b tempest-VolumesSnapshotsTestJSON-1995513668 None] Creating offline snapshot 3e5d8f2e-3128-406a-b61d-1081dba4121b of volume f5394cf1-d9c3-49ca-a995-79f6a5d14bae {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:24:31 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-0d80a03a-0e03-4214-8a0b-65005e10e0d4 tempest-VolumesListTestJSON-1821370474 None] Volume volume-7c7e797a-486f-46e8-b346-1e61a0f3307c (7c7e797a-486f-46e8-b346-1e61a0f3307c): created successfully Jun 02 03:24:31 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0d80a03a-0e03-4214-8a0b-65005e10e0d4 tempest-VolumesListTestJSON-1821370474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c1b8f46-58d1-46e8-83cb-c440e4d879a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:31 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0d80a03a-0e03-4214-8a0b-65005e10e0d4 tempest-VolumesListTestJSON-1821370474 None] Flow 'volume_create_manager' (2b435905-974c-4586-b00c-f3ff97d07924) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:24:31 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[e215b667-b9fc-47b6-a764-ca9e227760f4]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:24:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-2c27895d-47dd-4b5f-a5a7-d34fc6d8f2b5 req-d645a0cd-af9d-49aa-9aa0-3f00c519d50b tempest-VolumesSnapshotsTestJSON-1995513668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:31 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-0d80a03a-0e03-4214-8a0b-65005e10e0d4 tempest-VolumesListTestJSON-1821370474 None] Created volume successfully. Jun 02 03:24:31 devstack sudo[95785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae Jun 02 03:24:31 devstack sudo[95785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:31 devstack sudo[95785]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-2c27895d-47dd-4b5f-a5a7-d34fc6d8f2b5 req-d645a0cd-af9d-49aa-9aa0-3f00c519d50b tempest-VolumesSnapshotsTestJSON-1995513668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae" returned: 0 in 0.731s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-2c27895d-47dd-4b5f-a5a7-d34fc6d8f2b5 req-d645a0cd-af9d-49aa-9aa0-3f00c519d50b tempest-VolumesSnapshotsTestJSON-1995513668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae.3e5d8f2e-3128-406a-b61d-1081dba4121b 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:31 devstack sudo[95790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae.3e5d8f2e-3128-406a-b61d-1081dba4121b 1G Jun 02 03:24:31 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:32 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-2c27895d-47dd-4b5f-a5a7-d34fc6d8f2b5 req-d645a0cd-af9d-49aa-9aa0-3f00c519d50b tempest-VolumesSnapshotsTestJSON-1995513668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae.3e5d8f2e-3128-406a-b61d-1081dba4121b 1G" returned: 0 in 0.843s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-2c27895d-47dd-4b5f-a5a7-d34fc6d8f2b5 req-d645a0cd-af9d-49aa-9aa0-3f00c519d50b tempest-VolumesSnapshotsTestJSON-1995513668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae.3e5d8f2e-3128-406a-b61d-1081dba4121b {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:32 devstack sudo[95797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae.3e5d8f2e-3128-406a-b61d-1081dba4121b Jun 02 03:24:32 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:33 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-2c27895d-47dd-4b5f-a5a7-d34fc6d8f2b5 req-d645a0cd-af9d-49aa-9aa0-3f00c519d50b tempest-VolumesSnapshotsTestJSON-1995513668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae.3e5d8f2e-3128-406a-b61d-1081dba4121b" returned: 0 in 0.731s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:33 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [req-2c27895d-47dd-4b5f-a5a7-d34fc6d8f2b5 req-d645a0cd-af9d-49aa-9aa0-3f00c519d50b tempest-VolumesSnapshotsTestJSON-1995513668 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae.3e5d8f2e-3128-406a-b61d-1081dba4121b is being set with open permissions: ugo+rw Jun 02 03:24:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-2c27895d-47dd-4b5f-a5a7-d34fc6d8f2b5 req-d645a0cd-af9d-49aa-9aa0-3f00c519d50b tempest-VolumesSnapshotsTestJSON-1995513668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae.3e5d8f2e-3128-406a-b61d-1081dba4121b {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:33 devstack sudo[95802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae.3e5d8f2e-3128-406a-b61d-1081dba4121b Jun 02 03:24:33 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:34 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-2c27895d-47dd-4b5f-a5a7-d34fc6d8f2b5 req-d645a0cd-af9d-49aa-9aa0-3f00c519d50b tempest-VolumesSnapshotsTestJSON-1995513668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae.3e5d8f2e-3128-406a-b61d-1081dba4121b" returned: 0 in 0.605s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-2c27895d-47dd-4b5f-a5a7-d34fc6d8f2b5 req-d645a0cd-af9d-49aa-9aa0-3f00c519d50b tempest-VolumesSnapshotsTestJSON-1995513668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:34 devstack sudo[95805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae.info Jun 02 03:24:34 devstack sudo[95805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-214b2175-50d9-4adf-aa46-88f5d1b2dda9 tempest-VolumesListTestJSON-1821370474 None] Acquiring lock "cinder-7c7e797a-486f-46e8-b346-1e61a0f3307c-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:24:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-214b2175-50d9-4adf-aa46-88f5d1b2dda9 tempest-VolumesListTestJSON-1821370474 None] Lock "cinder-7c7e797a-486f-46e8-b346-1e61a0f3307c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:24:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-214b2175-50d9-4adf-aa46-88f5d1b2dda9 tempest-VolumesListTestJSON-1821370474 None] Acquiring lock "cinder-quobyte-7c7e797a-486f-46e8-b346-1e61a0f3307c" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:24:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-214b2175-50d9-4adf-aa46-88f5d1b2dda9 tempest-VolumesListTestJSON-1821370474 None] Lock "cinder-quobyte-7c7e797a-486f-46e8-b346-1e61a0f3307c" acquired by "delete_volume" :: waited 0.025s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:24:34 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[903a6416-3e9e-418a-9e91-468754c1cb35]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:24:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-214b2175-50d9-4adf-aa46-88f5d1b2dda9 tempest-VolumesListTestJSON-1821370474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7c7e797a-486f-46e8-b346-1e61a0f3307c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:34 devstack sudo[95805]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-2c27895d-47dd-4b5f-a5a7-d34fc6d8f2b5 req-d645a0cd-af9d-49aa-9aa0-3f00c519d50b tempest-VolumesSnapshotsTestJSON-1995513668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae.info" returned: 0 in 0.745s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:34 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [req-2c27895d-47dd-4b5f-a5a7-d34fc6d8f2b5 req-d645a0cd-af9d-49aa-9aa0-3f00c519d50b tempest-VolumesSnapshotsTestJSON-1995513668 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae.info is being set with open permissions: ugo+rw Jun 02 03:24:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-2c27895d-47dd-4b5f-a5a7-d34fc6d8f2b5 req-d645a0cd-af9d-49aa-9aa0-3f00c519d50b tempest-VolumesSnapshotsTestJSON-1995513668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:34 devstack sudo[95809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae.info Jun 02 03:24:34 devstack sudo[95809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:34 devstack sudo[95808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7c7e797a-486f-46e8-b346-1e61a0f3307c Jun 02 03:24:34 devstack sudo[95808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:35 devstack sudo[95809]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-2c27895d-47dd-4b5f-a5a7-d34fc6d8f2b5 req-d645a0cd-af9d-49aa-9aa0-3f00c519d50b tempest-VolumesSnapshotsTestJSON-1995513668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae.info" returned: 0 in 0.633s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-2c27895d-47dd-4b5f-a5a7-d34fc6d8f2b5 req-d645a0cd-af9d-49aa-9aa0-3f00c519d50b tempest-VolumesSnapshotsTestJSON-1995513668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.444s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-685ca8a7-af0c-48c0-8978-828aec535419 tempest-GroupSnapshotsV319Test-53960984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.194s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:35 devstack sudo[95808]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-214b2175-50d9-4adf-aa46-88f5d1b2dda9 tempest-VolumesListTestJSON-1821370474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7c7e797a-486f-46e8-b346-1e61a0f3307c" returned: 0 in 0.761s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-214b2175-50d9-4adf-aa46-88f5d1b2dda9 tempest-VolumesListTestJSON-1821370474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7c7e797a-486f-46e8-b346-1e61a0f3307c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:35 devstack sudo[95816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7c7e797a-486f-46e8-b346-1e61a0f3307c Jun 02 03:24:35 devstack sudo[95816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:35 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-685ca8a7-af0c-48c0-8978-828aec535419 tempest-GroupSnapshotsV319Test-53960984 None] Creating offline snapshot 39f06c32-67fc-4a94-8c91-fd4975a5b1fe of volume 6fff8bd1-c0bf-454b-b833-85ea7176abcc {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:24:35 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[a207fc5e-3374-4ff1-9164-a459efbde0b2]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:24:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-685ca8a7-af0c-48c0-8978-828aec535419 tempest-GroupSnapshotsV319Test-53960984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:35 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-2c27895d-47dd-4b5f-a5a7-d34fc6d8f2b5 req-d645a0cd-af9d-49aa-9aa0-3f00c519d50b tempest-VolumesSnapshotsTestJSON-1995513668 None] Create snapshot completed successfully Jun 02 03:24:35 devstack sudo[95818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc Jun 02 03:24:35 devstack sudo[95818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:36 devstack sudo[95816]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-214b2175-50d9-4adf-aa46-88f5d1b2dda9 tempest-VolumesListTestJSON-1821370474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7c7e797a-486f-46e8-b346-1e61a0f3307c" returned: 0 in 0.632s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-214b2175-50d9-4adf-aa46-88f5d1b2dda9 tempest-VolumesListTestJSON-1821370474 None] Lock "cinder-quobyte-7c7e797a-486f-46e8-b346-1e61a0f3307c" released by "delete_volume" :: held 1.464s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:24:36 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-214b2175-50d9-4adf-aa46-88f5d1b2dda9 tempest-VolumesListTestJSON-1821370474 None] Created reservations ['2677e728-319b-45f8-8a6b-af4627d1cfdf', '5d1fa717-e1b2-4648-9fdf-450568892260', 'dd26c795-6399-4dc2-b993-eb6d6db24ff7', '7a19fc7b-87be-4b7d-9f69-e0da164eaaa0'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:24:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-214b2175-50d9-4adf-aa46-88f5d1b2dda9 tempest-VolumesListTestJSON-1821370474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-214b2175-50d9-4adf-aa46-88f5d1b2dda9 tempest-VolumesListTestJSON-1821370474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:36 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-214b2175-50d9-4adf-aa46-88f5d1b2dda9 tempest-VolumesListTestJSON-1821370474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:24:36 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-214b2175-50d9-4adf-aa46-88f5d1b2dda9 tempest-VolumesListTestJSON-1821370474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:24:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-214b2175-50d9-4adf-aa46-88f5d1b2dda9 tempest-VolumesListTestJSON-1821370474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-214b2175-50d9-4adf-aa46-88f5d1b2dda9 tempest-VolumesListTestJSON-1821370474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:36 devstack sudo[95825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:24:36 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:36 devstack sudo[95818]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-685ca8a7-af0c-48c0-8978-828aec535419 tempest-GroupSnapshotsV319Test-53960984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc" returned: 0 in 0.792s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-685ca8a7-af0c-48c0-8978-828aec535419 tempest-GroupSnapshotsV319Test-53960984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc.39f06c32-67fc-4a94-8c91-fd4975a5b1fe 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:36 devstack sudo[95827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc.39f06c32-67fc-4a94-8c91-fd4975a5b1fe 1G Jun 02 03:24:36 devstack sudo[95827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [req-c6cc89f5-10ee-40ad-8dad-46c9ca78ba5a req-59917ab3-f5cb-4348-a27a-4cb87f964326 tempest-VolumesSnapshotsTestJSON-1995513668 None] Acquiring lock "cinder-3e5d8f2e-3128-406a-b61d-1081dba4121b-delete_snapshot" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:24:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [req-c6cc89f5-10ee-40ad-8dad-46c9ca78ba5a req-59917ab3-f5cb-4348-a27a-4cb87f964326 tempest-VolumesSnapshotsTestJSON-1995513668 None] Lock "cinder-3e5d8f2e-3128-406a-b61d-1081dba4121b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:24:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [req-c6cc89f5-10ee-40ad-8dad-46c9ca78ba5a req-59917ab3-f5cb-4348-a27a-4cb87f964326 tempest-VolumesSnapshotsTestJSON-1995513668 None] Acquiring lock "cinder-quobyte-f5394cf1-d9c3-49ca-a995-79f6a5d14bae" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:24:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [req-c6cc89f5-10ee-40ad-8dad-46c9ca78ba5a req-59917ab3-f5cb-4348-a27a-4cb87f964326 tempest-VolumesSnapshotsTestJSON-1995513668 None] Lock "cinder-quobyte-f5394cf1-d9c3-49ca-a995-79f6a5d14bae" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:24:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [req-c6cc89f5-10ee-40ad-8dad-46c9ca78ba5a req-59917ab3-f5cb-4348-a27a-4cb87f964326 tempest-VolumesSnapshotsTestJSON-1995513668 None] Acquiring lock "cinder-quobyte-3e5d8f2e-3128-406a-b61d-1081dba4121b" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:24:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [req-c6cc89f5-10ee-40ad-8dad-46c9ca78ba5a req-59917ab3-f5cb-4348-a27a-4cb87f964326 tempest-VolumesSnapshotsTestJSON-1995513668 None] Lock "cinder-quobyte-3e5d8f2e-3128-406a-b61d-1081dba4121b" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:24:36 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [req-c6cc89f5-10ee-40ad-8dad-46c9ca78ba5a req-59917ab3-f5cb-4348-a27a-4cb87f964326 tempest-VolumesSnapshotsTestJSON-1995513668 None] Deleting offline snapshot 3e5d8f2e-3128-406a-b61d-1081dba4121b of volume f5394cf1-d9c3-49ca-a995-79f6a5d14bae {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:24:36 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [req-c6cc89f5-10ee-40ad-8dad-46c9ca78ba5a req-59917ab3-f5cb-4348-a27a-4cb87f964326 tempest-VolumesSnapshotsTestJSON-1995513668 None] snapshot_file for this snap is: volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae.3e5d8f2e-3128-406a-b61d-1081dba4121b {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:24:36 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[c784d1ea-348b-41a1-93a7-bc76e1f74669]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:24:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-c6cc89f5-10ee-40ad-8dad-46c9ca78ba5a req-59917ab3-f5cb-4348-a27a-4cb87f964326 tempest-VolumesSnapshotsTestJSON-1995513668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae.3e5d8f2e-3128-406a-b61d-1081dba4121b {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:36 devstack sudo[95829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae.3e5d8f2e-3128-406a-b61d-1081dba4121b Jun 02 03:24:36 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:37 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-3d14183b-1964-480f-9ca1-bdc0478aa581 tempest-VolumesListTestJSON-1821370474 None] Acquiring lock "cinder-0a172e6e-7e66-43ed-a462-977bc7d12152-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:24:37 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-214b2175-50d9-4adf-aa46-88f5d1b2dda9 tempest-VolumesListTestJSON-1821370474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.759s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:37 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-214b2175-50d9-4adf-aa46-88f5d1b2dda9 tempest-VolumesListTestJSON-1821370474 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:24:37 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-3d14183b-1964-480f-9ca1-bdc0478aa581 tempest-VolumesListTestJSON-1821370474 None] Lock "cinder-0a172e6e-7e66-43ed-a462-977bc7d12152-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:24:37 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-214b2175-50d9-4adf-aa46-88f5d1b2dda9 tempest-VolumesListTestJSON-1821370474 None] Deleted volume successfully. Jun 02 03:24:37 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-214b2175-50d9-4adf-aa46-88f5d1b2dda9 tempest-VolumesListTestJSON-1821370474 None] Lock "cinder-7c7e797a-486f-46e8-b346-1e61a0f3307c-delete_volume" released by "delete_volume" :: held 2.496s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:24:37 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-3d14183b-1964-480f-9ca1-bdc0478aa581 tempest-VolumesListTestJSON-1821370474 None] Acquiring lock "cinder-quobyte-0a172e6e-7e66-43ed-a462-977bc7d12152" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:24:37 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-3d14183b-1964-480f-9ca1-bdc0478aa581 tempest-VolumesListTestJSON-1821370474 None] Lock "cinder-quobyte-0a172e6e-7e66-43ed-a462-977bc7d12152" acquired by "delete_volume" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:24:37 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fa3fa0-931c-4f2d-b1e1-81a8d231f0bf]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:24:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3d14183b-1964-480f-9ca1-bdc0478aa581 tempest-VolumesListTestJSON-1821370474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-0a172e6e-7e66-43ed-a462-977bc7d12152 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:37 devstack sudo[95827]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:37 devstack sudo[95836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-0a172e6e-7e66-43ed-a462-977bc7d12152 Jun 02 03:24:37 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-685ca8a7-af0c-48c0-8978-828aec535419 tempest-GroupSnapshotsV319Test-53960984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc.39f06c32-67fc-4a94-8c91-fd4975a5b1fe 1G" returned: 0 in 0.972s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-685ca8a7-af0c-48c0-8978-828aec535419 tempest-GroupSnapshotsV319Test-53960984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc.39f06c32-67fc-4a94-8c91-fd4975a5b1fe {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:37 devstack sudo[95838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc.39f06c32-67fc-4a94-8c91-fd4975a5b1fe Jun 02 03:24:37 devstack sudo[95838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:37 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-c6cc89f5-10ee-40ad-8dad-46c9ca78ba5a req-59917ab3-f5cb-4348-a27a-4cb87f964326 tempest-VolumesSnapshotsTestJSON-1995513668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae.3e5d8f2e-3128-406a-b61d-1081dba4121b" returned: 0 in 0.959s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:37 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [req-c6cc89f5-10ee-40ad-8dad-46c9ca78ba5a req-59917ab3-f5cb-4348-a27a-4cb87f964326 tempest-VolumesSnapshotsTestJSON-1995513668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:24:37 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17028d5-3999-4ac0-93cb-776487625519]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:24:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-c6cc89f5-10ee-40ad-8dad-46c9ca78ba5a req-59917ab3-f5cb-4348-a27a-4cb87f964326 tempest-VolumesSnapshotsTestJSON-1995513668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:37 devstack sudo[95844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae Jun 02 03:24:37 devstack sudo[95844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:38 devstack sudo[95838]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-685ca8a7-af0c-48c0-8978-828aec535419 tempest-GroupSnapshotsV319Test-53960984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc.39f06c32-67fc-4a94-8c91-fd4975a5b1fe" returned: 0 in 0.753s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:38 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-685ca8a7-af0c-48c0-8978-828aec535419 tempest-GroupSnapshotsV319Test-53960984 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc.39f06c32-67fc-4a94-8c91-fd4975a5b1fe is being set with open permissions: ugo+rw: NotImplementedError Jun 02 03:24:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-685ca8a7-af0c-48c0-8978-828aec535419 tempest-GroupSnapshotsV319Test-53960984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc.39f06c32-67fc-4a94-8c91-fd4975a5b1fe {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:38 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3d14183b-1964-480f-9ca1-bdc0478aa581 tempest-VolumesListTestJSON-1821370474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-0a172e6e-7e66-43ed-a462-977bc7d12152" returned: 0 in 0.902s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3d14183b-1964-480f-9ca1-bdc0478aa581 tempest-VolumesListTestJSON-1821370474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-0a172e6e-7e66-43ed-a462-977bc7d12152 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:38 devstack sudo[95854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc.39f06c32-67fc-4a94-8c91-fd4975a5b1fe Jun 02 03:24:38 devstack sudo[95854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:38 devstack sudo[95855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-0a172e6e-7e66-43ed-a462-977bc7d12152 Jun 02 03:24:38 devstack sudo[95855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:38 devstack sudo[95844]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-c6cc89f5-10ee-40ad-8dad-46c9ca78ba5a req-59917ab3-f5cb-4348-a27a-4cb87f964326 tempest-VolumesSnapshotsTestJSON-1995513668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae" returned: 0 in 0.893s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-c6cc89f5-10ee-40ad-8dad-46c9ca78ba5a req-59917ab3-f5cb-4348-a27a-4cb87f964326 tempest-VolumesSnapshotsTestJSON-1995513668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae.3e5d8f2e-3128-406a-b61d-1081dba4121b {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:38 devstack sudo[95862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae.3e5d8f2e-3128-406a-b61d-1081dba4121b Jun 02 03:24:38 devstack sudo[95862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:38 devstack sudo[95854]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-685ca8a7-af0c-48c0-8978-828aec535419 tempest-GroupSnapshotsV319Test-53960984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc.39f06c32-67fc-4a94-8c91-fd4975a5b1fe" returned: 0 in 0.691s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-685ca8a7-af0c-48c0-8978-828aec535419 tempest-GroupSnapshotsV319Test-53960984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:38 devstack sudo[95865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc.info Jun 02 03:24:38 devstack sudo[95865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:38 devstack sudo[95855]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3d14183b-1964-480f-9ca1-bdc0478aa581 tempest-VolumesListTestJSON-1821370474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-0a172e6e-7e66-43ed-a462-977bc7d12152" returned: 0 in 0.749s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:38 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-3d14183b-1964-480f-9ca1-bdc0478aa581 tempest-VolumesListTestJSON-1821370474 None] Lock "cinder-quobyte-0a172e6e-7e66-43ed-a462-977bc7d12152" released by "delete_volume" :: held 1.713s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:24:38 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-3d14183b-1964-480f-9ca1-bdc0478aa581 tempest-VolumesListTestJSON-1821370474 None] Created reservations ['e0bc3afe-9233-4883-9abb-e1ce3473376e', '78d5f5c6-502d-4d6a-a418-185c05468ba3', '71a9eee5-0baf-4a22-8c97-7dcca48e3e88', '5fdd7831-5619-43c5-919f-72cd19725e7a'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:24:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3d14183b-1964-480f-9ca1-bdc0478aa581 tempest-VolumesListTestJSON-1821370474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3d14183b-1964-480f-9ca1-bdc0478aa581 tempest-VolumesListTestJSON-1821370474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:39 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3d14183b-1964-480f-9ca1-bdc0478aa581 tempest-VolumesListTestJSON-1821370474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:24:39 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3d14183b-1964-480f-9ca1-bdc0478aa581 tempest-VolumesListTestJSON-1821370474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:24:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3d14183b-1964-480f-9ca1-bdc0478aa581 tempest-VolumesListTestJSON-1821370474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3d14183b-1964-480f-9ca1-bdc0478aa581 tempest-VolumesListTestJSON-1821370474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:39 devstack sudo[95867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:24:39 devstack sudo[95867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:39 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2d6e8be7-0b59-47c9-9170-c363cbacc74a tempest-VolumesListTestJSON-1821370474 None] Acquiring lock "cinder-94eca601-21cb-4359-89be-4d7dcefa80ab-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:24:39 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2d6e8be7-0b59-47c9-9170-c363cbacc74a tempest-VolumesListTestJSON-1821370474 None] Lock "cinder-94eca601-21cb-4359-89be-4d7dcefa80ab-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:24:39 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2d6e8be7-0b59-47c9-9170-c363cbacc74a tempest-VolumesListTestJSON-1821370474 None] Acquiring lock "cinder-quobyte-94eca601-21cb-4359-89be-4d7dcefa80ab" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:24:39 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2d6e8be7-0b59-47c9-9170-c363cbacc74a tempest-VolumesListTestJSON-1821370474 None] Lock "cinder-quobyte-94eca601-21cb-4359-89be-4d7dcefa80ab" acquired by "delete_volume" :: waited 0.023s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:24:39 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1e2a5c-4edb-4ff3-87af-2aa2b7379068]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:24:39 devstack sudo[95865]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2d6e8be7-0b59-47c9-9170-c363cbacc74a tempest-VolumesListTestJSON-1821370474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-94eca601-21cb-4359-89be-4d7dcefa80ab {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-685ca8a7-af0c-48c0-8978-828aec535419 tempest-GroupSnapshotsV319Test-53960984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc.info" returned: 0 in 0.760s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:39 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-685ca8a7-af0c-48c0-8978-828aec535419 tempest-GroupSnapshotsV319Test-53960984 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc.info is being set with open permissions: ugo+rw: NotImplementedError Jun 02 03:24:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-685ca8a7-af0c-48c0-8978-828aec535419 tempest-GroupSnapshotsV319Test-53960984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:39 devstack sudo[95874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc.info Jun 02 03:24:39 devstack sudo[95874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:39 devstack sudo[95862]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-c6cc89f5-10ee-40ad-8dad-46c9ca78ba5a req-59917ab3-f5cb-4348-a27a-4cb87f964326 tempest-VolumesSnapshotsTestJSON-1995513668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae.3e5d8f2e-3128-406a-b61d-1081dba4121b" returned: 0 in 0.968s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-c6cc89f5-10ee-40ad-8dad-46c9ca78ba5a req-59917ab3-f5cb-4348-a27a-4cb87f964326 tempest-VolumesSnapshotsTestJSON-1995513668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae.3e5d8f2e-3128-406a-b61d-1081dba4121b {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:39 devstack sudo[95876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae.3e5d8f2e-3128-406a-b61d-1081dba4121b Jun 02 03:24:39 devstack sudo[95876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:39 devstack sudo[95873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-94eca601-21cb-4359-89be-4d7dcefa80ab Jun 02 03:24:39 devstack sudo[95873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:40 devstack sudo[95867]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3d14183b-1964-480f-9ca1-bdc0478aa581 tempest-VolumesListTestJSON-1821370474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 1.116s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:40 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-3d14183b-1964-480f-9ca1-bdc0478aa581 tempest-VolumesListTestJSON-1821370474 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:24:40 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-3d14183b-1964-480f-9ca1-bdc0478aa581 tempest-VolumesListTestJSON-1821370474 None] Deleted volume successfully. Jun 02 03:24:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-3d14183b-1964-480f-9ca1-bdc0478aa581 tempest-VolumesListTestJSON-1821370474 None] Lock "cinder-0a172e6e-7e66-43ed-a462-977bc7d12152-delete_volume" released by "delete_volume" :: held 3.113s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:24:40 devstack sudo[95874]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-685ca8a7-af0c-48c0-8978-828aec535419 tempest-GroupSnapshotsV319Test-53960984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc.info" returned: 0 in 0.731s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-685ca8a7-af0c-48c0-8978-828aec535419 tempest-GroupSnapshotsV319Test-53960984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.829s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:40 devstack sudo[95876]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-c6cc89f5-10ee-40ad-8dad-46c9ca78ba5a req-59917ab3-f5cb-4348-a27a-4cb87f964326 tempest-VolumesSnapshotsTestJSON-1995513668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae.3e5d8f2e-3128-406a-b61d-1081dba4121b" returned: 0 in 0.721s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [req-c6cc89f5-10ee-40ad-8dad-46c9ca78ba5a req-59917ab3-f5cb-4348-a27a-4cb87f964326 tempest-VolumesSnapshotsTestJSON-1995513668 None] Lock "cinder-quobyte-3e5d8f2e-3128-406a-b61d-1081dba4121b" released by "_delete_snapshot" :: held 3.700s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:24:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [req-c6cc89f5-10ee-40ad-8dad-46c9ca78ba5a req-59917ab3-f5cb-4348-a27a-4cb87f964326 tempest-VolumesSnapshotsTestJSON-1995513668 None] Lock "cinder-quobyte-f5394cf1-d9c3-49ca-a995-79f6a5d14bae" released by "delete_snapshot" :: held 3.736s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:24:40 devstack sudo[95873]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2d6e8be7-0b59-47c9-9170-c363cbacc74a tempest-VolumesListTestJSON-1821370474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-94eca601-21cb-4359-89be-4d7dcefa80ab" returned: 0 in 0.891s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2d6e8be7-0b59-47c9-9170-c363cbacc74a tempest-VolumesListTestJSON-1821370474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-94eca601-21cb-4359-89be-4d7dcefa80ab {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:40 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-685ca8a7-af0c-48c0-8978-828aec535419 tempest-GroupSnapshotsV319Test-53960984 None] group_snapshot 2193efec-c459-4783-a8a3-c126c5dac1a8: created successfully Jun 02 03:24:40 devstack sudo[95885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-94eca601-21cb-4359-89be-4d7dcefa80ab Jun 02 03:24:40 devstack sudo[95885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:40 devstack cinder-volume[86431]: WARNING cinder.quota [req-c6cc89f5-10ee-40ad-8dad-46c9ca78ba5a req-59917ab3-f5cb-4348-a27a-4cb87f964326 tempest-VolumesSnapshotsTestJSON-1995513668 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 02 03:24:40 devstack cinder-volume[86431]: DEBUG cinder.quota [req-c6cc89f5-10ee-40ad-8dad-46c9ca78ba5a req-59917ab3-f5cb-4348-a27a-4cb87f964326 tempest-VolumesSnapshotsTestJSON-1995513668 None] Created reservations ['1f233e9a-3be4-4c2f-b0d3-9ad38a663ad1', '500dc401-41fd-4fdb-83a9-6aec5fc85b1a', 'ea404996-17ef-47a5-992c-fb06ead7e2f1', '5a7cbbda-1a2d-434f-aa0a-9d5471056048'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:24:40 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-c6cc89f5-10ee-40ad-8dad-46c9ca78ba5a req-59917ab3-f5cb-4348-a27a-4cb87f964326 tempest-VolumesSnapshotsTestJSON-1995513668 None] Delete snapshot completed successfully. Jun 02 03:24:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [req-c6cc89f5-10ee-40ad-8dad-46c9ca78ba5a req-59917ab3-f5cb-4348-a27a-4cb87f964326 tempest-VolumesSnapshotsTestJSON-1995513668 None] Lock "cinder-3e5d8f2e-3128-406a-b61d-1081dba4121b-delete_snapshot" released by "delete_snapshot" :: held 3.939s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:24:41 devstack cinder-volume[86431]: DEBUG cinder.coordination [req-3705137b-57c2-44bf-a394-260a5267bb83 req-78e174b1-3994-411b-a3f1-07ff42080831 tempest-VolumesSnapshotsTestJSON-1995513668 None] Acquiring lock "cinder-f5394cf1-d9c3-49ca-a995-79f6a5d14bae-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:24:41 devstack cinder-volume[86431]: DEBUG cinder.coordination [req-3705137b-57c2-44bf-a394-260a5267bb83 req-78e174b1-3994-411b-a3f1-07ff42080831 tempest-VolumesSnapshotsTestJSON-1995513668 None] Lock "cinder-f5394cf1-d9c3-49ca-a995-79f6a5d14bae-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:24:41 devstack sudo[95885]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2d6e8be7-0b59-47c9-9170-c363cbacc74a tempest-VolumesListTestJSON-1821370474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-94eca601-21cb-4359-89be-4d7dcefa80ab" returned: 0 in 0.747s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:41 devstack cinder-volume[86431]: DEBUG cinder.coordination [req-3705137b-57c2-44bf-a394-260a5267bb83 req-78e174b1-3994-411b-a3f1-07ff42080831 tempest-VolumesSnapshotsTestJSON-1995513668 None] Acquiring lock "cinder-quobyte-f5394cf1-d9c3-49ca-a995-79f6a5d14bae" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:24:41 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-9e8f58e8-92ea-48d3-be5d-a3ba35cba3d2 tempest-GroupSnapshotsV319Test-53960984 None] group_snapshot 2193efec-c459-4783-a8a3-c126c5dac1a8: deleting Jun 02 03:24:41 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2d6e8be7-0b59-47c9-9170-c363cbacc74a tempest-VolumesListTestJSON-1821370474 None] Lock "cinder-quobyte-94eca601-21cb-4359-89be-4d7dcefa80ab" released by "delete_volume" :: held 1.730s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:24:41 devstack cinder-volume[86431]: DEBUG cinder.coordination [req-3705137b-57c2-44bf-a394-260a5267bb83 req-78e174b1-3994-411b-a3f1-07ff42080831 tempest-VolumesSnapshotsTestJSON-1995513668 None] Lock "cinder-quobyte-f5394cf1-d9c3-49ca-a995-79f6a5d14bae" acquired by "delete_volume" :: waited 0.046s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:24:41 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9e8f58e8-92ea-48d3-be5d-a3ba35cba3d2 tempest-GroupSnapshotsV319Test-53960984 None] group_snapshot 2193efec-c459-4783-a8a3-c126c5dac1a8: deleting {{(pid=86431) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Jun 02 03:24:41 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad042a12-08f1-4e69-9446-5267be42ae88]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:24:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-3705137b-57c2-44bf-a394-260a5267bb83 req-78e174b1-3994-411b-a3f1-07ff42080831 tempest-VolumesSnapshotsTestJSON-1995513668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:41 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-9e8f58e8-92ea-48d3-be5d-a3ba35cba3d2 tempest-GroupSnapshotsV319Test-53960984 None] Acquiring lock "cinder-quobyte-6fff8bd1-c0bf-454b-b833-85ea7176abcc" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:24:41 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-9e8f58e8-92ea-48d3-be5d-a3ba35cba3d2 tempest-GroupSnapshotsV319Test-53960984 None] Lock "cinder-quobyte-6fff8bd1-c0bf-454b-b833-85ea7176abcc" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:24:41 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-9e8f58e8-92ea-48d3-be5d-a3ba35cba3d2 tempest-GroupSnapshotsV319Test-53960984 None] Acquiring lock "cinder-quobyte-39f06c32-67fc-4a94-8c91-fd4975a5b1fe" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:24:41 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-2d6e8be7-0b59-47c9-9170-c363cbacc74a tempest-VolumesListTestJSON-1821370474 None] Created reservations ['a276e61a-b0cf-40e9-a3ef-8a0f98726af1', '757827ac-7972-4447-ba38-2e193ada8226', 'ebf1540f-8c09-4781-a9c4-db9320e3e96d', '550c3ed0-16fa-4c43-a001-7abb719ccbb1'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:24:41 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-9e8f58e8-92ea-48d3-be5d-a3ba35cba3d2 tempest-GroupSnapshotsV319Test-53960984 None] Lock "cinder-quobyte-39f06c32-67fc-4a94-8c91-fd4975a5b1fe" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:24:41 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-9e8f58e8-92ea-48d3-be5d-a3ba35cba3d2 tempest-GroupSnapshotsV319Test-53960984 None] Deleting offline snapshot 39f06c32-67fc-4a94-8c91-fd4975a5b1fe of volume 6fff8bd1-c0bf-454b-b833-85ea7176abcc {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:24:41 devstack sudo[95888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae Jun 02 03:24:41 devstack sudo[95888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:41 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-9e8f58e8-92ea-48d3-be5d-a3ba35cba3d2 tempest-GroupSnapshotsV319Test-53960984 None] snapshot_file for this snap is: volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc.39f06c32-67fc-4a94-8c91-fd4975a5b1fe {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:24:41 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbc9c15-06a7-4a44-9701-936aa6c2b3dd]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:24:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9e8f58e8-92ea-48d3-be5d-a3ba35cba3d2 tempest-GroupSnapshotsV319Test-53960984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc.39f06c32-67fc-4a94-8c91-fd4975a5b1fe {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2d6e8be7-0b59-47c9-9170-c363cbacc74a tempest-VolumesListTestJSON-1821370474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2d6e8be7-0b59-47c9-9170-c363cbacc74a tempest-VolumesListTestJSON-1821370474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:41 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-2d6e8be7-0b59-47c9-9170-c363cbacc74a tempest-VolumesListTestJSON-1821370474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:24:41 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-2d6e8be7-0b59-47c9-9170-c363cbacc74a tempest-VolumesListTestJSON-1821370474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:24:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2d6e8be7-0b59-47c9-9170-c363cbacc74a tempest-VolumesListTestJSON-1821370474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2d6e8be7-0b59-47c9-9170-c363cbacc74a tempest-VolumesListTestJSON-1821370474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:41 devstack sudo[95891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:24:41 devstack sudo[95891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:41 devstack sudo[95890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc.39f06c32-67fc-4a94-8c91-fd4975a5b1fe Jun 02 03:24:41 devstack sudo[95890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:42 devstack sudo[95888]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-3705137b-57c2-44bf-a394-260a5267bb83 req-78e174b1-3994-411b-a3f1-07ff42080831 tempest-VolumesSnapshotsTestJSON-1995513668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae" returned: 0 in 0.848s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-3705137b-57c2-44bf-a394-260a5267bb83 req-78e174b1-3994-411b-a3f1-07ff42080831 tempest-VolumesSnapshotsTestJSON-1995513668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:42 devstack sudo[95898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae Jun 02 03:24:42 devstack sudo[95898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:42 devstack sudo[95891]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2d6e8be7-0b59-47c9-9170-c363cbacc74a tempest-VolumesListTestJSON-1821370474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.726s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:42 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-2d6e8be7-0b59-47c9-9170-c363cbacc74a tempest-VolumesListTestJSON-1821370474 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:24:42 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-2d6e8be7-0b59-47c9-9170-c363cbacc74a tempest-VolumesListTestJSON-1821370474 None] Deleted volume successfully. Jun 02 03:24:42 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2d6e8be7-0b59-47c9-9170-c363cbacc74a tempest-VolumesListTestJSON-1821370474 None] Lock "cinder-94eca601-21cb-4359-89be-4d7dcefa80ab-delete_volume" released by "delete_volume" :: held 2.906s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:24:42 devstack sudo[95890]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9e8f58e8-92ea-48d3-be5d-a3ba35cba3d2 tempest-GroupSnapshotsV319Test-53960984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc.39f06c32-67fc-4a94-8c91-fd4975a5b1fe" returned: 0 in 1.108s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:42 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-9e8f58e8-92ea-48d3-be5d-a3ba35cba3d2 tempest-GroupSnapshotsV319Test-53960984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:24:42 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c0ee73-1462-4269-bdb1-87d415ad1c6a]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:24:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9e8f58e8-92ea-48d3-be5d-a3ba35cba3d2 tempest-GroupSnapshotsV319Test-53960984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:42 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-c02d3b8b-4ca8-467f-a0f2-90c475e0b54d tempest-VolumesListAdminTestJSON-223638558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:24:42 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-c02d3b8b-4ca8-467f-a0f2-90c475e0b54d tempest-VolumesListAdminTestJSON-223638558 None] Flow 'volume_create_manager' (463ebe79-2990-430f-97b4-2493b69d918c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:24:42 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-c02d3b8b-4ca8-467f-a0f2-90c475e0b54d tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89011783-1e17-48e6-a839-5355fd50520f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:42 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-c02d3b8b-4ca8-467f-a0f2-90c475e0b54d tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89011783-1e17-48e6-a839-5355fd50520f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1258497727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=952034cf-649b-4360-aed5-3685751545da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6334f263fca4ae1897ae7f68e8d357d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:24:43Z,use_quota=True,user_id='f30f5ed6e0504c5dab5e81455e773b92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:42 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-c02d3b8b-4ca8-467f-a0f2-90c475e0b54d tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf78711-ac54-4141-930e-ca06e4164944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:42 devstack sudo[95905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc Jun 02 03:24:42 devstack sudo[95905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:42 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-c02d3b8b-4ca8-467f-a0f2-90c475e0b54d tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf78711-ac54-4141-930e-ca06e4164944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:42 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-c02d3b8b-4ca8-467f-a0f2-90c475e0b54d tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6cfe65a-5fb3-4c4b-b3ea-8a133cf758b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:42 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-c02d3b8b-4ca8-467f-a0f2-90c475e0b54d tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6cfe65a-5fb3-4c4b-b3ea-8a133cf758b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '952034cf-649b-4360-aed5-3685751545da', 'volume_name': 'volume-952034cf-649b-4360-aed5-3685751545da', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:42 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-c02d3b8b-4ca8-467f-a0f2-90c475e0b54d tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b977c6-6508-4112-ad31-d5b57934afb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:42 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-c02d3b8b-4ca8-467f-a0f2-90c475e0b54d tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b977c6-6508-4112-ad31-d5b57934afb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:42 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-c02d3b8b-4ca8-467f-a0f2-90c475e0b54d tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c87fc53-b226-4300-bb9f-5fc37ec7b121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:42 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-c02d3b8b-4ca8-467f-a0f2-90c475e0b54d tempest-VolumesListAdminTestJSON-223638558 None] Volume 952034cf-649b-4360-aed5-3685751545da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-952034cf-649b-4360-aed5-3685751545da', 'volume_size': 1} Jun 02 03:24:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c02d3b8b-4ca8-467f-a0f2-90c475e0b54d tempest-VolumesListAdminTestJSON-223638558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c02d3b8b-4ca8-467f-a0f2-90c475e0b54d tempest-VolumesListAdminTestJSON-223638558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:42 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-c02d3b8b-4ca8-467f-a0f2-90c475e0b54d tempest-VolumesListAdminTestJSON-223638558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1258497727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=952034cf-649b-4360-aed5-3685751545da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6334f263fca4ae1897ae7f68e8d357d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:24:43Z,use_quota=True,user_id='f30f5ed6e0504c5dab5e81455e773b92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:24:42 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-c02d3b8b-4ca8-467f-a0f2-90c475e0b54d tempest-VolumesListAdminTestJSON-223638558 None] Creating volume 952034cf-649b-4360-aed5-3685751545da {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:24:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c02d3b8b-4ca8-467f-a0f2-90c475e0b54d tempest-VolumesListAdminTestJSON-223638558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c02d3b8b-4ca8-467f-a0f2-90c475e0b54d tempest-VolumesListAdminTestJSON-223638558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:42 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-c02d3b8b-4ca8-467f-a0f2-90c475e0b54d tempest-VolumesListAdminTestJSON-223638558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:24:42 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-c02d3b8b-4ca8-467f-a0f2-90c475e0b54d tempest-VolumesListAdminTestJSON-223638558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:24:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c02d3b8b-4ca8-467f-a0f2-90c475e0b54d tempest-VolumesListAdminTestJSON-223638558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:42 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-c02d3b8b-4ca8-467f-a0f2-90c475e0b54d tempest-VolumesListAdminTestJSON-223638558 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:24:42 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-c02d3b8b-4ca8-467f-a0f2-90c475e0b54d tempest-VolumesListAdminTestJSON-223638558 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:24:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c02d3b8b-4ca8-467f-a0f2-90c475e0b54d tempest-VolumesListAdminTestJSON-223638558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-952034cf-649b-4360-aed5-3685751545da 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:42 devstack sudo[95908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-952034cf-649b-4360-aed5-3685751545da 1073741824 Jun 02 03:24:42 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:42 devstack sudo[95898]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-3705137b-57c2-44bf-a394-260a5267bb83 req-78e174b1-3994-411b-a3f1-07ff42080831 tempest-VolumesSnapshotsTestJSON-1995513668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f5394cf1-d9c3-49ca-a995-79f6a5d14bae" returned: 0 in 0.795s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:43 devstack cinder-volume[86431]: DEBUG cinder.coordination [req-3705137b-57c2-44bf-a394-260a5267bb83 req-78e174b1-3994-411b-a3f1-07ff42080831 tempest-VolumesSnapshotsTestJSON-1995513668 None] Lock "cinder-quobyte-f5394cf1-d9c3-49ca-a995-79f6a5d14bae" released by "delete_volume" :: held 1.736s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:24:43 devstack cinder-volume[86431]: DEBUG cinder.quota [req-3705137b-57c2-44bf-a394-260a5267bb83 req-78e174b1-3994-411b-a3f1-07ff42080831 tempest-VolumesSnapshotsTestJSON-1995513668 None] Created reservations ['f784d3fe-ab04-4788-98ed-8e8c3ff2155d', '8e4e3aad-73e8-46f9-a4fb-7afa2f4822c1', 'c0a5dbbd-cb2e-4f7e-bb78-9467f1c039ae', '38c5bbf8-9f0d-4614-89c9-0d92ee999813'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:24:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-3705137b-57c2-44bf-a394-260a5267bb83 req-78e174b1-3994-411b-a3f1-07ff42080831 tempest-VolumesSnapshotsTestJSON-1995513668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-3705137b-57c2-44bf-a394-260a5267bb83 req-78e174b1-3994-411b-a3f1-07ff42080831 tempest-VolumesSnapshotsTestJSON-1995513668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:43 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [req-3705137b-57c2-44bf-a394-260a5267bb83 req-78e174b1-3994-411b-a3f1-07ff42080831 tempest-VolumesSnapshotsTestJSON-1995513668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:24:43 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [req-3705137b-57c2-44bf-a394-260a5267bb83 req-78e174b1-3994-411b-a3f1-07ff42080831 tempest-VolumesSnapshotsTestJSON-1995513668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:24:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-3705137b-57c2-44bf-a394-260a5267bb83 req-78e174b1-3994-411b-a3f1-07ff42080831 tempest-VolumesSnapshotsTestJSON-1995513668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-3705137b-57c2-44bf-a394-260a5267bb83 req-78e174b1-3994-411b-a3f1-07ff42080831 tempest-VolumesSnapshotsTestJSON-1995513668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:43 devstack sudo[95910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:24:43 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:43 devstack sudo[95905]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9e8f58e8-92ea-48d3-be5d-a3ba35cba3d2 tempest-GroupSnapshotsV319Test-53960984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc" returned: 0 in 0.940s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9e8f58e8-92ea-48d3-be5d-a3ba35cba3d2 tempest-GroupSnapshotsV319Test-53960984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc.39f06c32-67fc-4a94-8c91-fd4975a5b1fe {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:43 devstack sudo[95918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc.39f06c32-67fc-4a94-8c91-fd4975a5b1fe Jun 02 03:24:43 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:43 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-3705137b-57c2-44bf-a394-260a5267bb83 req-78e174b1-3994-411b-a3f1-07ff42080831 tempest-VolumesSnapshotsTestJSON-1995513668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.753s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:43 devstack cinder-volume[86431]: DEBUG cinder.manager [req-3705137b-57c2-44bf-a394-260a5267bb83 req-78e174b1-3994-411b-a3f1-07ff42080831 tempest-VolumesSnapshotsTestJSON-1995513668 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:24:43 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-3705137b-57c2-44bf-a394-260a5267bb83 req-78e174b1-3994-411b-a3f1-07ff42080831 tempest-VolumesSnapshotsTestJSON-1995513668 None] Deleted volume successfully. Jun 02 03:24:43 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:43 devstack cinder-volume[86431]: DEBUG cinder.coordination [req-3705137b-57c2-44bf-a394-260a5267bb83 req-78e174b1-3994-411b-a3f1-07ff42080831 tempest-VolumesSnapshotsTestJSON-1995513668 None] Lock "cinder-f5394cf1-d9c3-49ca-a995-79f6a5d14bae-delete_volume" released by "delete_volume" :: held 2.798s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:24:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c02d3b8b-4ca8-467f-a0f2-90c475e0b54d tempest-VolumesListAdminTestJSON-223638558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-952034cf-649b-4360-aed5-3685751545da 1073741824" returned: 0 in 1.079s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c02d3b8b-4ca8-467f-a0f2-90c475e0b54d tempest-VolumesListAdminTestJSON-223638558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-952034cf-649b-4360-aed5-3685751545da {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:44 devstack sudo[95921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-952034cf-649b-4360-aed5-3685751545da Jun 02 03:24:44 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:44 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9e8f58e8-92ea-48d3-be5d-a3ba35cba3d2 tempest-GroupSnapshotsV319Test-53960984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc.39f06c32-67fc-4a94-8c91-fd4975a5b1fe" returned: 0 in 0.893s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9e8f58e8-92ea-48d3-be5d-a3ba35cba3d2 tempest-GroupSnapshotsV319Test-53960984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc.39f06c32-67fc-4a94-8c91-fd4975a5b1fe {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:44 devstack sudo[95927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc.39f06c32-67fc-4a94-8c91-fd4975a5b1fe Jun 02 03:24:44 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:44 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c02d3b8b-4ca8-467f-a0f2-90c475e0b54d tempest-VolumesListAdminTestJSON-223638558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-952034cf-649b-4360-aed5-3685751545da" returned: 0 in 0.670s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:44 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-c02d3b8b-4ca8-467f-a0f2-90c475e0b54d tempest-VolumesListAdminTestJSON-223638558 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:24:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c02d3b8b-4ca8-467f-a0f2-90c475e0b54d tempest-VolumesListAdminTestJSON-223638558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-c02d3b8b-4ca8-467f-a0f2-90c475e0b54d tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c87fc53-b226-4300-bb9f-5fc37ec7b121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-952034cf-649b-4360-aed5-3685751545da', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-c02d3b8b-4ca8-467f-a0f2-90c475e0b54d tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b25ca8b-45b2-46ff-bed8-e465d1d5a058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:44 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-c02d3b8b-4ca8-467f-a0f2-90c475e0b54d tempest-VolumesListAdminTestJSON-223638558 None] Volume volume-952034cf-649b-4360-aed5-3685751545da (952034cf-649b-4360-aed5-3685751545da): created successfully Jun 02 03:24:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-c02d3b8b-4ca8-467f-a0f2-90c475e0b54d tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b25ca8b-45b2-46ff-bed8-e465d1d5a058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-c02d3b8b-4ca8-467f-a0f2-90c475e0b54d tempest-VolumesListAdminTestJSON-223638558 None] Flow 'volume_create_manager' (463ebe79-2990-430f-97b4-2493b69d918c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:24:44 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-c02d3b8b-4ca8-467f-a0f2-90c475e0b54d tempest-VolumesListAdminTestJSON-223638558 None] Created volume successfully. Jun 02 03:24:45 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9e8f58e8-92ea-48d3-be5d-a3ba35cba3d2 tempest-GroupSnapshotsV319Test-53960984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc.39f06c32-67fc-4a94-8c91-fd4975a5b1fe" returned: 0 in 0.755s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-9e8f58e8-92ea-48d3-be5d-a3ba35cba3d2 tempest-GroupSnapshotsV319Test-53960984 None] Lock "cinder-quobyte-39f06c32-67fc-4a94-8c91-fd4975a5b1fe" released by "_delete_snapshot" :: held 3.883s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-9e8f58e8-92ea-48d3-be5d-a3ba35cba3d2 tempest-GroupSnapshotsV319Test-53960984 None] Lock "cinder-quobyte-6fff8bd1-c0bf-454b-b833-85ea7176abcc" released by "delete_snapshot" :: held 3.929s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:24:45 devstack cinder-volume[86431]: WARNING cinder.quota [None req-9e8f58e8-92ea-48d3-be5d-a3ba35cba3d2 tempest-GroupSnapshotsV319Test-53960984 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1861481254 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1861481254, it is now deprecated. Please use the default quota class for default quota. Jun 02 03:24:45 devstack cinder-volume[86431]: WARNING cinder.quota [None req-9e8f58e8-92ea-48d3-be5d-a3ba35cba3d2 tempest-GroupSnapshotsV319Test-53960984 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1861481254 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1861481254, it is now deprecated. Please use the default quota class for default quota. Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b506097-465c-49b9-a821-afc975216a61 tempest-VolumesListAdminTestJSON-223638558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9b506097-465c-49b9-a821-afc975216a61 tempest-VolumesListAdminTestJSON-223638558 None] Flow 'volume_create_manager' (967d3965-5523-417e-a3a5-b2338e92d7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9b506097-465c-49b9-a821-afc975216a61 tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7a1ee4e-1067-43c4-acce-b2bfd7d16bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-9e8f58e8-92ea-48d3-be5d-a3ba35cba3d2 tempest-GroupSnapshotsV319Test-53960984 None] Created reservations ['e56580f5-fae7-414a-8089-c9f59cf23f1e', '58462262-4461-4589-b69d-5a35b676b461', '46a32b6a-d7bd-4287-b99e-428296d6527b', '6bf622c1-ee4a-4c59-9812-21b1c1e3b24c'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9b506097-465c-49b9-a821-afc975216a61 tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7a1ee4e-1067-43c4-acce-b2bfd7d16bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1590577757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0e7c050-9158-4c51-890f-7f02045d11b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6334f263fca4ae1897ae7f68e8d357d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:24:45Z,use_quota=True,user_id='f30f5ed6e0504c5dab5e81455e773b92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9b506097-465c-49b9-a821-afc975216a61 tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (611215a2-6001-4dc9-8e6e-b30648fdf035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9b506097-465c-49b9-a821-afc975216a61 tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (611215a2-6001-4dc9-8e6e-b30648fdf035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9b506097-465c-49b9-a821-afc975216a61 tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7dd518-ae74-4d09-8649-be50e9e5a77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9b506097-465c-49b9-a821-afc975216a61 tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7dd518-ae74-4d09-8649-be50e9e5a77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0e7c050-9158-4c51-890f-7f02045d11b3', 'volume_name': 'volume-b0e7c050-9158-4c51-890f-7f02045d11b3', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9b506097-465c-49b9-a821-afc975216a61 tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8585d1bf-93bf-49fc-abcd-b839027075ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9b506097-465c-49b9-a821-afc975216a61 tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8585d1bf-93bf-49fc-abcd-b839027075ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9b506097-465c-49b9-a821-afc975216a61 tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac22022b-ec9a-4ea1-928a-09eea63105a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:45 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-9b506097-465c-49b9-a821-afc975216a61 tempest-VolumesListAdminTestJSON-223638558 None] Volume b0e7c050-9158-4c51-890f-7f02045d11b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0e7c050-9158-4c51-890f-7f02045d11b3', 'volume_size': 1} Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9b506097-465c-49b9-a821-afc975216a61 tempest-VolumesListAdminTestJSON-223638558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9b506097-465c-49b9-a821-afc975216a61 tempest-VolumesListAdminTestJSON-223638558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9b506097-465c-49b9-a821-afc975216a61 tempest-VolumesListAdminTestJSON-223638558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1590577757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0e7c050-9158-4c51-890f-7f02045d11b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6334f263fca4ae1897ae7f68e8d357d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:24:45Z,use_quota=True,user_id='f30f5ed6e0504c5dab5e81455e773b92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-9b506097-465c-49b9-a821-afc975216a61 tempest-VolumesListAdminTestJSON-223638558 None] Creating volume b0e7c050-9158-4c51-890f-7f02045d11b3 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9b506097-465c-49b9-a821-afc975216a61 tempest-VolumesListAdminTestJSON-223638558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9b506097-465c-49b9-a821-afc975216a61 tempest-VolumesListAdminTestJSON-223638558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9b506097-465c-49b9-a821-afc975216a61 tempest-VolumesListAdminTestJSON-223638558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9b506097-465c-49b9-a821-afc975216a61 tempest-VolumesListAdminTestJSON-223638558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9b506097-465c-49b9-a821-afc975216a61 tempest-VolumesListAdminTestJSON-223638558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9b506097-465c-49b9-a821-afc975216a61 tempest-VolumesListAdminTestJSON-223638558 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:24:45 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-9b506097-465c-49b9-a821-afc975216a61 tempest-VolumesListAdminTestJSON-223638558 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9b506097-465c-49b9-a821-afc975216a61 tempest-VolumesListAdminTestJSON-223638558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b0e7c050-9158-4c51-890f-7f02045d11b3 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:45 devstack sudo[95930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b0e7c050-9158-4c51-890f-7f02045d11b3 1073741824 Jun 02 03:24:45 devstack sudo[95930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-aad98629-052b-4a67-ad75-872d1ab2a113 tempest-VolumesNegativeTest-2135440357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-aad98629-052b-4a67-ad75-872d1ab2a113 tempest-VolumesNegativeTest-2135440357 None] Flow 'volume_create_manager' (9622bcb5-3b4b-4d73-bbb5-6538af7b2621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-aad98629-052b-4a67-ad75-872d1ab2a113 tempest-VolumesNegativeTest-2135440357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (805ba431-4fb0-466f-83cc-4131fe126c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-aad98629-052b-4a67-ad75-872d1ab2a113 tempest-VolumesNegativeTest-2135440357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (805ba431-4fb0-466f-83cc-4131fe126c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-565775255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7078cc09-c373-49fe-b91d-dcf65f8ef55c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe6286aaa7b44f28665a876f518c32e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:24:46Z,use_quota=True,user_id='c87447b02b4747a0b1cd320fd93df024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-aad98629-052b-4a67-ad75-872d1ab2a113 tempest-VolumesNegativeTest-2135440357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (752fe6fb-a148-4e40-af63-8efffae0c936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-aad98629-052b-4a67-ad75-872d1ab2a113 tempest-VolumesNegativeTest-2135440357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (752fe6fb-a148-4e40-af63-8efffae0c936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-aad98629-052b-4a67-ad75-872d1ab2a113 tempest-VolumesNegativeTest-2135440357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50ed4491-ceae-4587-b569-7d4292c8cd7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-aad98629-052b-4a67-ad75-872d1ab2a113 tempest-VolumesNegativeTest-2135440357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50ed4491-ceae-4587-b569-7d4292c8cd7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7078cc09-c373-49fe-b91d-dcf65f8ef55c', 'volume_name': 'volume-7078cc09-c373-49fe-b91d-dcf65f8ef55c', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-aad98629-052b-4a67-ad75-872d1ab2a113 tempest-VolumesNegativeTest-2135440357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0b02213-eea4-4ba4-b816-91dc5140ef50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-aad98629-052b-4a67-ad75-872d1ab2a113 tempest-VolumesNegativeTest-2135440357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0b02213-eea4-4ba4-b816-91dc5140ef50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-aad98629-052b-4a67-ad75-872d1ab2a113 tempest-VolumesNegativeTest-2135440357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00eeecc3-67cc-47d8-ac13-8ab6921d38fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:45 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-aad98629-052b-4a67-ad75-872d1ab2a113 tempest-VolumesNegativeTest-2135440357 None] Volume 7078cc09-c373-49fe-b91d-dcf65f8ef55c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7078cc09-c373-49fe-b91d-dcf65f8ef55c', 'volume_size': 1} Jun 02 03:24:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-aad98629-052b-4a67-ad75-872d1ab2a113 tempest-VolumesNegativeTest-2135440357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:45 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-9e8f58e8-92ea-48d3-be5d-a3ba35cba3d2 tempest-GroupSnapshotsV319Test-53960984 None] group_snapshot 2193efec-c459-4783-a8a3-c126c5dac1a8: deleted successfully Jun 02 03:24:46 devstack sudo[95930]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9b506097-465c-49b9-a821-afc975216a61 tempest-VolumesListAdminTestJSON-223638558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b0e7c050-9158-4c51-890f-7f02045d11b3 1073741824" returned: 0 in 0.822s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9b506097-465c-49b9-a821-afc975216a61 tempest-VolumesListAdminTestJSON-223638558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b0e7c050-9158-4c51-890f-7f02045d11b3 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:46 devstack sudo[95936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b0e7c050-9158-4c51-890f-7f02045d11b3 Jun 02 03:24:46 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:46 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e07f9832-6d4a-4e50-b106-6527ffc8016c tempest-GroupSnapshotsV319Test-53960984 None] Acquiring lock "cinder-quobyte-6fff8bd1-c0bf-454b-b833-85ea7176abcc" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:24:46 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e07f9832-6d4a-4e50-b106-6527ffc8016c tempest-GroupSnapshotsV319Test-53960984 None] Lock "cinder-quobyte-6fff8bd1-c0bf-454b-b833-85ea7176abcc" acquired by "delete_volume" :: waited 0.023s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:24:46 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[346beb44-a41b-46ce-b325-871f719ae876]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:24:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e07f9832-6d4a-4e50-b106-6527ffc8016c tempest-GroupSnapshotsV319Test-53960984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:47 devstack sudo[95938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc Jun 02 03:24:47 devstack sudo[95938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:47 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9b506097-465c-49b9-a821-afc975216a61 tempest-VolumesListAdminTestJSON-223638558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b0e7c050-9158-4c51-890f-7f02045d11b3" returned: 0 in 0.602s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9b506097-465c-49b9-a821-afc975216a61 tempest-VolumesListAdminTestJSON-223638558 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:24:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9b506097-465c-49b9-a821-afc975216a61 tempest-VolumesListAdminTestJSON-223638558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-aad98629-052b-4a67-ad75-872d1ab2a113 tempest-VolumesNegativeTest-2135440357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.344s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-aad98629-052b-4a67-ad75-872d1ab2a113 tempest-VolumesNegativeTest-2135440357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-565775255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7078cc09-c373-49fe-b91d-dcf65f8ef55c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fe6286aaa7b44f28665a876f518c32e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:24:46Z,use_quota=True,user_id='c87447b02b4747a0b1cd320fd93df024',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:24:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-aad98629-052b-4a67-ad75-872d1ab2a113 tempest-VolumesNegativeTest-2135440357 None] Creating volume 7078cc09-c373-49fe-b91d-dcf65f8ef55c {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:24:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-aad98629-052b-4a67-ad75-872d1ab2a113 tempest-VolumesNegativeTest-2135440357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-aad98629-052b-4a67-ad75-872d1ab2a113 tempest-VolumesNegativeTest-2135440357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-aad98629-052b-4a67-ad75-872d1ab2a113 tempest-VolumesNegativeTest-2135440357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:24:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-aad98629-052b-4a67-ad75-872d1ab2a113 tempest-VolumesNegativeTest-2135440357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:24:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-aad98629-052b-4a67-ad75-872d1ab2a113 tempest-VolumesNegativeTest-2135440357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-aad98629-052b-4a67-ad75-872d1ab2a113 tempest-VolumesNegativeTest-2135440357 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:24:47 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-aad98629-052b-4a67-ad75-872d1ab2a113 tempest-VolumesNegativeTest-2135440357 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:24:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-aad98629-052b-4a67-ad75-872d1ab2a113 tempest-VolumesNegativeTest-2135440357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7078cc09-c373-49fe-b91d-dcf65f8ef55c 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9b506097-465c-49b9-a821-afc975216a61 tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac22022b-ec9a-4ea1-928a-09eea63105a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0e7c050-9158-4c51-890f-7f02045d11b3', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:47 devstack sudo[95941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7078cc09-c373-49fe-b91d-dcf65f8ef55c 1073741824 Jun 02 03:24:47 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9b506097-465c-49b9-a821-afc975216a61 tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb561901-c89c-4182-b0cd-e77c890f38eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:47 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-9b506097-465c-49b9-a821-afc975216a61 tempest-VolumesListAdminTestJSON-223638558 None] Volume volume-b0e7c050-9158-4c51-890f-7f02045d11b3 (b0e7c050-9158-4c51-890f-7f02045d11b3): created successfully Jun 02 03:24:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9b506097-465c-49b9-a821-afc975216a61 tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb561901-c89c-4182-b0cd-e77c890f38eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9b506097-465c-49b9-a821-afc975216a61 tempest-VolumesListAdminTestJSON-223638558 None] Flow 'volume_create_manager' (967d3965-5523-417e-a3a5-b2338e92d7ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:24:47 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-9b506097-465c-49b9-a821-afc975216a61 tempest-VolumesListAdminTestJSON-223638558 None] Created volume successfully. Jun 02 03:24:47 devstack sudo[95938]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e07f9832-6d4a-4e50-b106-6527ffc8016c tempest-GroupSnapshotsV319Test-53960984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc" returned: 0 in 0.743s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e07f9832-6d4a-4e50-b106-6527ffc8016c tempest-GroupSnapshotsV319Test-53960984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:47 devstack sudo[95949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc Jun 02 03:24:47 devstack sudo[95949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-fca45353-2b72-4cff-a42c-a5d012639f5d tempest-VolumesListAdminTestJSON-223638558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:24:48 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fca45353-2b72-4cff-a42c-a5d012639f5d tempest-VolumesListAdminTestJSON-223638558 None] Flow 'volume_create_manager' (af55164a-205f-4205-b9b9-4bec8f0d687c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fca45353-2b72-4cff-a42c-a5d012639f5d tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e2e275-ecd9-4115-9df5-850927438113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-aad98629-052b-4a67-ad75-872d1ab2a113 tempest-VolumesNegativeTest-2135440357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7078cc09-c373-49fe-b91d-dcf65f8ef55c 1073741824" returned: 0 in 1.078s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fca45353-2b72-4cff-a42c-a5d012639f5d tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e2e275-ecd9-4115-9df5-850927438113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-877374862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=530304ae-835d-4de2-a5b9-fdeca793eef0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6334f263fca4ae1897ae7f68e8d357d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:24:48Z,use_quota=True,user_id='f30f5ed6e0504c5dab5e81455e773b92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fca45353-2b72-4cff-a42c-a5d012639f5d tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03541e17-48a8-469b-8520-c166555d9d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fca45353-2b72-4cff-a42c-a5d012639f5d tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03541e17-48a8-469b-8520-c166555d9d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fca45353-2b72-4cff-a42c-a5d012639f5d tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce378a2e-28d4-4464-93bd-1919f85d65ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fca45353-2b72-4cff-a42c-a5d012639f5d tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce378a2e-28d4-4464-93bd-1919f85d65ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '530304ae-835d-4de2-a5b9-fdeca793eef0', 'volume_name': 'volume-530304ae-835d-4de2-a5b9-fdeca793eef0', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fca45353-2b72-4cff-a42c-a5d012639f5d tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d54558-267f-446b-9b65-cbeae9499e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fca45353-2b72-4cff-a42c-a5d012639f5d tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d54558-267f-446b-9b65-cbeae9499e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fca45353-2b72-4cff-a42c-a5d012639f5d tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b30f0197-db45-478a-b656-d2c3aa984c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:48 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-fca45353-2b72-4cff-a42c-a5d012639f5d tempest-VolumesListAdminTestJSON-223638558 None] Volume 530304ae-835d-4de2-a5b9-fdeca793eef0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-530304ae-835d-4de2-a5b9-fdeca793eef0', 'volume_size': 1} Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fca45353-2b72-4cff-a42c-a5d012639f5d tempest-VolumesListAdminTestJSON-223638558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:48 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-7edfb408-ae71-481a-8cef-16e10dc09390 tempest-GroupsV320Test-380440538 None] Group tempest-GroupsV320Test-Group-1928696608: creating Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-aad98629-052b-4a67-ad75-872d1ab2a113 tempest-VolumesNegativeTest-2135440357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7078cc09-c373-49fe-b91d-dcf65f8ef55c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:48 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-7edfb408-ae71-481a-8cef-16e10dc09390 tempest-GroupsV320Test-380440538 None] Group tempest-GroupsV320Test-Group-1928696608: created successfully Jun 02 03:24:48 devstack sudo[95954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7078cc09-c373-49fe-b91d-dcf65f8ef55c Jun 02 03:24:48 devstack sudo[95954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:48 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-7edfb408-ae71-481a-8cef-16e10dc09390 tempest-GroupsV320Test-380440538 None] Create group completed successfully. Jun 02 03:24:48 devstack sudo[95949]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e07f9832-6d4a-4e50-b106-6527ffc8016c tempest-GroupSnapshotsV319Test-53960984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6fff8bd1-c0bf-454b-b833-85ea7176abcc" returned: 0 in 0.728s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e07f9832-6d4a-4e50-b106-6527ffc8016c tempest-GroupSnapshotsV319Test-53960984 None] Lock "cinder-quobyte-6fff8bd1-c0bf-454b-b833-85ea7176abcc" released by "delete_volume" :: held 1.559s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-e07f9832-6d4a-4e50-b106-6527ffc8016c tempest-GroupSnapshotsV319Test-53960984 None] Created reservations ['32681b5e-f0dc-41dc-a260-51ce26ccde0c'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:24:48 devstack cinder-volume[86431]: WARNING cinder.quota [None req-e07f9832-6d4a-4e50-b106-6527ffc8016c tempest-GroupSnapshotsV319Test-53960984 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1861481254 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1861481254, it is now deprecated. Please use the default quota class for default quota. Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-e07f9832-6d4a-4e50-b106-6527ffc8016c tempest-GroupSnapshotsV319Test-53960984 None] Created reservations ['b1356a58-e43a-427a-a419-fd2ad33f0d33', '07034454-843b-43f1-a9b4-caa528a89b4f', '37d0b525-4729-4f94-859e-bfac3790abf8', '70368424-d580-4186-801a-9d93f1b9cfa3'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e07f9832-6d4a-4e50-b106-6527ffc8016c tempest-GroupSnapshotsV319Test-53960984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e07f9832-6d4a-4e50-b106-6527ffc8016c tempest-GroupSnapshotsV319Test-53960984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e07f9832-6d4a-4e50-b106-6527ffc8016c tempest-GroupSnapshotsV319Test-53960984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e07f9832-6d4a-4e50-b106-6527ffc8016c tempest-GroupSnapshotsV319Test-53960984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e07f9832-6d4a-4e50-b106-6527ffc8016c tempest-GroupSnapshotsV319Test-53960984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e07f9832-6d4a-4e50-b106-6527ffc8016c tempest-GroupSnapshotsV319Test-53960984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:48 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:24:48 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:48 devstack sudo[95954]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-aad98629-052b-4a67-ad75-872d1ab2a113 tempest-VolumesNegativeTest-2135440357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7078cc09-c373-49fe-b91d-dcf65f8ef55c" returned: 0 in 0.610s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-aad98629-052b-4a67-ad75-872d1ab2a113 tempest-VolumesNegativeTest-2135440357 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-aad98629-052b-4a67-ad75-872d1ab2a113 tempest-VolumesNegativeTest-2135440357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.791s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fca45353-2b72-4cff-a42c-a5d012639f5d tempest-VolumesListAdminTestJSON-223638558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.650s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-fca45353-2b72-4cff-a42c-a5d012639f5d tempest-VolumesListAdminTestJSON-223638558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-877374862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=530304ae-835d-4de2-a5b9-fdeca793eef0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6334f263fca4ae1897ae7f68e8d357d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:24:48Z,use_quota=True,user_id='f30f5ed6e0504c5dab5e81455e773b92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-fca45353-2b72-4cff-a42c-a5d012639f5d tempest-VolumesListAdminTestJSON-223638558 None] Creating volume 530304ae-835d-4de2-a5b9-fdeca793eef0 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fca45353-2b72-4cff-a42c-a5d012639f5d tempest-VolumesListAdminTestJSON-223638558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fca45353-2b72-4cff-a42c-a5d012639f5d tempest-VolumesListAdminTestJSON-223638558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-fca45353-2b72-4cff-a42c-a5d012639f5d tempest-VolumesListAdminTestJSON-223638558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-fca45353-2b72-4cff-a42c-a5d012639f5d tempest-VolumesListAdminTestJSON-223638558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fca45353-2b72-4cff-a42c-a5d012639f5d tempest-VolumesListAdminTestJSON-223638558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-fca45353-2b72-4cff-a42c-a5d012639f5d tempest-VolumesListAdminTestJSON-223638558 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:24:48 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-fca45353-2b72-4cff-a42c-a5d012639f5d tempest-VolumesListAdminTestJSON-223638558 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fca45353-2b72-4cff-a42c-a5d012639f5d tempest-VolumesListAdminTestJSON-223638558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-530304ae-835d-4de2-a5b9-fdeca793eef0 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:48 devstack sudo[95960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-530304ae-835d-4de2-a5b9-fdeca793eef0 1073741824 Jun 02 03:24:48 devstack sudo[95960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-aad98629-052b-4a67-ad75-872d1ab2a113 tempest-VolumesNegativeTest-2135440357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00eeecc3-67cc-47d8-ac13-8ab6921d38fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7078cc09-c373-49fe-b91d-dcf65f8ef55c', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:49 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-aad98629-052b-4a67-ad75-872d1ab2a113 tempest-VolumesNegativeTest-2135440357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (488de0fb-025a-4cee-b3f5-a478c7ffe822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:49 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-aad98629-052b-4a67-ad75-872d1ab2a113 tempest-VolumesNegativeTest-2135440357 None] Volume volume-7078cc09-c373-49fe-b91d-dcf65f8ef55c (7078cc09-c373-49fe-b91d-dcf65f8ef55c): created successfully Jun 02 03:24:49 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-aad98629-052b-4a67-ad75-872d1ab2a113 tempest-VolumesNegativeTest-2135440357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (488de0fb-025a-4cee-b3f5-a478c7ffe822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:49 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-aad98629-052b-4a67-ad75-872d1ab2a113 tempest-VolumesNegativeTest-2135440357 None] Flow 'volume_create_manager' (9622bcb5-3b4b-4d73-bbb5-6538af7b2621) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:24:49 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-aad98629-052b-4a67-ad75-872d1ab2a113 tempest-VolumesNegativeTest-2135440357 None] Created volume successfully. Jun 02 03:24:49 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e07f9832-6d4a-4e50-b106-6527ffc8016c tempest-GroupSnapshotsV319Test-53960984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.600s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:49 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-e07f9832-6d4a-4e50-b106-6527ffc8016c tempest-GroupSnapshotsV319Test-53960984 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:24:49 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-e07f9832-6d4a-4e50-b106-6527ffc8016c tempest-GroupSnapshotsV319Test-53960984 None] Delete group completed successfully. Jun 02 03:24:49 devstack sudo[95960]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fca45353-2b72-4cff-a42c-a5d012639f5d tempest-VolumesListAdminTestJSON-223638558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-530304ae-835d-4de2-a5b9-fdeca793eef0 1073741824" returned: 0 in 0.892s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fca45353-2b72-4cff-a42c-a5d012639f5d tempest-VolumesListAdminTestJSON-223638558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-530304ae-835d-4de2-a5b9-fdeca793eef0 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:49 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-530304ae-835d-4de2-a5b9-fdeca793eef0 Jun 02 03:24:49 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:49 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-224d76fd-80c9-4905-ae6d-28653fb70a08 tempest-GroupsV320Test-380440538 None] Created reservations ['68b012cb-629f-4a60-b002-eac7a6057afc'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:24:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-224d76fd-80c9-4905-ae6d-28653fb70a08 tempest-GroupsV320Test-380440538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-224d76fd-80c9-4905-ae6d-28653fb70a08 tempest-GroupsV320Test-380440538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:50 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-224d76fd-80c9-4905-ae6d-28653fb70a08 tempest-GroupsV320Test-380440538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:24:50 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-224d76fd-80c9-4905-ae6d-28653fb70a08 tempest-GroupsV320Test-380440538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:24:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-224d76fd-80c9-4905-ae6d-28653fb70a08 tempest-GroupsV320Test-380440538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-224d76fd-80c9-4905-ae6d-28653fb70a08 tempest-GroupsV320Test-380440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:50 devstack sudo[95969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:24:50 devstack sudo[95969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:50 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fca45353-2b72-4cff-a42c-a5d012639f5d tempest-VolumesListAdminTestJSON-223638558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-530304ae-835d-4de2-a5b9-fdeca793eef0" returned: 0 in 0.792s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:50 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-fca45353-2b72-4cff-a42c-a5d012639f5d tempest-VolumesListAdminTestJSON-223638558 None] <== create_volume: return (1751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:24:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fca45353-2b72-4cff-a42c-a5d012639f5d tempest-VolumesListAdminTestJSON-223638558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:50 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fca45353-2b72-4cff-a42c-a5d012639f5d tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b30f0197-db45-478a-b656-d2c3aa984c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-530304ae-835d-4de2-a5b9-fdeca793eef0', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:50 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fca45353-2b72-4cff-a42c-a5d012639f5d tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46813dde-55fb-4460-9591-27acb1ef0119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:50 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-fca45353-2b72-4cff-a42c-a5d012639f5d tempest-VolumesListAdminTestJSON-223638558 None] Volume volume-530304ae-835d-4de2-a5b9-fdeca793eef0 (530304ae-835d-4de2-a5b9-fdeca793eef0): created successfully Jun 02 03:24:50 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fca45353-2b72-4cff-a42c-a5d012639f5d tempest-VolumesListAdminTestJSON-223638558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46813dde-55fb-4460-9591-27acb1ef0119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:50 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fca45353-2b72-4cff-a42c-a5d012639f5d tempest-VolumesListAdminTestJSON-223638558 None] Flow 'volume_create_manager' (af55164a-205f-4205-b9b9-4bec8f0d687c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:24:50 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-fca45353-2b72-4cff-a42c-a5d012639f5d tempest-VolumesListAdminTestJSON-223638558 None] Created volume successfully. Jun 02 03:24:50 devstack sudo[95969]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-224d76fd-80c9-4905-ae6d-28653fb70a08 tempest-GroupsV320Test-380440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.756s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:50 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-224d76fd-80c9-4905-ae6d-28653fb70a08 tempest-GroupsV320Test-380440538 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:24:50 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-224d76fd-80c9-4905-ae6d-28653fb70a08 tempest-GroupsV320Test-380440538 None] Delete group completed successfully. Jun 02 03:24:52 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-1da9fd6a-2b22-4f2a-81b8-b62444f0d24d tempest-VolumesListAdminTestJSON-329599700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:24:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1da9fd6a-2b22-4f2a-81b8-b62444f0d24d tempest-VolumesListAdminTestJSON-329599700 None] Flow 'volume_create_manager' (d3bbb792-d56c-4f43-b760-7f21403a4329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:24:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1da9fd6a-2b22-4f2a-81b8-b62444f0d24d tempest-VolumesListAdminTestJSON-329599700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3177f824-6071-428f-9ea1-209212d4ab31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1da9fd6a-2b22-4f2a-81b8-b62444f0d24d tempest-VolumesListAdminTestJSON-329599700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3177f824-6071-428f-9ea1-209212d4ab31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d51d70a3-4de8-405f-996a-4be1d278338d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c564ce70a04140a9b011a8de2d18e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:24:53Z,use_quota=True,user_id='558731f7977f4a56b34db2603726ee88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1da9fd6a-2b22-4f2a-81b8-b62444f0d24d tempest-VolumesListAdminTestJSON-329599700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583ae8a9-24ee-402c-bea8-237b59704b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1da9fd6a-2b22-4f2a-81b8-b62444f0d24d tempest-VolumesListAdminTestJSON-329599700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583ae8a9-24ee-402c-bea8-237b59704b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1da9fd6a-2b22-4f2a-81b8-b62444f0d24d tempest-VolumesListAdminTestJSON-329599700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49b6bc90-de73-483e-a845-e2f3611eb480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1da9fd6a-2b22-4f2a-81b8-b62444f0d24d tempest-VolumesListAdminTestJSON-329599700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49b6bc90-de73-483e-a845-e2f3611eb480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd51d70a3-4de8-405f-996a-4be1d278338d', 'volume_name': 'volume-d51d70a3-4de8-405f-996a-4be1d278338d', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1da9fd6a-2b22-4f2a-81b8-b62444f0d24d tempest-VolumesListAdminTestJSON-329599700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e4f409-d41e-4d3a-87d6-be70fd883289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1da9fd6a-2b22-4f2a-81b8-b62444f0d24d tempest-VolumesListAdminTestJSON-329599700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e4f409-d41e-4d3a-87d6-be70fd883289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1da9fd6a-2b22-4f2a-81b8-b62444f0d24d tempest-VolumesListAdminTestJSON-329599700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4348a615-e602-46ea-b3c8-64b8f5cbc798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:52 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-1da9fd6a-2b22-4f2a-81b8-b62444f0d24d tempest-VolumesListAdminTestJSON-329599700 None] Volume d51d70a3-4de8-405f-996a-4be1d278338d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d51d70a3-4de8-405f-996a-4be1d278338d', 'volume_size': 1} Jun 02 03:24:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1da9fd6a-2b22-4f2a-81b8-b62444f0d24d tempest-VolumesListAdminTestJSON-329599700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1da9fd6a-2b22-4f2a-81b8-b62444f0d24d tempest-VolumesListAdminTestJSON-329599700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:52 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-1da9fd6a-2b22-4f2a-81b8-b62444f0d24d tempest-VolumesListAdminTestJSON-329599700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d51d70a3-4de8-405f-996a-4be1d278338d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c564ce70a04140a9b011a8de2d18e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:24:53Z,use_quota=True,user_id='558731f7977f4a56b34db2603726ee88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:24:52 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-1da9fd6a-2b22-4f2a-81b8-b62444f0d24d tempest-VolumesListAdminTestJSON-329599700 None] Creating volume d51d70a3-4de8-405f-996a-4be1d278338d {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:24:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1da9fd6a-2b22-4f2a-81b8-b62444f0d24d tempest-VolumesListAdminTestJSON-329599700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1da9fd6a-2b22-4f2a-81b8-b62444f0d24d tempest-VolumesListAdminTestJSON-329599700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:52 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-1da9fd6a-2b22-4f2a-81b8-b62444f0d24d tempest-VolumesListAdminTestJSON-329599700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:24:52 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-1da9fd6a-2b22-4f2a-81b8-b62444f0d24d tempest-VolumesListAdminTestJSON-329599700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:24:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1da9fd6a-2b22-4f2a-81b8-b62444f0d24d tempest-VolumesListAdminTestJSON-329599700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:52 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-1da9fd6a-2b22-4f2a-81b8-b62444f0d24d tempest-VolumesListAdminTestJSON-329599700 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:24:52 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-1da9fd6a-2b22-4f2a-81b8-b62444f0d24d tempest-VolumesListAdminTestJSON-329599700 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:24:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1da9fd6a-2b22-4f2a-81b8-b62444f0d24d tempest-VolumesListAdminTestJSON-329599700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d51d70a3-4de8-405f-996a-4be1d278338d 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:52 devstack sudo[95976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d51d70a3-4de8-405f-996a-4be1d278338d 1073741824 Jun 02 03:24:52 devstack sudo[95976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:53 devstack sudo[95976]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1da9fd6a-2b22-4f2a-81b8-b62444f0d24d tempest-VolumesListAdminTestJSON-329599700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d51d70a3-4de8-405f-996a-4be1d278338d 1073741824" returned: 0 in 0.939s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1da9fd6a-2b22-4f2a-81b8-b62444f0d24d tempest-VolumesListAdminTestJSON-329599700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d51d70a3-4de8-405f-996a-4be1d278338d {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:53 devstack sudo[95982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d51d70a3-4de8-405f-996a-4be1d278338d Jun 02 03:24:53 devstack sudo[95982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:54 devstack sudo[95982]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1da9fd6a-2b22-4f2a-81b8-b62444f0d24d tempest-VolumesListAdminTestJSON-329599700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d51d70a3-4de8-405f-996a-4be1d278338d" returned: 0 in 0.680s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:54 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-1da9fd6a-2b22-4f2a-81b8-b62444f0d24d tempest-VolumesListAdminTestJSON-329599700 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:24:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1da9fd6a-2b22-4f2a-81b8-b62444f0d24d tempest-VolumesListAdminTestJSON-329599700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:54 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1da9fd6a-2b22-4f2a-81b8-b62444f0d24d tempest-VolumesListAdminTestJSON-329599700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4348a615-e602-46ea-b3c8-64b8f5cbc798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d51d70a3-4de8-405f-996a-4be1d278338d', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:54 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1da9fd6a-2b22-4f2a-81b8-b62444f0d24d tempest-VolumesListAdminTestJSON-329599700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f398b6c-02a5-4a15-93fc-7af7182b8834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:54 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-1da9fd6a-2b22-4f2a-81b8-b62444f0d24d tempest-VolumesListAdminTestJSON-329599700 None] Volume volume-d51d70a3-4de8-405f-996a-4be1d278338d (d51d70a3-4de8-405f-996a-4be1d278338d): created successfully Jun 02 03:24:54 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1da9fd6a-2b22-4f2a-81b8-b62444f0d24d tempest-VolumesListAdminTestJSON-329599700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f398b6c-02a5-4a15-93fc-7af7182b8834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:54 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1da9fd6a-2b22-4f2a-81b8-b62444f0d24d tempest-VolumesListAdminTestJSON-329599700 None] Flow 'volume_create_manager' (d3bbb792-d56c-4f43-b760-7f21403a4329) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:24:54 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-1da9fd6a-2b22-4f2a-81b8-b62444f0d24d tempest-VolumesListAdminTestJSON-329599700 None] Created volume successfully. Jun 02 03:24:54 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e63dcf4d-917c-4b8b-bedf-25ca4c5801a6 tempest-VolumesListAdminTestJSON-329599700 None] Acquiring lock "cinder-d51d70a3-4de8-405f-996a-4be1d278338d-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:24:54 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e63dcf4d-917c-4b8b-bedf-25ca4c5801a6 tempest-VolumesListAdminTestJSON-329599700 None] Lock "cinder-d51d70a3-4de8-405f-996a-4be1d278338d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:24:54 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e63dcf4d-917c-4b8b-bedf-25ca4c5801a6 tempest-VolumesListAdminTestJSON-329599700 None] Acquiring lock "cinder-quobyte-d51d70a3-4de8-405f-996a-4be1d278338d" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:24:54 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e63dcf4d-917c-4b8b-bedf-25ca4c5801a6 tempest-VolumesListAdminTestJSON-329599700 None] Lock "cinder-quobyte-d51d70a3-4de8-405f-996a-4be1d278338d" acquired by "delete_volume" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:24:54 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7258260-cf78-42b7-b2c2-03130bfa0e43]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:24:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e63dcf4d-917c-4b8b-bedf-25ca4c5801a6 tempest-VolumesListAdminTestJSON-329599700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d51d70a3-4de8-405f-996a-4be1d278338d {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:55 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d51e79be-bbb4-4be9-bdf0-a12710dcb45e tempest-VolumesListAdminTestJSON-223638558 None] Acquiring lock "cinder-530304ae-835d-4de2-a5b9-fdeca793eef0-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:24:55 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d51e79be-bbb4-4be9-bdf0-a12710dcb45e tempest-VolumesListAdminTestJSON-223638558 None] Lock "cinder-530304ae-835d-4de2-a5b9-fdeca793eef0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:24:55 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d51e79be-bbb4-4be9-bdf0-a12710dcb45e tempest-VolumesListAdminTestJSON-223638558 None] Acquiring lock "cinder-quobyte-530304ae-835d-4de2-a5b9-fdeca793eef0" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:24:55 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d51e79be-bbb4-4be9-bdf0-a12710dcb45e tempest-VolumesListAdminTestJSON-223638558 None] Lock "cinder-quobyte-530304ae-835d-4de2-a5b9-fdeca793eef0" acquired by "delete_volume" :: waited 0.023s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:24:55 devstack sudo[95985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d51d70a3-4de8-405f-996a-4be1d278338d Jun 02 03:24:55 devstack sudo[95985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:55 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67bf4c9-d096-4f2f-b1d6-e86ebaa640a1]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:24:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d51e79be-bbb4-4be9-bdf0-a12710dcb45e tempest-VolumesListAdminTestJSON-223638558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-530304ae-835d-4de2-a5b9-fdeca793eef0 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:55 devstack sudo[95987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-530304ae-835d-4de2-a5b9-fdeca793eef0 Jun 02 03:24:55 devstack sudo[95987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:56 devstack sudo[95987]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d51e79be-bbb4-4be9-bdf0-a12710dcb45e tempest-VolumesListAdminTestJSON-223638558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-530304ae-835d-4de2-a5b9-fdeca793eef0" returned: 0 in 0.965s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d51e79be-bbb4-4be9-bdf0-a12710dcb45e tempest-VolumesListAdminTestJSON-223638558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-530304ae-835d-4de2-a5b9-fdeca793eef0 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:56 devstack sudo[95995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-530304ae-835d-4de2-a5b9-fdeca793eef0 Jun 02 03:24:56 devstack sudo[95995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:56 devstack sudo[95985]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e63dcf4d-917c-4b8b-bedf-25ca4c5801a6 tempest-VolumesListAdminTestJSON-329599700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d51d70a3-4de8-405f-996a-4be1d278338d" returned: 0 in 1.250s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e63dcf4d-917c-4b8b-bedf-25ca4c5801a6 tempest-VolumesListAdminTestJSON-329599700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d51d70a3-4de8-405f-996a-4be1d278338d {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:56 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e811c26-2640-4ab6-bfff-5a69ab35948d tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:24:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9e811c26-2640-4ab6-bfff-5a69ab35948d tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Flow 'volume_create_manager' (aafb762d-6f23-4d02-a117-ffd765e3ada3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:24:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9e811c26-2640-4ab6-bfff-5a69ab35948d tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53db5477-01bd-4c46-b51c-75f82160ceef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:56 devstack sudo[95997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d51d70a3-4de8-405f-996a-4be1d278338d Jun 02 03:24:56 devstack sudo[95997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9e811c26-2640-4ab6-bfff-5a69ab35948d tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53db5477-01bd-4c46-b51c-75f82160ceef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2038666360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b185bcc-4368-416f-865e-dede93131007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='516c62304d914d95b3e4fd3768167778',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:24:56Z,use_quota=True,user_id='7dc38642ec1242c9b8ea8b1c0f952279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9e811c26-2640-4ab6-bfff-5a69ab35948d tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f92eba27-7ff6-4917-b0c3-126174bbccb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9e811c26-2640-4ab6-bfff-5a69ab35948d tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f92eba27-7ff6-4917-b0c3-126174bbccb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9e811c26-2640-4ab6-bfff-5a69ab35948d tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (454f2779-e7dc-4ade-a9ca-dcc5d7209184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9e811c26-2640-4ab6-bfff-5a69ab35948d tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (454f2779-e7dc-4ade-a9ca-dcc5d7209184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b185bcc-4368-416f-865e-dede93131007', 'volume_name': 'volume-5b185bcc-4368-416f-865e-dede93131007', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9e811c26-2640-4ab6-bfff-5a69ab35948d tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd2bb299-0f61-4f99-adf7-289612ce8d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9e811c26-2640-4ab6-bfff-5a69ab35948d tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd2bb299-0f61-4f99-adf7-289612ce8d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9e811c26-2640-4ab6-bfff-5a69ab35948d tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a113999-3680-4a26-b4ac-1438fed32c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:56 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-9e811c26-2640-4ab6-bfff-5a69ab35948d tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Volume 5b185bcc-4368-416f-865e-dede93131007: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b185bcc-4368-416f-865e-dede93131007', 'volume_size': 1} Jun 02 03:24:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9e811c26-2640-4ab6-bfff-5a69ab35948d tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9e811c26-2640-4ab6-bfff-5a69ab35948d tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:56 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9e811c26-2640-4ab6-bfff-5a69ab35948d tempest-VolumeQuotasNegativeTestJSON-1241545311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2038666360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b185bcc-4368-416f-865e-dede93131007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='516c62304d914d95b3e4fd3768167778',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:24:56Z,use_quota=True,user_id='7dc38642ec1242c9b8ea8b1c0f952279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:24:56 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-9e811c26-2640-4ab6-bfff-5a69ab35948d tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Creating volume 5b185bcc-4368-416f-865e-dede93131007 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:24:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9e811c26-2640-4ab6-bfff-5a69ab35948d tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9e811c26-2640-4ab6-bfff-5a69ab35948d tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:56 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9e811c26-2640-4ab6-bfff-5a69ab35948d tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:24:56 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9e811c26-2640-4ab6-bfff-5a69ab35948d tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:24:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9e811c26-2640-4ab6-bfff-5a69ab35948d tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:56 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9e811c26-2640-4ab6-bfff-5a69ab35948d tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:24:56 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-9e811c26-2640-4ab6-bfff-5a69ab35948d tempest-VolumeQuotasNegativeTestJSON-1241545311 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:24:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9e811c26-2640-4ab6-bfff-5a69ab35948d tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5b185bcc-4368-416f-865e-dede93131007 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:56 devstack sudo[95999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5b185bcc-4368-416f-865e-dede93131007 1073741824 Jun 02 03:24:56 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:56 devstack sudo[95995]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d51e79be-bbb4-4be9-bdf0-a12710dcb45e tempest-VolumesListAdminTestJSON-223638558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-530304ae-835d-4de2-a5b9-fdeca793eef0" returned: 0 in 0.861s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:56 devstack sudo[95997]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e63dcf4d-917c-4b8b-bedf-25ca4c5801a6 tempest-VolumesListAdminTestJSON-329599700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d51d70a3-4de8-405f-996a-4be1d278338d" returned: 0 in 0.791s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:56 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d51e79be-bbb4-4be9-bdf0-a12710dcb45e tempest-VolumesListAdminTestJSON-223638558 None] Lock "cinder-quobyte-530304ae-835d-4de2-a5b9-fdeca793eef0" released by "delete_volume" :: held 1.899s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:24:57 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e63dcf4d-917c-4b8b-bedf-25ca4c5801a6 tempest-VolumesListAdminTestJSON-329599700 None] Lock "cinder-quobyte-d51d70a3-4de8-405f-996a-4be1d278338d" released by "delete_volume" :: held 2.117s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:24:57 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-d51e79be-bbb4-4be9-bdf0-a12710dcb45e tempest-VolumesListAdminTestJSON-223638558 None] Created reservations ['24536303-56a6-4ced-a5f4-743fea4640cf', '12a5bba1-7ea0-44f4-ba9a-c378c1bee831', '0090ac86-3fd2-4a15-adb3-57fa6b890224', 'de29b5db-a77c-4359-8689-836e72b96a8d'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:24:57 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-e63dcf4d-917c-4b8b-bedf-25ca4c5801a6 tempest-VolumesListAdminTestJSON-329599700 None] Created reservations ['499a71c4-b76b-446b-bc4e-055437c72366', '8e5e419c-0f98-4082-8fcd-0237baac2526', '95bdc266-0d6f-4083-bf1e-a0324c9967d1', '3d417da5-bec3-4573-b984-c0b7c39860dd'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:24:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d51e79be-bbb4-4be9-bdf0-a12710dcb45e tempest-VolumesListAdminTestJSON-223638558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d51e79be-bbb4-4be9-bdf0-a12710dcb45e tempest-VolumesListAdminTestJSON-223638558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:57 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-d51e79be-bbb4-4be9-bdf0-a12710dcb45e tempest-VolumesListAdminTestJSON-223638558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:24:57 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-d51e79be-bbb4-4be9-bdf0-a12710dcb45e tempest-VolumesListAdminTestJSON-223638558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:24:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d51e79be-bbb4-4be9-bdf0-a12710dcb45e tempest-VolumesListAdminTestJSON-223638558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d51e79be-bbb4-4be9-bdf0-a12710dcb45e tempest-VolumesListAdminTestJSON-223638558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:57 devstack sudo[96006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:24:57 devstack sudo[96006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e63dcf4d-917c-4b8b-bedf-25ca4c5801a6 tempest-VolumesListAdminTestJSON-329599700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:24:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e63dcf4d-917c-4b8b-bedf-25ca4c5801a6 tempest-VolumesListAdminTestJSON-329599700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:24:57 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e63dcf4d-917c-4b8b-bedf-25ca4c5801a6 tempest-VolumesListAdminTestJSON-329599700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:24:57 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e63dcf4d-917c-4b8b-bedf-25ca4c5801a6 tempest-VolumesListAdminTestJSON-329599700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:24:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e63dcf4d-917c-4b8b-bedf-25ca4c5801a6 tempest-VolumesListAdminTestJSON-329599700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e63dcf4d-917c-4b8b-bedf-25ca4c5801a6 tempest-VolumesListAdminTestJSON-329599700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:57 devstack sudo[96009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:24:57 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:57 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-cc655862-ee1b-4c81-9b58-fd340f7b817d tempest-VolumesListAdminTestJSON-223638558 None] Acquiring lock "cinder-b0e7c050-9158-4c51-890f-7f02045d11b3-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:24:57 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-cc655862-ee1b-4c81-9b58-fd340f7b817d tempest-VolumesListAdminTestJSON-223638558 None] Lock "cinder-b0e7c050-9158-4c51-890f-7f02045d11b3-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:24:57 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-cc655862-ee1b-4c81-9b58-fd340f7b817d tempest-VolumesListAdminTestJSON-223638558 None] Acquiring lock "cinder-quobyte-b0e7c050-9158-4c51-890f-7f02045d11b3" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:24:57 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-cc655862-ee1b-4c81-9b58-fd340f7b817d tempest-VolumesListAdminTestJSON-223638558 None] Lock "cinder-quobyte-b0e7c050-9158-4c51-890f-7f02045d11b3" acquired by "delete_volume" :: waited 0.030s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:24:57 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c3f955-1f61-4ced-b1e4-3be3d307cf56]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:24:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cc655862-ee1b-4c81-9b58-fd340f7b817d tempest-VolumesListAdminTestJSON-223638558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b0e7c050-9158-4c51-890f-7f02045d11b3 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:57 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9e811c26-2640-4ab6-bfff-5a69ab35948d tempest-VolumeQuotasNegativeTestJSON-1241545311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5b185bcc-4368-416f-865e-dede93131007 1073741824" returned: 0 in 1.652s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9e811c26-2640-4ab6-bfff-5a69ab35948d tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5b185bcc-4368-416f-865e-dede93131007 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:58 devstack sudo[96014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b0e7c050-9158-4c51-890f-7f02045d11b3 Jun 02 03:24:58 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:58 devstack sudo[96015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5b185bcc-4368-416f-865e-dede93131007 Jun 02 03:24:58 devstack sudo[96015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:58 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e63dcf4d-917c-4b8b-bedf-25ca4c5801a6 tempest-VolumesListAdminTestJSON-329599700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 1.054s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:58 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-e63dcf4d-917c-4b8b-bedf-25ca4c5801a6 tempest-VolumesListAdminTestJSON-329599700 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:24:58 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-e63dcf4d-917c-4b8b-bedf-25ca4c5801a6 tempest-VolumesListAdminTestJSON-329599700 None] Deleted volume successfully. Jun 02 03:24:58 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e63dcf4d-917c-4b8b-bedf-25ca4c5801a6 tempest-VolumesListAdminTestJSON-329599700 None] Lock "cinder-d51d70a3-4de8-405f-996a-4be1d278338d-delete_volume" released by "delete_volume" :: held 3.718s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:24:58 devstack sudo[96006]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d51e79be-bbb4-4be9-bdf0-a12710dcb45e tempest-VolumesListAdminTestJSON-223638558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 1.321s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:58 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-d51e79be-bbb4-4be9-bdf0-a12710dcb45e tempest-VolumesListAdminTestJSON-223638558 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:24:58 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-d51e79be-bbb4-4be9-bdf0-a12710dcb45e tempest-VolumesListAdminTestJSON-223638558 None] Deleted volume successfully. Jun 02 03:24:58 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d51e79be-bbb4-4be9-bdf0-a12710dcb45e tempest-VolumesListAdminTestJSON-223638558 None] Lock "cinder-530304ae-835d-4de2-a5b9-fdeca793eef0-delete_volume" released by "delete_volume" :: held 3.623s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:24:59 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:59 devstack sudo[96015]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cc655862-ee1b-4c81-9b58-fd340f7b817d tempest-VolumesListAdminTestJSON-223638558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b0e7c050-9158-4c51-890f-7f02045d11b3" returned: 0 in 1.233s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cc655862-ee1b-4c81-9b58-fd340f7b817d tempest-VolumesListAdminTestJSON-223638558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b0e7c050-9158-4c51-890f-7f02045d11b3 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:24:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9e811c26-2640-4ab6-bfff-5a69ab35948d tempest-VolumeQuotasNegativeTestJSON-1241545311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5b185bcc-4368-416f-865e-dede93131007" returned: 0 in 1.106s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:59 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9e811c26-2640-4ab6-bfff-5a69ab35948d tempest-VolumeQuotasNegativeTestJSON-1241545311 None] <== create_volume: return (2856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:24:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9e811c26-2640-4ab6-bfff-5a69ab35948d tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.858s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:24:59 devstack sudo[96036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b0e7c050-9158-4c51-890f-7f02045d11b3 Jun 02 03:24:59 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:24:59 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9e811c26-2640-4ab6-bfff-5a69ab35948d tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a113999-3680-4a26-b4ac-1438fed32c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b185bcc-4368-416f-865e-dede93131007', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:59 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9e811c26-2640-4ab6-bfff-5a69ab35948d tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e997d316-d0f6-4c01-b0cb-121cf0671582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:24:59 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-9e811c26-2640-4ab6-bfff-5a69ab35948d tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Volume volume-5b185bcc-4368-416f-865e-dede93131007 (5b185bcc-4368-416f-865e-dede93131007): created successfully Jun 02 03:24:59 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9e811c26-2640-4ab6-bfff-5a69ab35948d tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e997d316-d0f6-4c01-b0cb-121cf0671582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:24:59 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9e811c26-2640-4ab6-bfff-5a69ab35948d tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Flow 'volume_create_manager' (aafb762d-6f23-4d02-a117-ffd765e3ada3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:24:59 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-9e811c26-2640-4ab6-bfff-5a69ab35948d tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Created volume successfully. Jun 02 03:24:59 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root Jun 02 03:24:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cc655862-ee1b-4c81-9b58-fd340f7b817d tempest-VolumesListAdminTestJSON-223638558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b0e7c050-9158-4c51-890f-7f02045d11b3" returned: 0 in 0.724s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:24:59 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-cc655862-ee1b-4c81-9b58-fd340f7b817d tempest-VolumesListAdminTestJSON-223638558 None] Lock "cinder-quobyte-b0e7c050-9158-4c51-890f-7f02045d11b3" released by "delete_volume" :: held 2.016s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:24:59 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-cc655862-ee1b-4c81-9b58-fd340f7b817d tempest-VolumesListAdminTestJSON-223638558 None] Created reservations ['b25bbc35-c11f-4fd4-827d-9a6b311de527', '67685d4b-4d56-4175-82be-236ec92786a1', '9488df37-41bd-430e-a907-c270c9463eb0', '41a7bac9-1426-4ab2-a7a4-7b91cf341763'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:25:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-cc655862-ee1b-4c81-9b58-fd340f7b817d tempest-VolumesListAdminTestJSON-223638558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-cc655862-ee1b-4c81-9b58-fd340f7b817d tempest-VolumesListAdminTestJSON-223638558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:00 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-cc655862-ee1b-4c81-9b58-fd340f7b817d tempest-VolumesListAdminTestJSON-223638558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:25:00 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-cc655862-ee1b-4c81-9b58-fd340f7b817d tempest-VolumesListAdminTestJSON-223638558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:25:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-cc655862-ee1b-4c81-9b58-fd340f7b817d tempest-VolumesListAdminTestJSON-223638558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:25:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cc655862-ee1b-4c81-9b58-fd340f7b817d tempest-VolumesListAdminTestJSON-223638558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:00 devstack sudo[96040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:25:00 devstack sudo[96040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:00 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6af0374c-a5b9-42d2-838e-65f0591dfd2c tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Acquiring lock "cinder-5b185bcc-4368-416f-865e-dede93131007-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:00 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6af0374c-a5b9-42d2-838e-65f0591dfd2c tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Lock "cinder-5b185bcc-4368-416f-865e-dede93131007-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:00 devstack sudo[96040]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cc655862-ee1b-4c81-9b58-fd340f7b817d tempest-VolumesListAdminTestJSON-223638558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.844s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:00 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-cc655862-ee1b-4c81-9b58-fd340f7b817d tempest-VolumesListAdminTestJSON-223638558 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:25:00 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-cc655862-ee1b-4c81-9b58-fd340f7b817d tempest-VolumesListAdminTestJSON-223638558 None] Deleted volume successfully. Jun 02 03:25:00 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-cc655862-ee1b-4c81-9b58-fd340f7b817d tempest-VolumesListAdminTestJSON-223638558 None] Lock "cinder-b0e7c050-9158-4c51-890f-7f02045d11b3-delete_volume" released by "delete_volume" :: held 3.140s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:25:00 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6af0374c-a5b9-42d2-838e-65f0591dfd2c tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Acquiring lock "cinder-quobyte-5b185bcc-4368-416f-865e-dede93131007" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:00 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6af0374c-a5b9-42d2-838e-65f0591dfd2c tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Lock "cinder-quobyte-5b185bcc-4368-416f-865e-dede93131007" acquired by "delete_volume" :: waited 0.016s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:00 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c053302-08c8-4b92-ab90-d49320168479]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:25:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6af0374c-a5b9-42d2-838e-65f0591dfd2c tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5b185bcc-4368-416f-865e-dede93131007 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:01 devstack sudo[96043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5b185bcc-4368-416f-865e-dede93131007 Jun 02 03:25:01 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:01 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b2c84ba2-c392-4e9f-a40e-cdc755fb813f tempest-VolumesListAdminTestJSON-223638558 None] Acquiring lock "cinder-952034cf-649b-4360-aed5-3685751545da-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:01 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b2c84ba2-c392-4e9f-a40e-cdc755fb813f tempest-VolumesListAdminTestJSON-223638558 None] Lock "cinder-952034cf-649b-4360-aed5-3685751545da-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:01 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b2c84ba2-c392-4e9f-a40e-cdc755fb813f tempest-VolumesListAdminTestJSON-223638558 None] Acquiring lock "cinder-quobyte-952034cf-649b-4360-aed5-3685751545da" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:01 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b2c84ba2-c392-4e9f-a40e-cdc755fb813f tempest-VolumesListAdminTestJSON-223638558 None] Lock "cinder-quobyte-952034cf-649b-4360-aed5-3685751545da" acquired by "delete_volume" :: waited 0.016s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:01 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac77abf5-e0a0-4900-810a-f831e46c8882]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:25:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b2c84ba2-c392-4e9f-a40e-cdc755fb813f tempest-VolumesListAdminTestJSON-223638558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-952034cf-649b-4360-aed5-3685751545da {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:01 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-952034cf-649b-4360-aed5-3685751545da Jun 02 03:25:01 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:01 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6af0374c-a5b9-42d2-838e-65f0591dfd2c tempest-VolumeQuotasNegativeTestJSON-1241545311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5b185bcc-4368-416f-865e-dede93131007" returned: 0 in 0.908s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6af0374c-a5b9-42d2-838e-65f0591dfd2c tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5b185bcc-4368-416f-865e-dede93131007 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:01 devstack sudo[96053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5b185bcc-4368-416f-865e-dede93131007 Jun 02 03:25:01 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:02 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b2c84ba2-c392-4e9f-a40e-cdc755fb813f tempest-VolumesListAdminTestJSON-223638558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-952034cf-649b-4360-aed5-3685751545da" returned: 0 in 0.904s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b2c84ba2-c392-4e9f-a40e-cdc755fb813f tempest-VolumesListAdminTestJSON-223638558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-952034cf-649b-4360-aed5-3685751545da {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:02 devstack sudo[96059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-952034cf-649b-4360-aed5-3685751545da Jun 02 03:25:02 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:02 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6af0374c-a5b9-42d2-838e-65f0591dfd2c tempest-VolumeQuotasNegativeTestJSON-1241545311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5b185bcc-4368-416f-865e-dede93131007" returned: 0 in 0.694s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:02 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6af0374c-a5b9-42d2-838e-65f0591dfd2c tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Lock "cinder-quobyte-5b185bcc-4368-416f-865e-dede93131007" released by "delete_volume" :: held 1.665s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:25:02 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-6af0374c-a5b9-42d2-838e-65f0591dfd2c tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Created reservations ['11eacf3f-5062-432e-a159-a4fd90ee8f64', 'c70ab4f8-4444-47db-9a78-5f838141b2e6', '3e808c41-6f72-4991-8a1f-17582ef27938', '9e463e44-0626-4484-a359-064e5ae34ebb'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:25:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6af0374c-a5b9-42d2-838e-65f0591dfd2c tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6af0374c-a5b9-42d2-838e-65f0591dfd2c tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:02 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6af0374c-a5b9-42d2-838e-65f0591dfd2c tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:25:02 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6af0374c-a5b9-42d2-838e-65f0591dfd2c tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:25:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6af0374c-a5b9-42d2-838e-65f0591dfd2c tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:25:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6af0374c-a5b9-42d2-838e-65f0591dfd2c tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:02 devstack sudo[96063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:25:02 devstack sudo[96063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:02 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b2c84ba2-c392-4e9f-a40e-cdc755fb813f tempest-VolumesListAdminTestJSON-223638558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-952034cf-649b-4360-aed5-3685751545da" returned: 0 in 0.668s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:02 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b2c84ba2-c392-4e9f-a40e-cdc755fb813f tempest-VolumesListAdminTestJSON-223638558 None] Lock "cinder-quobyte-952034cf-649b-4360-aed5-3685751545da" released by "delete_volume" :: held 1.626s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:25:02 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-b2c84ba2-c392-4e9f-a40e-cdc755fb813f tempest-VolumesListAdminTestJSON-223638558 None] Created reservations ['38669924-98e6-4350-a240-d8b75fce9b67', 'c692173f-c9d2-43a6-9d60-c2d9c76f8c73', '27f7baef-9c18-4fcf-abb6-b76a9f7e8706', 'fdce83fc-fb40-4572-81d7-557c22d4e2e9'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:25:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b2c84ba2-c392-4e9f-a40e-cdc755fb813f tempest-VolumesListAdminTestJSON-223638558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b2c84ba2-c392-4e9f-a40e-cdc755fb813f tempest-VolumesListAdminTestJSON-223638558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:03 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b2c84ba2-c392-4e9f-a40e-cdc755fb813f tempest-VolumesListAdminTestJSON-223638558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:25:03 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b2c84ba2-c392-4e9f-a40e-cdc755fb813f tempest-VolumesListAdminTestJSON-223638558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:25:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b2c84ba2-c392-4e9f-a40e-cdc755fb813f tempest-VolumesListAdminTestJSON-223638558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:25:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b2c84ba2-c392-4e9f-a40e-cdc755fb813f tempest-VolumesListAdminTestJSON-223638558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:03 devstack sudo[96066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:25:03 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:03 devstack sudo[96063]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6af0374c-a5b9-42d2-838e-65f0591dfd2c tempest-VolumeQuotasNegativeTestJSON-1241545311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.760s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:03 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-6af0374c-a5b9-42d2-838e-65f0591dfd2c tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:25:03 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-6af0374c-a5b9-42d2-838e-65f0591dfd2c tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Deleted volume successfully. Jun 02 03:25:03 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6af0374c-a5b9-42d2-838e-65f0591dfd2c tempest-VolumeQuotasNegativeTestJSON-1241545311 None] Lock "cinder-5b185bcc-4368-416f-865e-dede93131007-delete_volume" released by "delete_volume" :: held 2.675s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:25:03 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b2c84ba2-c392-4e9f-a40e-cdc755fb813f tempest-VolumesListAdminTestJSON-223638558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.819s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:03 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-b2c84ba2-c392-4e9f-a40e-cdc755fb813f tempest-VolumesListAdminTestJSON-223638558 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:25:03 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-b2c84ba2-c392-4e9f-a40e-cdc755fb813f tempest-VolumesListAdminTestJSON-223638558 None] Deleted volume successfully. Jun 02 03:25:03 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b2c84ba2-c392-4e9f-a40e-cdc755fb813f tempest-VolumesListAdminTestJSON-223638558 None] Lock "cinder-952034cf-649b-4360-aed5-3685751545da-delete_volume" released by "delete_volume" :: held 2.688s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:25:08 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3aa3232-c317-45f4-8486-9d941853b0ea tempest-SnapshotsActionsTest-1531810083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:25:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b3aa3232-c317-45f4-8486-9d941853b0ea tempest-SnapshotsActionsTest-1531810083 None] Flow 'volume_create_manager' (daa1ec9b-4b70-4f9d-a1bd-59e313ccf8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:25:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b3aa3232-c317-45f4-8486-9d941853b0ea tempest-SnapshotsActionsTest-1531810083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdc18f97-fb31-4623-9e27-a32534c24d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b3aa3232-c317-45f4-8486-9d941853b0ea tempest-SnapshotsActionsTest-1531810083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdc18f97-fb31-4623-9e27-a32534c24d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2019820819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eacdf65-0ba7-4817-8477-d79f05c256c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfbb26207f1845b495cc87f32212f793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:25:08Z,use_quota=True,user_id='e7a021f120c84e5c88713e4cf13a2615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b3aa3232-c317-45f4-8486-9d941853b0ea tempest-SnapshotsActionsTest-1531810083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (493b5384-899a-4038-a1ce-23833961def6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b3aa3232-c317-45f4-8486-9d941853b0ea tempest-SnapshotsActionsTest-1531810083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (493b5384-899a-4038-a1ce-23833961def6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b3aa3232-c317-45f4-8486-9d941853b0ea tempest-SnapshotsActionsTest-1531810083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a163f2-fdc7-4ef8-9468-ea5b28f98b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b3aa3232-c317-45f4-8486-9d941853b0ea tempest-SnapshotsActionsTest-1531810083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a163f2-fdc7-4ef8-9468-ea5b28f98b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eacdf65-0ba7-4817-8477-d79f05c256c9', 'volume_name': 'volume-7eacdf65-0ba7-4817-8477-d79f05c256c9', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b3aa3232-c317-45f4-8486-9d941853b0ea tempest-SnapshotsActionsTest-1531810083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3466019-4d7d-49d2-a1db-899919700e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b3aa3232-c317-45f4-8486-9d941853b0ea tempest-SnapshotsActionsTest-1531810083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3466019-4d7d-49d2-a1db-899919700e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b3aa3232-c317-45f4-8486-9d941853b0ea tempest-SnapshotsActionsTest-1531810083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b3ef2b0-0556-44e0-84fa-192276b49645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:08 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-b3aa3232-c317-45f4-8486-9d941853b0ea tempest-SnapshotsActionsTest-1531810083 None] Volume 7eacdf65-0ba7-4817-8477-d79f05c256c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eacdf65-0ba7-4817-8477-d79f05c256c9', 'volume_size': 1} Jun 02 03:25:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b3aa3232-c317-45f4-8486-9d941853b0ea tempest-SnapshotsActionsTest-1531810083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b3aa3232-c317-45f4-8486-9d941853b0ea tempest-SnapshotsActionsTest-1531810083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:08 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b3aa3232-c317-45f4-8486-9d941853b0ea tempest-SnapshotsActionsTest-1531810083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2019820819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eacdf65-0ba7-4817-8477-d79f05c256c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfbb26207f1845b495cc87f32212f793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:25:08Z,use_quota=True,user_id='e7a021f120c84e5c88713e4cf13a2615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:25:08 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-b3aa3232-c317-45f4-8486-9d941853b0ea tempest-SnapshotsActionsTest-1531810083 None] Creating volume 7eacdf65-0ba7-4817-8477-d79f05c256c9 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:25:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b3aa3232-c317-45f4-8486-9d941853b0ea tempest-SnapshotsActionsTest-1531810083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b3aa3232-c317-45f4-8486-9d941853b0ea tempest-SnapshotsActionsTest-1531810083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:08 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b3aa3232-c317-45f4-8486-9d941853b0ea tempest-SnapshotsActionsTest-1531810083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:25:08 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b3aa3232-c317-45f4-8486-9d941853b0ea tempest-SnapshotsActionsTest-1531810083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:25:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b3aa3232-c317-45f4-8486-9d941853b0ea tempest-SnapshotsActionsTest-1531810083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:25:08 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b3aa3232-c317-45f4-8486-9d941853b0ea tempest-SnapshotsActionsTest-1531810083 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:25:08 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-b3aa3232-c317-45f4-8486-9d941853b0ea tempest-SnapshotsActionsTest-1531810083 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:25:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b3aa3232-c317-45f4-8486-9d941853b0ea tempest-SnapshotsActionsTest-1531810083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:08 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9 1073741824 Jun 02 03:25:08 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:09 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:25:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:25:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:25:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:25:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:09 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:25:09 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:10 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b3aa3232-c317-45f4-8486-9d941853b0ea tempest-SnapshotsActionsTest-1531810083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9 1073741824" returned: 0 in 1.642s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b3aa3232-c317-45f4-8486-9d941853b0ea tempest-SnapshotsActionsTest-1531810083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:10 devstack sudo[96481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9 Jun 02 03:25:10 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:10 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 1.339s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:10 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:25:10 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager._thread_info {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:25:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread count: 8 {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 02 03:25:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread info: [<_MainThread(MainThread, started 138618128814208)>, , , , , , , ] {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 02 03:25:11 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b3aa3232-c317-45f4-8486-9d941853b0ea tempest-SnapshotsActionsTest-1531810083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9" returned: 0 in 1.103s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b3aa3232-c317-45f4-8486-9d941853b0ea tempest-SnapshotsActionsTest-1531810083 None] <== create_volume: return (2841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:25:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b3aa3232-c317-45f4-8486-9d941853b0ea tempest-SnapshotsActionsTest-1531810083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.851s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:25:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b3aa3232-c317-45f4-8486-9d941853b0ea tempest-SnapshotsActionsTest-1531810083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b3ef2b0-0556-44e0-84fa-192276b49645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eacdf65-0ba7-4817-8477-d79f05c256c9', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b3aa3232-c317-45f4-8486-9d941853b0ea tempest-SnapshotsActionsTest-1531810083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b4a82ad-e9fc-474f-afdb-0ada9cf09d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:11 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-b3aa3232-c317-45f4-8486-9d941853b0ea tempest-SnapshotsActionsTest-1531810083 None] Volume volume-7eacdf65-0ba7-4817-8477-d79f05c256c9 (7eacdf65-0ba7-4817-8477-d79f05c256c9): created successfully Jun 02 03:25:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b3aa3232-c317-45f4-8486-9d941853b0ea tempest-SnapshotsActionsTest-1531810083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b4a82ad-e9fc-474f-afdb-0ada9cf09d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b3aa3232-c317-45f4-8486-9d941853b0ea tempest-SnapshotsActionsTest-1531810083 None] Flow 'volume_create_manager' (daa1ec9b-4b70-4f9d-a1bd-59e313ccf8f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:25:11 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-b3aa3232-c317-45f4-8486-9d941853b0ea tempest-SnapshotsActionsTest-1531810083 None] Created volume successfully. Jun 02 03:25:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-13b1749b-2c58-4d08-add7-c5e9d34ce1f5 tempest-SnapshotsActionsTest-1531810083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-13b1749b-2c58-4d08-add7-c5e9d34ce1f5 tempest-SnapshotsActionsTest-1531810083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-13b1749b-2c58-4d08-add7-c5e9d34ce1f5 tempest-SnapshotsActionsTest-1531810083 None] Creating offline snapshot 8ce326a5-4e31-4bed-b874-3c712a6d14d2 of volume 7eacdf65-0ba7-4817-8477-d79f05c256c9 {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:25:11 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed79e5f-25f7-42e9-a898-c97235329766]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:25:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-13b1749b-2c58-4d08-add7-c5e9d34ce1f5 tempest-SnapshotsActionsTest-1531810083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:12 devstack sudo[96612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9 Jun 02 03:25:12 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:12 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-13b1749b-2c58-4d08-add7-c5e9d34ce1f5 tempest-SnapshotsActionsTest-1531810083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9" returned: 0 in 0.960s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-13b1749b-2c58-4d08-add7-c5e9d34ce1f5 tempest-SnapshotsActionsTest-1531810083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:12 devstack sudo[96619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 1G Jun 02 03:25:12 devstack sudo[96619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:13 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c2840c9-f1aa-47bf-a210-3af9f0a73332 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:25:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3c2840c9-f1aa-47bf-a210-3af9f0a73332 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Flow 'volume_create_manager' (0c75f68b-2c65-414d-b8e3-1625917a6902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:25:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3c2840c9-f1aa-47bf-a210-3af9f0a73332 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c2b0e3-3d56-4703-9934-bb80e8f78bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3c2840c9-f1aa-47bf-a210-3af9f0a73332 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c2b0e3-3d56-4703-9934-bb80e8f78bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-6423587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa91c344e290409892b3fca250c8a19e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:25:13Z,use_quota=True,user_id='94527010a1144ff088211765c6c3baae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3c2840c9-f1aa-47bf-a210-3af9f0a73332 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6ffc9dd-88e4-4a5a-bec4-11c12e227fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3c2840c9-f1aa-47bf-a210-3af9f0a73332 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6ffc9dd-88e4-4a5a-bec4-11c12e227fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3c2840c9-f1aa-47bf-a210-3af9f0a73332 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8316cadc-b480-4bc0-bf57-0a16cc77eda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3c2840c9-f1aa-47bf-a210-3af9f0a73332 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8316cadc-b480-4bc0-bf57-0a16cc77eda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956', 'volume_name': 'volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3c2840c9-f1aa-47bf-a210-3af9f0a73332 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5557fefe-746e-406f-b275-aac67c5e3543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3c2840c9-f1aa-47bf-a210-3af9f0a73332 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5557fefe-746e-406f-b275-aac67c5e3543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3c2840c9-f1aa-47bf-a210-3af9f0a73332 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87892001-dbde-44c1-a3d1-4b5edb5291d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:13 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-3c2840c9-f1aa-47bf-a210-3af9f0a73332 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Volume 5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956', 'volume_size': 1} Jun 02 03:25:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3c2840c9-f1aa-47bf-a210-3af9f0a73332 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:13 devstack sudo[96619]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-13b1749b-2c58-4d08-add7-c5e9d34ce1f5 tempest-SnapshotsActionsTest-1531810083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 1G" returned: 0 in 0.836s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-13b1749b-2c58-4d08-add7-c5e9d34ce1f5 tempest-SnapshotsActionsTest-1531810083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eacdf65-0ba7-4817-8477-d79f05c256c9 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:13 devstack sudo[96625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eacdf65-0ba7-4817-8477-d79f05c256c9 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 Jun 02 03:25:13 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:14 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-13b1749b-2c58-4d08-add7-c5e9d34ce1f5 tempest-SnapshotsActionsTest-1531810083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eacdf65-0ba7-4817-8477-d79f05c256c9 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2" returned: 0 in 0.685s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:14 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-13b1749b-2c58-4d08-add7-c5e9d34ce1f5 tempest-SnapshotsActionsTest-1531810083 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 is being set with open permissions: ugo+rw Jun 02 03:25:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-13b1749b-2c58-4d08-add7-c5e9d34ce1f5 tempest-SnapshotsActionsTest-1531810083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:14 devstack sudo[96630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 Jun 02 03:25:14 devstack sudo[96630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:15 devstack sudo[96630]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-13b1749b-2c58-4d08-add7-c5e9d34ce1f5 tempest-SnapshotsActionsTest-1531810083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2" returned: 0 in 0.611s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-13b1749b-2c58-4d08-add7-c5e9d34ce1f5 tempest-SnapshotsActionsTest-1531810083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:15 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.info Jun 02 03:25:15 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:15 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-13b1749b-2c58-4d08-add7-c5e9d34ce1f5 tempest-SnapshotsActionsTest-1531810083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.info" returned: 0 in 0.626s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:15 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-13b1749b-2c58-4d08-add7-c5e9d34ce1f5 tempest-SnapshotsActionsTest-1531810083 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.info is being set with open permissions: ugo+rw Jun 02 03:25:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-13b1749b-2c58-4d08-add7-c5e9d34ce1f5 tempest-SnapshotsActionsTest-1531810083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:15 devstack sudo[96637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.info Jun 02 03:25:15 devstack sudo[96637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:16 devstack sudo[96637]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-13b1749b-2c58-4d08-add7-c5e9d34ce1f5 tempest-SnapshotsActionsTest-1531810083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.info" returned: 0 in 0.602s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-13b1749b-2c58-4d08-add7-c5e9d34ce1f5 tempest-SnapshotsActionsTest-1531810083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.430s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:25:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3c2840c9-f1aa-47bf-a210-3af9f0a73332 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.955s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:16 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3c2840c9-f1aa-47bf-a210-3af9f0a73332 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-6423587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa91c344e290409892b3fca250c8a19e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:25:13Z,use_quota=True,user_id='94527010a1144ff088211765c6c3baae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:25:16 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-3c2840c9-f1aa-47bf-a210-3af9f0a73332 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Creating volume 5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:25:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3c2840c9-f1aa-47bf-a210-3af9f0a73332 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3c2840c9-f1aa-47bf-a210-3af9f0a73332 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:16 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3c2840c9-f1aa-47bf-a210-3af9f0a73332 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:25:16 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3c2840c9-f1aa-47bf-a210-3af9f0a73332 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:25:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3c2840c9-f1aa-47bf-a210-3af9f0a73332 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:25:16 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3c2840c9-f1aa-47bf-a210-3af9f0a73332 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:25:16 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-3c2840c9-f1aa-47bf-a210-3af9f0a73332 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:25:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3c2840c9-f1aa-47bf-a210-3af9f0a73332 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:16 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956 1073741824 Jun 02 03:25:16 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:16 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-13b1749b-2c58-4d08-add7-c5e9d34ce1f5 tempest-SnapshotsActionsTest-1531810083 None] Create snapshot completed successfully Jun 02 03:25:17 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-781eb69f-1741-4745-a3fb-c32d089bb3fa tempest-VolumesMetadataTest-568972207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:25:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-781eb69f-1741-4745-a3fb-c32d089bb3fa tempest-VolumesMetadataTest-568972207 None] Flow 'volume_create_manager' (5d7bc123-4548-4de3-9c7d-c260e5904784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:25:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-781eb69f-1741-4745-a3fb-c32d089bb3fa tempest-VolumesMetadataTest-568972207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3293dfe9-6e96-465b-8dc8-585e8428e564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-781eb69f-1741-4745-a3fb-c32d089bb3fa tempest-VolumesMetadataTest-568972207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3293dfe9-6e96-465b-8dc8-585e8428e564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1062403440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb3e96c2-6df4-4b42-8ace-cf7820606a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7574fe63ab53416dbd023b45baa0f286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:25:17Z,use_quota=True,user_id='ed81475084ec43b58885fd30153e01b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-781eb69f-1741-4745-a3fb-c32d089bb3fa tempest-VolumesMetadataTest-568972207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a067721-64b0-4da3-b4b8-70d16a6d3086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-781eb69f-1741-4745-a3fb-c32d089bb3fa tempest-VolumesMetadataTest-568972207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a067721-64b0-4da3-b4b8-70d16a6d3086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-781eb69f-1741-4745-a3fb-c32d089bb3fa tempest-VolumesMetadataTest-568972207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (470242e1-e35a-4ecd-a265-dc7d5d226f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-781eb69f-1741-4745-a3fb-c32d089bb3fa tempest-VolumesMetadataTest-568972207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (470242e1-e35a-4ecd-a265-dc7d5d226f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb3e96c2-6df4-4b42-8ace-cf7820606a0a', 'volume_name': 'volume-eb3e96c2-6df4-4b42-8ace-cf7820606a0a', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-781eb69f-1741-4745-a3fb-c32d089bb3fa tempest-VolumesMetadataTest-568972207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d46244cb-9c27-41d4-87ee-af7b7806b2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-781eb69f-1741-4745-a3fb-c32d089bb3fa tempest-VolumesMetadataTest-568972207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d46244cb-9c27-41d4-87ee-af7b7806b2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-781eb69f-1741-4745-a3fb-c32d089bb3fa tempest-VolumesMetadataTest-568972207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfcc6c92-80af-4288-9069-c7e03f3f3769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:17 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-781eb69f-1741-4745-a3fb-c32d089bb3fa tempest-VolumesMetadataTest-568972207 None] Volume eb3e96c2-6df4-4b42-8ace-cf7820606a0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb3e96c2-6df4-4b42-8ace-cf7820606a0a', 'volume_size': 1} Jun 02 03:25:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-781eb69f-1741-4745-a3fb-c32d089bb3fa tempest-VolumesMetadataTest-568972207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:17 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3c2840c9-f1aa-47bf-a210-3af9f0a73332 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956 1073741824" returned: 0 in 0.973s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3c2840c9-f1aa-47bf-a210-3af9f0a73332 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:17 devstack sudo[96647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956 Jun 02 03:25:17 devstack sudo[96647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-aa2acfa5-82a3-4189-a064-d348babdee0a tempest-SnapshotsActionsTest-1531810083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:18 devstack sudo[96647]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3c2840c9-f1aa-47bf-a210-3af9f0a73332 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956" returned: 0 in 0.635s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:18 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3c2840c9-f1aa-47bf-a210-3af9f0a73332 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:25:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3c2840c9-f1aa-47bf-a210-3af9f0a73332 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:25:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-781eb69f-1741-4745-a3fb-c32d089bb3fa tempest-VolumesMetadataTest-568972207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.735s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:18 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-781eb69f-1741-4745-a3fb-c32d089bb3fa tempest-VolumesMetadataTest-568972207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1062403440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb3e96c2-6df4-4b42-8ace-cf7820606a0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7574fe63ab53416dbd023b45baa0f286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:25:17Z,use_quota=True,user_id='ed81475084ec43b58885fd30153e01b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:25:18 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-781eb69f-1741-4745-a3fb-c32d089bb3fa tempest-VolumesMetadataTest-568972207 None] Creating volume eb3e96c2-6df4-4b42-8ace-cf7820606a0a {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:25:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-781eb69f-1741-4745-a3fb-c32d089bb3fa tempest-VolumesMetadataTest-568972207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-781eb69f-1741-4745-a3fb-c32d089bb3fa tempest-VolumesMetadataTest-568972207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:18 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-781eb69f-1741-4745-a3fb-c32d089bb3fa tempest-VolumesMetadataTest-568972207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:25:18 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-781eb69f-1741-4745-a3fb-c32d089bb3fa tempest-VolumesMetadataTest-568972207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:25:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-781eb69f-1741-4745-a3fb-c32d089bb3fa tempest-VolumesMetadataTest-568972207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:25:18 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-781eb69f-1741-4745-a3fb-c32d089bb3fa tempest-VolumesMetadataTest-568972207 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:25:18 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-781eb69f-1741-4745-a3fb-c32d089bb3fa tempest-VolumesMetadataTest-568972207 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:25:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-781eb69f-1741-4745-a3fb-c32d089bb3fa tempest-VolumesMetadataTest-568972207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-eb3e96c2-6df4-4b42-8ace-cf7820606a0a 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:18 devstack sudo[96650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-eb3e96c2-6df4-4b42-8ace-cf7820606a0a 1073741824 Jun 02 03:25:18 devstack sudo[96650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3c2840c9-f1aa-47bf-a210-3af9f0a73332 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87892001-dbde-44c1-a3d1-4b5edb5291d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3c2840c9-f1aa-47bf-a210-3af9f0a73332 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8018d6a4-4176-47bb-9656-6156734da8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:18 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-3c2840c9-f1aa-47bf-a210-3af9f0a73332 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Volume volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956 (5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956): created successfully Jun 02 03:25:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3c2840c9-f1aa-47bf-a210-3af9f0a73332 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8018d6a4-4176-47bb-9656-6156734da8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3c2840c9-f1aa-47bf-a210-3af9f0a73332 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Flow 'volume_create_manager' (0c75f68b-2c65-414d-b8e3-1625917a6902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:25:18 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-3c2840c9-f1aa-47bf-a210-3af9f0a73332 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Created volume successfully. Jun 02 03:25:18 devstack sudo[96650]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-781eb69f-1741-4745-a3fb-c32d089bb3fa tempest-VolumesMetadataTest-568972207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-eb3e96c2-6df4-4b42-8ace-cf7820606a0a 1073741824" returned: 0 in 0.882s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9e5fb179-591e-4940-ad89-5cc91ce07854 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-781eb69f-1741-4745-a3fb-c32d089bb3fa tempest-VolumesMetadataTest-568972207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-eb3e96c2-6df4-4b42-8ace-cf7820606a0a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:18 devstack sudo[96657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-eb3e96c2-6df4-4b42-8ace-cf7820606a0a Jun 02 03:25:19 devstack sudo[96657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:19 devstack sudo[96657]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-781eb69f-1741-4745-a3fb-c32d089bb3fa tempest-VolumesMetadataTest-568972207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-eb3e96c2-6df4-4b42-8ace-cf7820606a0a" returned: 0 in 0.637s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:19 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-781eb69f-1741-4745-a3fb-c32d089bb3fa tempest-VolumesMetadataTest-568972207 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:25:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-781eb69f-1741-4745-a3fb-c32d089bb3fa tempest-VolumesMetadataTest-568972207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:25:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-aa2acfa5-82a3-4189-a064-d348babdee0a tempest-SnapshotsActionsTest-1531810083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.746s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-781eb69f-1741-4745-a3fb-c32d089bb3fa tempest-VolumesMetadataTest-568972207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfcc6c92-80af-4288-9069-c7e03f3f3769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb3e96c2-6df4-4b42-8ace-cf7820606a0a', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-781eb69f-1741-4745-a3fb-c32d089bb3fa tempest-VolumesMetadataTest-568972207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c5baf00-3bd7-407c-ac21-df9288dac614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:19 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-aa2acfa5-82a3-4189-a064-d348babdee0a tempest-SnapshotsActionsTest-1531810083 None] Creating offline snapshot a5310a69-83e2-4c84-99f7-392faba143c9 of volume 7eacdf65-0ba7-4817-8477-d79f05c256c9 {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:25:19 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-781eb69f-1741-4745-a3fb-c32d089bb3fa tempest-VolumesMetadataTest-568972207 None] Volume volume-eb3e96c2-6df4-4b42-8ace-cf7820606a0a (eb3e96c2-6df4-4b42-8ace-cf7820606a0a): created successfully Jun 02 03:25:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-781eb69f-1741-4745-a3fb-c32d089bb3fa tempest-VolumesMetadataTest-568972207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c5baf00-3bd7-407c-ac21-df9288dac614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-781eb69f-1741-4745-a3fb-c32d089bb3fa tempest-VolumesMetadataTest-568972207 None] Flow 'volume_create_manager' (5d7bc123-4548-4de3-9c7d-c260e5904784) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:25:19 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0878b4c-0f35-4132-8775-48669958c9cd]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:25:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-aa2acfa5-82a3-4189-a064-d348babdee0a tempest-SnapshotsActionsTest-1531810083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:19 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-781eb69f-1741-4745-a3fb-c32d089bb3fa tempest-VolumesMetadataTest-568972207 None] Created volume successfully. Jun 02 03:25:19 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 Jun 02 03:25:19 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:20 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-aa2acfa5-82a3-4189-a064-d348babdee0a tempest-SnapshotsActionsTest-1531810083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2" returned: 0 in 0.841s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-aa2acfa5-82a3-4189-a064-d348babdee0a tempest-SnapshotsActionsTest-1531810083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7eacdf65-0ba7-4817-8477-d79f05c256c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:25:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-aa2acfa5-82a3-4189-a064-d348babdee0a tempest-SnapshotsActionsTest-1531810083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.a5310a69-83e2-4c84-99f7-392faba143c9 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:20 devstack sudo[96702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.a5310a69-83e2-4c84-99f7-392faba143c9 1G Jun 02 03:25:20 devstack sudo[96702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:21 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-801898ba-5234-48c9-be7d-7cb46e6ba0b5 tempest-VolumesMetadataTest-568972207 None] Acquiring lock "cinder-eb3e96c2-6df4-4b42-8ace-cf7820606a0a-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:21 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-801898ba-5234-48c9-be7d-7cb46e6ba0b5 tempest-VolumesMetadataTest-568972207 None] Lock "cinder-eb3e96c2-6df4-4b42-8ace-cf7820606a0a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:21 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-801898ba-5234-48c9-be7d-7cb46e6ba0b5 tempest-VolumesMetadataTest-568972207 None] Acquiring lock "cinder-quobyte-eb3e96c2-6df4-4b42-8ace-cf7820606a0a" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:21 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-801898ba-5234-48c9-be7d-7cb46e6ba0b5 tempest-VolumesMetadataTest-568972207 None] Lock "cinder-quobyte-eb3e96c2-6df4-4b42-8ace-cf7820606a0a" acquired by "delete_volume" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:21 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fadf264-6fd1-4b4b-abe7-d04441afbb9e]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:25:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-801898ba-5234-48c9-be7d-7cb46e6ba0b5 tempest-VolumesMetadataTest-568972207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-eb3e96c2-6df4-4b42-8ace-cf7820606a0a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:21 devstack sudo[96708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-eb3e96c2-6df4-4b42-8ace-cf7820606a0a Jun 02 03:25:21 devstack sudo[96708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:21 devstack sudo[96702]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-aa2acfa5-82a3-4189-a064-d348babdee0a tempest-SnapshotsActionsTest-1531810083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.a5310a69-83e2-4c84-99f7-392faba143c9 1G" returned: 0 in 0.899s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-aa2acfa5-82a3-4189-a064-d348babdee0a tempest-SnapshotsActionsTest-1531810083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.a5310a69-83e2-4c84-99f7-392faba143c9 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:21 devstack sudo[96711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.a5310a69-83e2-4c84-99f7-392faba143c9 Jun 02 03:25:21 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:22 devstack sudo[96708]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-801898ba-5234-48c9-be7d-7cb46e6ba0b5 tempest-VolumesMetadataTest-568972207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-eb3e96c2-6df4-4b42-8ace-cf7820606a0a" returned: 0 in 0.801s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-801898ba-5234-48c9-be7d-7cb46e6ba0b5 tempest-VolumesMetadataTest-568972207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-eb3e96c2-6df4-4b42-8ace-cf7820606a0a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:22 devstack sudo[96719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-eb3e96c2-6df4-4b42-8ace-cf7820606a0a Jun 02 03:25:22 devstack sudo[96719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:22 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-aa2acfa5-82a3-4189-a064-d348babdee0a tempest-SnapshotsActionsTest-1531810083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.a5310a69-83e2-4c84-99f7-392faba143c9" returned: 0 in 0.712s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:22 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-aa2acfa5-82a3-4189-a064-d348babdee0a tempest-SnapshotsActionsTest-1531810083 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.a5310a69-83e2-4c84-99f7-392faba143c9 is being set with open permissions: ugo+rw Jun 02 03:25:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-aa2acfa5-82a3-4189-a064-d348babdee0a tempest-SnapshotsActionsTest-1531810083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.a5310a69-83e2-4c84-99f7-392faba143c9 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:22 devstack sudo[96721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.a5310a69-83e2-4c84-99f7-392faba143c9 Jun 02 03:25:22 devstack sudo[96721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:22 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-a5c0a381-fa18-4044-a3f6-abdfb809d395 tempest-VolumesNegativeTest-2135440357 None] Acquiring lock "cinder-7078cc09-c373-49fe-b91d-dcf65f8ef55c-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:22 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-a5c0a381-fa18-4044-a3f6-abdfb809d395 tempest-VolumesNegativeTest-2135440357 None] Lock "cinder-7078cc09-c373-49fe-b91d-dcf65f8ef55c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:22 devstack sudo[96719]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-801898ba-5234-48c9-be7d-7cb46e6ba0b5 tempest-VolumesMetadataTest-568972207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-eb3e96c2-6df4-4b42-8ace-cf7820606a0a" returned: 0 in 0.622s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:22 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-801898ba-5234-48c9-be7d-7cb46e6ba0b5 tempest-VolumesMetadataTest-568972207 None] Lock "cinder-quobyte-eb3e96c2-6df4-4b42-8ace-cf7820606a0a" released by "delete_volume" :: held 1.471s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:25:22 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-a5c0a381-fa18-4044-a3f6-abdfb809d395 tempest-VolumesNegativeTest-2135440357 None] Acquiring lock "cinder-quobyte-7078cc09-c373-49fe-b91d-dcf65f8ef55c" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:22 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-a5c0a381-fa18-4044-a3f6-abdfb809d395 tempest-VolumesNegativeTest-2135440357 None] Lock "cinder-quobyte-7078cc09-c373-49fe-b91d-dcf65f8ef55c" acquired by "delete_volume" :: waited 0.022s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:22 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[8534b765-acd2-4a89-8632-cfbd3da67807]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:25:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a5c0a381-fa18-4044-a3f6-abdfb809d395 tempest-VolumesNegativeTest-2135440357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7078cc09-c373-49fe-b91d-dcf65f8ef55c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:22 devstack sudo[96721]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-aa2acfa5-82a3-4189-a064-d348babdee0a tempest-SnapshotsActionsTest-1531810083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.a5310a69-83e2-4c84-99f7-392faba143c9" returned: 0 in 0.643s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-aa2acfa5-82a3-4189-a064-d348babdee0a tempest-SnapshotsActionsTest-1531810083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.221s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:25:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9e5fb179-591e-4940-ad89-5cc91ce07854 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.892s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:22 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-801898ba-5234-48c9-be7d-7cb46e6ba0b5 tempest-VolumesMetadataTest-568972207 None] Created reservations ['dcd63c47-14cf-47b0-89f5-d1731d8188d6', 'c7e5de10-5103-4f96-bc99-6e4549809838', '8fcfc10d-7e89-4b6a-8363-420bd9fe5406', 'fec0cffe-5fc4-4935-bee2-0cea36e1508c'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:25:22 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-9e5fb179-591e-4940-ad89-5cc91ce07854 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Creating offline snapshot e1841443-dcd7-45b3-8791-b8f74464b085 of volume 5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956 {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:25:22 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-aa2acfa5-82a3-4189-a064-d348babdee0a tempest-SnapshotsActionsTest-1531810083 None] Create snapshot completed successfully Jun 02 03:25:22 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5f15ee-9cab-452a-aea0-2cf5bac0c0d5]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:25:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9e5fb179-591e-4940-ad89-5cc91ce07854 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:22 devstack sudo[96726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7078cc09-c373-49fe-b91d-dcf65f8ef55c Jun 02 03:25:22 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-801898ba-5234-48c9-be7d-7cb46e6ba0b5 tempest-VolumesMetadataTest-568972207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-801898ba-5234-48c9-be7d-7cb46e6ba0b5 tempest-VolumesMetadataTest-568972207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:22 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-801898ba-5234-48c9-be7d-7cb46e6ba0b5 tempest-VolumesMetadataTest-568972207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:25:22 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-801898ba-5234-48c9-be7d-7cb46e6ba0b5 tempest-VolumesMetadataTest-568972207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:25:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-801898ba-5234-48c9-be7d-7cb46e6ba0b5 tempest-VolumesMetadataTest-568972207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:25:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-801898ba-5234-48c9-be7d-7cb46e6ba0b5 tempest-VolumesMetadataTest-568972207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:22 devstack sudo[96729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:25:22 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:23 devstack sudo[96728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956 Jun 02 03:25:23 devstack sudo[96728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:23 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-60ee72f3-22dc-4347-b039-fe8742865170 tempest-SnapshotsActionsTest-999197762 None] Acquiring lock "cinder-a5310a69-83e2-4c84-99f7-392faba143c9-delete_snapshot" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:23 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-60ee72f3-22dc-4347-b039-fe8742865170 tempest-SnapshotsActionsTest-999197762 None] Lock "cinder-a5310a69-83e2-4c84-99f7-392faba143c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:23 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-60ee72f3-22dc-4347-b039-fe8742865170 tempest-SnapshotsActionsTest-999197762 None] Acquiring lock "cinder-quobyte-7eacdf65-0ba7-4817-8477-d79f05c256c9" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:23 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-60ee72f3-22dc-4347-b039-fe8742865170 tempest-SnapshotsActionsTest-999197762 None] Lock "cinder-quobyte-7eacdf65-0ba7-4817-8477-d79f05c256c9" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:23 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-60ee72f3-22dc-4347-b039-fe8742865170 tempest-SnapshotsActionsTest-999197762 None] Acquiring lock "cinder-quobyte-a5310a69-83e2-4c84-99f7-392faba143c9" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:23 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-60ee72f3-22dc-4347-b039-fe8742865170 tempest-SnapshotsActionsTest-999197762 None] Lock "cinder-quobyte-a5310a69-83e2-4c84-99f7-392faba143c9" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:23 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-60ee72f3-22dc-4347-b039-fe8742865170 tempest-SnapshotsActionsTest-999197762 None] Deleting offline snapshot a5310a69-83e2-4c84-99f7-392faba143c9 of volume 7eacdf65-0ba7-4817-8477-d79f05c256c9 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:25:23 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-60ee72f3-22dc-4347-b039-fe8742865170 tempest-SnapshotsActionsTest-999197762 None] snapshot_file for this snap is: volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.a5310a69-83e2-4c84-99f7-392faba143c9 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:25:23 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[6652b15d-a0fd-4978-9c8d-d252ede99816]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:25:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-60ee72f3-22dc-4347-b039-fe8742865170 tempest-SnapshotsActionsTest-999197762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.a5310a69-83e2-4c84-99f7-392faba143c9 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:23 devstack sudo[96734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.a5310a69-83e2-4c84-99f7-392faba143c9 Jun 02 03:25:23 devstack sudo[96734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:23 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a5c0a381-fa18-4044-a3f6-abdfb809d395 tempest-VolumesNegativeTest-2135440357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7078cc09-c373-49fe-b91d-dcf65f8ef55c" returned: 0 in 0.915s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a5c0a381-fa18-4044-a3f6-abdfb809d395 tempest-VolumesNegativeTest-2135440357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7078cc09-c373-49fe-b91d-dcf65f8ef55c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:23 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7078cc09-c373-49fe-b91d-dcf65f8ef55c Jun 02 03:25:23 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:23 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-801898ba-5234-48c9-be7d-7cb46e6ba0b5 tempest-VolumesMetadataTest-568972207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.819s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:23 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-801898ba-5234-48c9-be7d-7cb46e6ba0b5 tempest-VolumesMetadataTest-568972207 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:25:23 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-801898ba-5234-48c9-be7d-7cb46e6ba0b5 tempest-VolumesMetadataTest-568972207 None] Deleted volume successfully. Jun 02 03:25:23 devstack sudo[96728]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9e5fb179-591e-4940-ad89-5cc91ce07854 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956" returned: 0 in 0.962s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9e5fb179-591e-4940-ad89-5cc91ce07854 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956.e1841443-dcd7-45b3-8791-b8f74464b085 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:23 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-801898ba-5234-48c9-be7d-7cb46e6ba0b5 tempest-VolumesMetadataTest-568972207 None] Lock "cinder-eb3e96c2-6df4-4b42-8ace-cf7820606a0a-delete_volume" released by "delete_volume" :: held 2.692s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:25:23 devstack sudo[96743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956.e1841443-dcd7-45b3-8791-b8f74464b085 1G Jun 02 03:25:23 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:24 devstack sudo[96734]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-60ee72f3-22dc-4347-b039-fe8742865170 tempest-SnapshotsActionsTest-999197762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.a5310a69-83e2-4c84-99f7-392faba143c9" returned: 0 in 0.962s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:24 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-60ee72f3-22dc-4347-b039-fe8742865170 tempest-SnapshotsActionsTest-999197762 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7eacdf65-0ba7-4817-8477-d79f05c256c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:25:24 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdd805a-4fd3-4f78-a961-f67c0c6dcb7d]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:25:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-60ee72f3-22dc-4347-b039-fe8742865170 tempest-SnapshotsActionsTest-999197762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:24 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a5c0a381-fa18-4044-a3f6-abdfb809d395 tempest-VolumesNegativeTest-2135440357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7078cc09-c373-49fe-b91d-dcf65f8ef55c" returned: 0 in 0.793s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:24 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-a5c0a381-fa18-4044-a3f6-abdfb809d395 tempest-VolumesNegativeTest-2135440357 None] Lock "cinder-quobyte-7078cc09-c373-49fe-b91d-dcf65f8ef55c" released by "delete_volume" :: held 1.761s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:25:24 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=150,cinder:UPDATE=165,cinder:INSERT=44,cinder:DELETE=12 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:25:24 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-a5c0a381-fa18-4044-a3f6-abdfb809d395 tempest-VolumesNegativeTest-2135440357 None] Created reservations ['59533908-d0e6-46d3-a82c-3bf6fa995db3', 'a78d00dd-b383-4296-93af-df268485c84a', '0f5c6495-f384-45a8-838f-e6d96ecda0b1', '4a81be41-4e29-40e0-83e5-f3342ddb08a2'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:25:24 devstack sudo[96749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 Jun 02 03:25:24 devstack sudo[96749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a5c0a381-fa18-4044-a3f6-abdfb809d395 tempest-VolumesNegativeTest-2135440357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a5c0a381-fa18-4044-a3f6-abdfb809d395 tempest-VolumesNegativeTest-2135440357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:24 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a5c0a381-fa18-4044-a3f6-abdfb809d395 tempest-VolumesNegativeTest-2135440357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:25:24 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a5c0a381-fa18-4044-a3f6-abdfb809d395 tempest-VolumesNegativeTest-2135440357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:25:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a5c0a381-fa18-4044-a3f6-abdfb809d395 tempest-VolumesNegativeTest-2135440357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:25:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a5c0a381-fa18-4044-a3f6-abdfb809d395 tempest-VolumesNegativeTest-2135440357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:24 devstack sudo[96754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:25:24 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:24 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9e5fb179-591e-4940-ad89-5cc91ce07854 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956.e1841443-dcd7-45b3-8791-b8f74464b085 1G" returned: 0 in 0.988s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9e5fb179-591e-4940-ad89-5cc91ce07854 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956.e1841443-dcd7-45b3-8791-b8f74464b085 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:24 devstack sudo[96756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956.e1841443-dcd7-45b3-8791-b8f74464b085 Jun 02 03:25:24 devstack sudo[96756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:25 devstack sudo[96749]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-60ee72f3-22dc-4347-b039-fe8742865170 tempest-SnapshotsActionsTest-999197762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2" returned: 0 in 1.001s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:25 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-60ee72f3-22dc-4347-b039-fe8742865170 tempest-SnapshotsActionsTest-999197762 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7eacdf65-0ba7-4817-8477-d79f05c256c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:25:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-60ee72f3-22dc-4347-b039-fe8742865170 tempest-SnapshotsActionsTest-999197762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.a5310a69-83e2-4c84-99f7-392faba143c9 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:25 devstack sudo[96763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.a5310a69-83e2-4c84-99f7-392faba143c9 Jun 02 03:25:25 devstack sudo[96763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:25 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a5c0a381-fa18-4044-a3f6-abdfb809d395 tempest-VolumesNegativeTest-2135440357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 1.014s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:25 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-a5c0a381-fa18-4044-a3f6-abdfb809d395 tempest-VolumesNegativeTest-2135440357 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:25:25 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-a5c0a381-fa18-4044-a3f6-abdfb809d395 tempest-VolumesNegativeTest-2135440357 None] Deleted volume successfully. Jun 02 03:25:25 devstack sudo[96756]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9e5fb179-591e-4940-ad89-5cc91ce07854 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956.e1841443-dcd7-45b3-8791-b8f74464b085" returned: 0 in 0.877s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:25 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-9e5fb179-591e-4940-ad89-5cc91ce07854 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956.e1841443-dcd7-45b3-8791-b8f74464b085 is being set with open permissions: ugo+rw Jun 02 03:25:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9e5fb179-591e-4940-ad89-5cc91ce07854 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956.e1841443-dcd7-45b3-8791-b8f74464b085 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:25 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-a5c0a381-fa18-4044-a3f6-abdfb809d395 tempest-VolumesNegativeTest-2135440357 None] Lock "cinder-7078cc09-c373-49fe-b91d-dcf65f8ef55c-delete_volume" released by "delete_volume" :: held 3.078s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:25:25 devstack sudo[96767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956.e1841443-dcd7-45b3-8791-b8f74464b085 Jun 02 03:25:25 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:26 devstack sudo[96763]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-60ee72f3-22dc-4347-b039-fe8742865170 tempest-SnapshotsActionsTest-999197762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.a5310a69-83e2-4c84-99f7-392faba143c9" returned: 0 in 0.897s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-60ee72f3-22dc-4347-b039-fe8742865170 tempest-SnapshotsActionsTest-999197762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.a5310a69-83e2-4c84-99f7-392faba143c9 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:26 devstack sudo[96775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.a5310a69-83e2-4c84-99f7-392faba143c9 Jun 02 03:25:26 devstack sudo[96775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:26 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9e5fb179-591e-4940-ad89-5cc91ce07854 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956.e1841443-dcd7-45b3-8791-b8f74464b085" returned: 0 in 0.699s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9e5fb179-591e-4940-ad89-5cc91ce07854 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:26 devstack sudo[96777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956.info Jun 02 03:25:26 devstack sudo[96777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:27 devstack sudo[96775]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-60ee72f3-22dc-4347-b039-fe8742865170 tempest-SnapshotsActionsTest-999197762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.a5310a69-83e2-4c84-99f7-392faba143c9" returned: 0 in 0.698s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:27 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-60ee72f3-22dc-4347-b039-fe8742865170 tempest-SnapshotsActionsTest-999197762 None] Lock "cinder-quobyte-a5310a69-83e2-4c84-99f7-392faba143c9" released by "_delete_snapshot" :: held 3.718s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:25:27 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-60ee72f3-22dc-4347-b039-fe8742865170 tempest-SnapshotsActionsTest-999197762 None] Lock "cinder-quobyte-7eacdf65-0ba7-4817-8477-d79f05c256c9" released by "delete_snapshot" :: held 3.768s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:25:27 devstack sudo[96777]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9e5fb179-591e-4940-ad89-5cc91ce07854 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956.info" returned: 0 in 0.672s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:27 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-9e5fb179-591e-4940-ad89-5cc91ce07854 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956.info is being set with open permissions: ugo+rw Jun 02 03:25:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9e5fb179-591e-4940-ad89-5cc91ce07854 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:27 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:UPDATE=187,cinder:INSERT=38,cinder:SELECT=138,cinder:DELETE=13 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:25:27 devstack sudo[96781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956.info Jun 02 03:25:27 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:27 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-60ee72f3-22dc-4347-b039-fe8742865170 tempest-SnapshotsActionsTest-999197762 None] Created reservations ['32337b72-3aa5-47aa-bea4-e833caf3abb3', '3431d100-e0fe-4c58-b606-3e98e64cb8f9', '6adc59cd-849d-48e3-9cb4-f15affc1627d', '83ccee69-8350-4442-8bdd-a981a119170d'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:25:27 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-60ee72f3-22dc-4347-b039-fe8742865170 tempest-SnapshotsActionsTest-999197762 None] Delete snapshot completed successfully. Jun 02 03:25:27 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-60ee72f3-22dc-4347-b039-fe8742865170 tempest-SnapshotsActionsTest-999197762 None] Lock "cinder-a5310a69-83e2-4c84-99f7-392faba143c9-delete_snapshot" released by "delete_snapshot" :: held 4.027s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:25:27 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9e5fb179-591e-4940-ad89-5cc91ce07854 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956.info" returned: 0 in 0.651s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9e5fb179-591e-4940-ad89-5cc91ce07854 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.973s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:25:27 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-9e5fb179-591e-4940-ad89-5cc91ce07854 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Create snapshot completed successfully Jun 02 03:25:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a74ad54d-3703-4a57-85b7-e945f59fb1a0 tempest-SnapshotsActionsTest-1531810083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a74ad54d-3703-4a57-85b7-e945f59fb1a0 tempest-SnapshotsActionsTest-1531810083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:27 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-a74ad54d-3703-4a57-85b7-e945f59fb1a0 tempest-SnapshotsActionsTest-1531810083 None] Creating offline snapshot 5140a801-0632-4677-94aa-a2fdd2842879 of volume 7eacdf65-0ba7-4817-8477-d79f05c256c9 {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:25:28 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[666d8e0f-85e7-4cb8-8bb9-fa392c2ef905]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:25:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a74ad54d-3703-4a57-85b7-e945f59fb1a0 tempest-SnapshotsActionsTest-1531810083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:28 devstack sudo[96784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 Jun 02 03:25:28 devstack sudo[96784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:28 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ceb3aa9-0fc8-4f3e-9dc2-c787b8bf40d9 tempest-VolumesTransfersV355Test-1301733984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:25:28 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4ceb3aa9-0fc8-4f3e-9dc2-c787b8bf40d9 tempest-VolumesTransfersV355Test-1301733984 None] Flow 'volume_create_manager' (6c3c3a6f-3ef8-4a80-84a6-2f27a9e9a3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:25:28 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4ceb3aa9-0fc8-4f3e-9dc2-c787b8bf40d9 tempest-VolumesTransfersV355Test-1301733984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29148cdb-07df-4f10-8085-c6c582432288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:28 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4ceb3aa9-0fc8-4f3e-9dc2-c787b8bf40d9 tempest-VolumesTransfersV355Test-1301733984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29148cdb-07df-4f10-8085-c6c582432288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1556958956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed479233-1d91-4e81-9395-77c5b9d9529c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7c1db67e07f44f4bf231ddd64243897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:25:28Z,use_quota=True,user_id='f984366bbe11422a941e0aad817a8520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:28 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4ceb3aa9-0fc8-4f3e-9dc2-c787b8bf40d9 tempest-VolumesTransfersV355Test-1301733984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5842c21-5afd-4e8e-9c9d-ed7d26aad8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:28 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4ceb3aa9-0fc8-4f3e-9dc2-c787b8bf40d9 tempest-VolumesTransfersV355Test-1301733984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5842c21-5afd-4e8e-9c9d-ed7d26aad8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:28 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4ceb3aa9-0fc8-4f3e-9dc2-c787b8bf40d9 tempest-VolumesTransfersV355Test-1301733984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06e55a8d-4245-4d76-b2bf-faef88376b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:28 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4ceb3aa9-0fc8-4f3e-9dc2-c787b8bf40d9 tempest-VolumesTransfersV355Test-1301733984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06e55a8d-4245-4d76-b2bf-faef88376b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed479233-1d91-4e81-9395-77c5b9d9529c', 'volume_name': 'volume-ed479233-1d91-4e81-9395-77c5b9d9529c', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:28 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4ceb3aa9-0fc8-4f3e-9dc2-c787b8bf40d9 tempest-VolumesTransfersV355Test-1301733984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1348189-923a-4664-8abe-0fafa2877d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:28 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4ceb3aa9-0fc8-4f3e-9dc2-c787b8bf40d9 tempest-VolumesTransfersV355Test-1301733984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1348189-923a-4664-8abe-0fafa2877d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:28 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4ceb3aa9-0fc8-4f3e-9dc2-c787b8bf40d9 tempest-VolumesTransfersV355Test-1301733984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c32608-d68b-4638-92cf-f1540d961dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:28 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-4ceb3aa9-0fc8-4f3e-9dc2-c787b8bf40d9 tempest-VolumesTransfersV355Test-1301733984 None] Volume ed479233-1d91-4e81-9395-77c5b9d9529c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed479233-1d91-4e81-9395-77c5b9d9529c', 'volume_size': 1} Jun 02 03:25:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4ceb3aa9-0fc8-4f3e-9dc2-c787b8bf40d9 tempest-VolumesTransfersV355Test-1301733984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:28 devstack sudo[96784]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a74ad54d-3703-4a57-85b7-e945f59fb1a0 tempest-SnapshotsActionsTest-1531810083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2" returned: 0 in 0.876s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:28 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-a74ad54d-3703-4a57-85b7-e945f59fb1a0 tempest-SnapshotsActionsTest-1531810083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7eacdf65-0ba7-4817-8477-d79f05c256c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:25:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a74ad54d-3703-4a57-85b7-e945f59fb1a0 tempest-SnapshotsActionsTest-1531810083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.5140a801-0632-4677-94aa-a2fdd2842879 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:28 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.5140a801-0632-4677-94aa-a2fdd2842879 1G Jun 02 03:25:28 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:29 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-61fb1dab-3491-4b68-93ca-7659ace511ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Acquiring lock "cinder-e1841443-dcd7-45b3-8791-b8f74464b085-delete_snapshot" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:29 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-61fb1dab-3491-4b68-93ca-7659ace511ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Lock "cinder-e1841443-dcd7-45b3-8791-b8f74464b085-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:29 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-61fb1dab-3491-4b68-93ca-7659ace511ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Acquiring lock "cinder-quobyte-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:29 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-61fb1dab-3491-4b68-93ca-7659ace511ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Lock "cinder-quobyte-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:29 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-61fb1dab-3491-4b68-93ca-7659ace511ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Acquiring lock "cinder-quobyte-e1841443-dcd7-45b3-8791-b8f74464b085" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:29 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-61fb1dab-3491-4b68-93ca-7659ace511ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Lock "cinder-quobyte-e1841443-dcd7-45b3-8791-b8f74464b085" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:29 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-61fb1dab-3491-4b68-93ca-7659ace511ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Deleting offline snapshot e1841443-dcd7-45b3-8791-b8f74464b085 of volume 5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:25:29 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-61fb1dab-3491-4b68-93ca-7659ace511ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] snapshot_file for this snap is: volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956.e1841443-dcd7-45b3-8791-b8f74464b085 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:25:29 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d34e476-ace8-4edf-bd14-bd18980b7d2c]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:25:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-61fb1dab-3491-4b68-93ca-7659ace511ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956.e1841443-dcd7-45b3-8791-b8f74464b085 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:29 devstack sudo[96800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956.e1841443-dcd7-45b3-8791-b8f74464b085 Jun 02 03:25:29 devstack sudo[96800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:29 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a74ad54d-3703-4a57-85b7-e945f59fb1a0 tempest-SnapshotsActionsTest-1531810083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.5140a801-0632-4677-94aa-a2fdd2842879 1G" returned: 0 in 0.869s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a74ad54d-3703-4a57-85b7-e945f59fb1a0 tempest-SnapshotsActionsTest-1531810083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.5140a801-0632-4677-94aa-a2fdd2842879 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:29 devstack sudo[96807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.5140a801-0632-4677-94aa-a2fdd2842879 Jun 02 03:25:29 devstack sudo[96807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:29 devstack sudo[96800]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-61fb1dab-3491-4b68-93ca-7659ace511ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956.e1841443-dcd7-45b3-8791-b8f74464b085" returned: 0 in 0.776s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:29 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-61fb1dab-3491-4b68-93ca-7659ace511ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:25:29 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d91c64-5e5c-4bc5-b4c6-836b7fc2ae21]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:25:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-61fb1dab-3491-4b68-93ca-7659ace511ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:30 devstack sudo[96811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956 Jun 02 03:25:30 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:30 devstack sudo[96807]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a74ad54d-3703-4a57-85b7-e945f59fb1a0 tempest-SnapshotsActionsTest-1531810083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.5140a801-0632-4677-94aa-a2fdd2842879" returned: 0 in 0.695s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:30 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-a74ad54d-3703-4a57-85b7-e945f59fb1a0 tempest-SnapshotsActionsTest-1531810083 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.5140a801-0632-4677-94aa-a2fdd2842879 is being set with open permissions: ugo+rw Jun 02 03:25:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a74ad54d-3703-4a57-85b7-e945f59fb1a0 tempest-SnapshotsActionsTest-1531810083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.5140a801-0632-4677-94aa-a2fdd2842879 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:30 devstack sudo[96816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.5140a801-0632-4677-94aa-a2fdd2842879 Jun 02 03:25:30 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:30 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-61fb1dab-3491-4b68-93ca-7659ace511ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956" returned: 0 in 0.749s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-61fb1dab-3491-4b68-93ca-7659ace511ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956.e1841443-dcd7-45b3-8791-b8f74464b085 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:30 devstack sudo[96821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956.e1841443-dcd7-45b3-8791-b8f74464b085 Jun 02 03:25:30 devstack sudo[96821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:31 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a74ad54d-3703-4a57-85b7-e945f59fb1a0 tempest-SnapshotsActionsTest-1531810083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.5140a801-0632-4677-94aa-a2fdd2842879" returned: 0 in 0.734s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a74ad54d-3703-4a57-85b7-e945f59fb1a0 tempest-SnapshotsActionsTest-1531810083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.308s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:25:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4ceb3aa9-0fc8-4f3e-9dc2-c787b8bf40d9 tempest-VolumesTransfersV355Test-1301733984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.638s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:31 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-4ceb3aa9-0fc8-4f3e-9dc2-c787b8bf40d9 tempest-VolumesTransfersV355Test-1301733984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1556958956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed479233-1d91-4e81-9395-77c5b9d9529c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7c1db67e07f44f4bf231ddd64243897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:25:28Z,use_quota=True,user_id='f984366bbe11422a941e0aad817a8520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:25:31 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-4ceb3aa9-0fc8-4f3e-9dc2-c787b8bf40d9 tempest-VolumesTransfersV355Test-1301733984 None] Creating volume ed479233-1d91-4e81-9395-77c5b9d9529c {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:25:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4ceb3aa9-0fc8-4f3e-9dc2-c787b8bf40d9 tempest-VolumesTransfersV355Test-1301733984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4ceb3aa9-0fc8-4f3e-9dc2-c787b8bf40d9 tempest-VolumesTransfersV355Test-1301733984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:31 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-4ceb3aa9-0fc8-4f3e-9dc2-c787b8bf40d9 tempest-VolumesTransfersV355Test-1301733984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:25:31 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-4ceb3aa9-0fc8-4f3e-9dc2-c787b8bf40d9 tempest-VolumesTransfersV355Test-1301733984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:25:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4ceb3aa9-0fc8-4f3e-9dc2-c787b8bf40d9 tempest-VolumesTransfersV355Test-1301733984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:25:31 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-4ceb3aa9-0fc8-4f3e-9dc2-c787b8bf40d9 tempest-VolumesTransfersV355Test-1301733984 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:25:31 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-4ceb3aa9-0fc8-4f3e-9dc2-c787b8bf40d9 tempest-VolumesTransfersV355Test-1301733984 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:25:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4ceb3aa9-0fc8-4f3e-9dc2-c787b8bf40d9 tempest-VolumesTransfersV355Test-1301733984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ed479233-1d91-4e81-9395-77c5b9d9529c 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:31 devstack sudo[96827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ed479233-1d91-4e81-9395-77c5b9d9529c 1073741824 Jun 02 03:25:31 devstack sudo[96827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:31 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-a74ad54d-3703-4a57-85b7-e945f59fb1a0 tempest-SnapshotsActionsTest-1531810083 None] Create snapshot completed successfully Jun 02 03:25:31 devstack sudo[96821]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-61fb1dab-3491-4b68-93ca-7659ace511ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956.e1841443-dcd7-45b3-8791-b8f74464b085" returned: 0 in 0.746s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-61fb1dab-3491-4b68-93ca-7659ace511ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956.e1841443-dcd7-45b3-8791-b8f74464b085 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:31 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956.e1841443-dcd7-45b3-8791-b8f74464b085 Jun 02 03:25:31 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:32 devstack sudo[96827]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4ceb3aa9-0fc8-4f3e-9dc2-c787b8bf40d9 tempest-VolumesTransfersV355Test-1301733984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ed479233-1d91-4e81-9395-77c5b9d9529c 1073741824" returned: 0 in 0.817s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:32 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-61fb1dab-3491-4b68-93ca-7659ace511ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956.e1841443-dcd7-45b3-8791-b8f74464b085" returned: 0 in 0.644s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4ceb3aa9-0fc8-4f3e-9dc2-c787b8bf40d9 tempest-VolumesTransfersV355Test-1301733984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ed479233-1d91-4e81-9395-77c5b9d9529c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:32 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-61fb1dab-3491-4b68-93ca-7659ace511ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Lock "cinder-quobyte-e1841443-dcd7-45b3-8791-b8f74464b085" released by "_delete_snapshot" :: held 3.084s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:25:32 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ed479233-1d91-4e81-9395-77c5b9d9529c Jun 02 03:25:32 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-61fb1dab-3491-4b68-93ca-7659ace511ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Lock "cinder-quobyte-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956" released by "delete_snapshot" :: held 3.119s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:25:32 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:32 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0380c727-f43e-4557-9867-cf38d0b8c967 tempest-SnapshotsActionsTest-999197762 None] Acquiring lock "cinder-5140a801-0632-4677-94aa-a2fdd2842879-delete_snapshot" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:32 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0380c727-f43e-4557-9867-cf38d0b8c967 tempest-SnapshotsActionsTest-999197762 None] Lock "cinder-5140a801-0632-4677-94aa-a2fdd2842879-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:32 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0380c727-f43e-4557-9867-cf38d0b8c967 tempest-SnapshotsActionsTest-999197762 None] Acquiring lock "cinder-quobyte-7eacdf65-0ba7-4817-8477-d79f05c256c9" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:32 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0380c727-f43e-4557-9867-cf38d0b8c967 tempest-SnapshotsActionsTest-999197762 None] Lock "cinder-quobyte-7eacdf65-0ba7-4817-8477-d79f05c256c9" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:32 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0380c727-f43e-4557-9867-cf38d0b8c967 tempest-SnapshotsActionsTest-999197762 None] Acquiring lock "cinder-quobyte-5140a801-0632-4677-94aa-a2fdd2842879" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:32 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-61fb1dab-3491-4b68-93ca-7659ace511ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Created reservations ['a4a8ca5c-bb2f-4375-83dd-253b17e0f923', '6cdc8f2b-7069-4439-8d24-ea7c19e72cbb', 'cee1e1bc-cad0-4fae-9c2b-fcc1ad665904', '7e9ded07-013a-4699-8f71-ce7d3ba46806'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:25:32 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0380c727-f43e-4557-9867-cf38d0b8c967 tempest-SnapshotsActionsTest-999197762 None] Lock "cinder-quobyte-5140a801-0632-4677-94aa-a2fdd2842879" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:32 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-0380c727-f43e-4557-9867-cf38d0b8c967 tempest-SnapshotsActionsTest-999197762 None] Deleting offline snapshot 5140a801-0632-4677-94aa-a2fdd2842879 of volume 7eacdf65-0ba7-4817-8477-d79f05c256c9 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:25:32 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-0380c727-f43e-4557-9867-cf38d0b8c967 tempest-SnapshotsActionsTest-999197762 None] snapshot_file for this snap is: volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.5140a801-0632-4677-94aa-a2fdd2842879 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:25:32 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff3f167-f7b3-4b36-b6dc-c586c6aa0db0]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:25:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0380c727-f43e-4557-9867-cf38d0b8c967 tempest-SnapshotsActionsTest-999197762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.5140a801-0632-4677-94aa-a2fdd2842879 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:32 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-61fb1dab-3491-4b68-93ca-7659ace511ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Delete snapshot completed successfully. Jun 02 03:25:32 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-61fb1dab-3491-4b68-93ca-7659ace511ef tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Lock "cinder-e1841443-dcd7-45b3-8791-b8f74464b085-delete_snapshot" released by "delete_snapshot" :: held 3.612s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:25:32 devstack sudo[96838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.5140a801-0632-4677-94aa-a2fdd2842879 Jun 02 03:25:32 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:32 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4ceb3aa9-0fc8-4f3e-9dc2-c787b8bf40d9 tempest-VolumesTransfersV355Test-1301733984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ed479233-1d91-4e81-9395-77c5b9d9529c" returned: 0 in 0.756s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:32 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-4ceb3aa9-0fc8-4f3e-9dc2-c787b8bf40d9 tempest-VolumesTransfersV355Test-1301733984 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:25:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4ceb3aa9-0fc8-4f3e-9dc2-c787b8bf40d9 tempest-VolumesTransfersV355Test-1301733984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:25:32 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4ceb3aa9-0fc8-4f3e-9dc2-c787b8bf40d9 tempest-VolumesTransfersV355Test-1301733984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c32608-d68b-4638-92cf-f1540d961dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed479233-1d91-4e81-9395-77c5b9d9529c', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:32 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4ceb3aa9-0fc8-4f3e-9dc2-c787b8bf40d9 tempest-VolumesTransfersV355Test-1301733984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb27ce57-f899-431e-8d42-eb888d3cca74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:32 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-4ceb3aa9-0fc8-4f3e-9dc2-c787b8bf40d9 tempest-VolumesTransfersV355Test-1301733984 None] Volume volume-ed479233-1d91-4e81-9395-77c5b9d9529c (ed479233-1d91-4e81-9395-77c5b9d9529c): created successfully Jun 02 03:25:32 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4ceb3aa9-0fc8-4f3e-9dc2-c787b8bf40d9 tempest-VolumesTransfersV355Test-1301733984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb27ce57-f899-431e-8d42-eb888d3cca74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:32 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4ceb3aa9-0fc8-4f3e-9dc2-c787b8bf40d9 tempest-VolumesTransfersV355Test-1301733984 None] Flow 'volume_create_manager' (6c3c3a6f-3ef8-4a80-84a6-2f27a9e9a3bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:25:32 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-4ceb3aa9-0fc8-4f3e-9dc2-c787b8bf40d9 tempest-VolumesTransfersV355Test-1301733984 None] Created volume successfully. Jun 02 03:25:33 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0380c727-f43e-4557-9867-cf38d0b8c967 tempest-SnapshotsActionsTest-999197762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.5140a801-0632-4677-94aa-a2fdd2842879" returned: 0 in 0.859s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:33 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-0380c727-f43e-4557-9867-cf38d0b8c967 tempest-SnapshotsActionsTest-999197762 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7eacdf65-0ba7-4817-8477-d79f05c256c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:25:33 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1e8c31-20b9-4e89-a521-866fc6bc7dfe]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:25:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0380c727-f43e-4557-9867-cf38d0b8c967 tempest-SnapshotsActionsTest-999197762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:33 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1c49371d-555a-459f-a9db-c7e33c04ae67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Acquiring lock "cinder-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:33 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1c49371d-555a-459f-a9db-c7e33c04ae67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Lock "cinder-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:33 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1c49371d-555a-459f-a9db-c7e33c04ae67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Acquiring lock "cinder-quobyte-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:33 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1c49371d-555a-459f-a9db-c7e33c04ae67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Lock "cinder-quobyte-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956" acquired by "delete_volume" :: waited 0.021s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:33 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 Jun 02 03:25:33 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:33 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[82571275-559b-464f-be4b-a6369ca58020]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:25:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1c49371d-555a-459f-a9db-c7e33c04ae67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:33 devstack sudo[96847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956 Jun 02 03:25:33 devstack sudo[96847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:34 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0380c727-f43e-4557-9867-cf38d0b8c967 tempest-SnapshotsActionsTest-999197762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2" returned: 0 in 1.212s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:34 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-0380c727-f43e-4557-9867-cf38d0b8c967 tempest-SnapshotsActionsTest-999197762 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7eacdf65-0ba7-4817-8477-d79f05c256c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:25:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0380c727-f43e-4557-9867-cf38d0b8c967 tempest-SnapshotsActionsTest-999197762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.5140a801-0632-4677-94aa-a2fdd2842879 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:34 devstack sudo[96847]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1c49371d-555a-459f-a9db-c7e33c04ae67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956" returned: 0 in 1.064s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1c49371d-555a-459f-a9db-c7e33c04ae67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:34 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.5140a801-0632-4677-94aa-a2fdd2842879 Jun 02 03:25:34 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:34 devstack sudo[96857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956 Jun 02 03:25:34 devstack sudo[96857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:34 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-67ab53a9-8d1a-448e-b556-0496533286f9 tempest-VolumesTransfersV355Test-22860117 None] Transfer volume completed successfully. Jun 02 03:25:35 devstack sudo[96857]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1c49371d-555a-459f-a9db-c7e33c04ae67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956" returned: 0 in 0.678s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:35 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1c49371d-555a-459f-a9db-c7e33c04ae67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Lock "cinder-quobyte-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956" released by "delete_volume" :: held 1.819s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:25:35 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-1c49371d-555a-459f-a9db-c7e33c04ae67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Created reservations ['96d9c9d5-1d55-410b-bd30-790d482c6ff6', '2b0edce9-3935-400f-85df-a3c7a3302427', '61155868-b559-4df2-a043-6875764c59ff', '44d56830-e55a-4e7e-bad6-a5f1e6c11a31'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:25:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1c49371d-555a-459f-a9db-c7e33c04ae67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1c49371d-555a-459f-a9db-c7e33c04ae67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:35 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-1c49371d-555a-459f-a9db-c7e33c04ae67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:25:35 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-1c49371d-555a-459f-a9db-c7e33c04ae67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:25:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1c49371d-555a-459f-a9db-c7e33c04ae67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:25:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1c49371d-555a-459f-a9db-c7e33c04ae67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:35 devstack sudo[96864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:25:35 devstack sudo[96864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:35 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0380c727-f43e-4557-9867-cf38d0b8c967 tempest-SnapshotsActionsTest-999197762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.5140a801-0632-4677-94aa-a2fdd2842879" returned: 0 in 0.960s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0380c727-f43e-4557-9867-cf38d0b8c967 tempest-SnapshotsActionsTest-999197762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.5140a801-0632-4677-94aa-a2fdd2842879 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:35 devstack sudo[96866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.5140a801-0632-4677-94aa-a2fdd2842879 Jun 02 03:25:35 devstack sudo[96866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7e2b48dd-acd2-4818-8606-4d32b27babb3 tempest-VolumesTransfersV355Test-853162801 None] Acquiring lock "cinder-ed479233-1d91-4e81-9395-77c5b9d9529c-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7e2b48dd-acd2-4818-8606-4d32b27babb3 tempest-VolumesTransfersV355Test-853162801 None] Lock "cinder-ed479233-1d91-4e81-9395-77c5b9d9529c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7e2b48dd-acd2-4818-8606-4d32b27babb3 tempest-VolumesTransfersV355Test-853162801 None] Acquiring lock "cinder-quobyte-ed479233-1d91-4e81-9395-77c5b9d9529c" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7e2b48dd-acd2-4818-8606-4d32b27babb3 tempest-VolumesTransfersV355Test-853162801 None] Lock "cinder-quobyte-ed479233-1d91-4e81-9395-77c5b9d9529c" acquired by "delete_volume" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:36 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[023f9068-276f-426f-91b4-1d7cc8bc3533]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:25:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7e2b48dd-acd2-4818-8606-4d32b27babb3 tempest-VolumesTransfersV355Test-853162801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ed479233-1d91-4e81-9395-77c5b9d9529c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:36 devstack sudo[96868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ed479233-1d91-4e81-9395-77c5b9d9529c Jun 02 03:25:36 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:36 devstack sudo[96864]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1c49371d-555a-459f-a9db-c7e33c04ae67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.932s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:36 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-1c49371d-555a-459f-a9db-c7e33c04ae67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:25:36 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-1c49371d-555a-459f-a9db-c7e33c04ae67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Deleted volume successfully. Jun 02 03:25:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1c49371d-555a-459f-a9db-c7e33c04ae67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1319158077 None] Lock "cinder-5bd07e3d-9d1f-48fc-bed2-0fd48c4ba956-delete_volume" released by "delete_volume" :: held 3.033s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:25:36 devstack sudo[96866]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0380c727-f43e-4557-9867-cf38d0b8c967 tempest-SnapshotsActionsTest-999197762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.5140a801-0632-4677-94aa-a2fdd2842879" returned: 0 in 1.040s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0380c727-f43e-4557-9867-cf38d0b8c967 tempest-SnapshotsActionsTest-999197762 None] Lock "cinder-quobyte-5140a801-0632-4677-94aa-a2fdd2842879" released by "_delete_snapshot" :: held 4.296s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:25:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0380c727-f43e-4557-9867-cf38d0b8c967 tempest-SnapshotsActionsTest-999197762 None] Lock "cinder-quobyte-7eacdf65-0ba7-4817-8477-d79f05c256c9" released by "delete_snapshot" :: held 4.335s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:25:36 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-0380c727-f43e-4557-9867-cf38d0b8c967 tempest-SnapshotsActionsTest-999197762 None] Created reservations ['de0c57d0-5d8c-4344-96a1-16cbc78adace', 'd3d30c0d-76c9-418d-ba95-5bf09dd2b494', '803dd346-11ae-4baf-a9b0-eb61020103b7', 'b8f417dc-aabb-4b5b-a8aa-1f1755572959'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:25:36 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-0380c727-f43e-4557-9867-cf38d0b8c967 tempest-SnapshotsActionsTest-999197762 None] Delete snapshot completed successfully. Jun 02 03:25:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0380c727-f43e-4557-9867-cf38d0b8c967 tempest-SnapshotsActionsTest-999197762 None] Lock "cinder-5140a801-0632-4677-94aa-a2fdd2842879-delete_snapshot" released by "delete_snapshot" :: held 4.563s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:25:37 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7e2b48dd-acd2-4818-8606-4d32b27babb3 tempest-VolumesTransfersV355Test-853162801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ed479233-1d91-4e81-9395-77c5b9d9529c" returned: 0 in 1.035s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7e2b48dd-acd2-4818-8606-4d32b27babb3 tempest-VolumesTransfersV355Test-853162801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ed479233-1d91-4e81-9395-77c5b9d9529c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:37 devstack sudo[96875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ed479233-1d91-4e81-9395-77c5b9d9529c Jun 02 03:25:37 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:37 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7e2b48dd-acd2-4818-8606-4d32b27babb3 tempest-VolumesTransfersV355Test-853162801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ed479233-1d91-4e81-9395-77c5b9d9529c" returned: 0 in 0.774s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:38 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7e2b48dd-acd2-4818-8606-4d32b27babb3 tempest-VolumesTransfersV355Test-853162801 None] Lock "cinder-quobyte-ed479233-1d91-4e81-9395-77c5b9d9529c" released by "delete_volume" :: held 1.865s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:25:38 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-7e2b48dd-acd2-4818-8606-4d32b27babb3 tempest-VolumesTransfersV355Test-853162801 None] Created reservations ['b51691a1-ff78-4080-9768-ababcd400480', 'b14c1283-eaa2-4758-bc23-1ccc6db0d3bb', 'de1321ff-301a-4c64-8347-60665b4b06e3', '118220e8-e744-41f7-86df-f458f3f01584'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:25:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-641294e8-036c-45e8-ac76-88f14d73b5a8 tempest-SnapshotsActionsTest-1531810083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-641294e8-036c-45e8-ac76-88f14d73b5a8 tempest-SnapshotsActionsTest-1531810083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:38 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-641294e8-036c-45e8-ac76-88f14d73b5a8 tempest-SnapshotsActionsTest-1531810083 None] Creating offline snapshot 97a33487-41f7-4e87-8f7d-9e9dbc4a0a2b of volume 7eacdf65-0ba7-4817-8477-d79f05c256c9 {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:25:38 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd414168-7c97-4472-aabe-9313e293de37]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:25:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-641294e8-036c-45e8-ac76-88f14d73b5a8 tempest-SnapshotsActionsTest-1531810083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7e2b48dd-acd2-4818-8606-4d32b27babb3 tempest-VolumesTransfersV355Test-853162801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7e2b48dd-acd2-4818-8606-4d32b27babb3 tempest-VolumesTransfersV355Test-853162801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:38 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-7e2b48dd-acd2-4818-8606-4d32b27babb3 tempest-VolumesTransfersV355Test-853162801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:25:38 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-7e2b48dd-acd2-4818-8606-4d32b27babb3 tempest-VolumesTransfersV355Test-853162801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:25:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7e2b48dd-acd2-4818-8606-4d32b27babb3 tempest-VolumesTransfersV355Test-853162801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:25:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7e2b48dd-acd2-4818-8606-4d32b27babb3 tempest-VolumesTransfersV355Test-853162801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:38 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:25:38 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:38 devstack sudo[96878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 Jun 02 03:25:38 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:39 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bcaa4e8-7584-43a5-b2d0-9062cd0a8061 tempest-VolumesTransfersV355Test-1301733984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:25:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2bcaa4e8-7584-43a5-b2d0-9062cd0a8061 tempest-VolumesTransfersV355Test-1301733984 None] Flow 'volume_create_manager' (bf3bea9b-c368-4a45-846d-e378339907b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:25:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2bcaa4e8-7584-43a5-b2d0-9062cd0a8061 tempest-VolumesTransfersV355Test-1301733984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3f6400-744d-4261-9c99-cca8be1ed6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2bcaa4e8-7584-43a5-b2d0-9062cd0a8061 tempest-VolumesTransfersV355Test-1301733984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3f6400-744d-4261-9c99-cca8be1ed6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1469171805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f69dbe-342c-45b4-aa15-fbf8712f0fbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7c1db67e07f44f4bf231ddd64243897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:25:39Z,use_quota=True,user_id='f984366bbe11422a941e0aad817a8520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2bcaa4e8-7584-43a5-b2d0-9062cd0a8061 tempest-VolumesTransfersV355Test-1301733984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09a60abc-e65b-444a-9bf4-831863a33ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2bcaa4e8-7584-43a5-b2d0-9062cd0a8061 tempest-VolumesTransfersV355Test-1301733984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09a60abc-e65b-444a-9bf4-831863a33ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2bcaa4e8-7584-43a5-b2d0-9062cd0a8061 tempest-VolumesTransfersV355Test-1301733984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c854fc5e-5284-48f5-b0e5-4e16e178dfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2bcaa4e8-7584-43a5-b2d0-9062cd0a8061 tempest-VolumesTransfersV355Test-1301733984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c854fc5e-5284-48f5-b0e5-4e16e178dfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92f69dbe-342c-45b4-aa15-fbf8712f0fbc', 'volume_name': 'volume-92f69dbe-342c-45b4-aa15-fbf8712f0fbc', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2bcaa4e8-7584-43a5-b2d0-9062cd0a8061 tempest-VolumesTransfersV355Test-1301733984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ccb358-924c-4a1f-8557-a733d5e50bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2bcaa4e8-7584-43a5-b2d0-9062cd0a8061 tempest-VolumesTransfersV355Test-1301733984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65ccb358-924c-4a1f-8557-a733d5e50bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2bcaa4e8-7584-43a5-b2d0-9062cd0a8061 tempest-VolumesTransfersV355Test-1301733984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ed0409-c9e1-44ce-b833-b49754c0b444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:39 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-2bcaa4e8-7584-43a5-b2d0-9062cd0a8061 tempest-VolumesTransfersV355Test-1301733984 None] Volume 92f69dbe-342c-45b4-aa15-fbf8712f0fbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92f69dbe-342c-45b4-aa15-fbf8712f0fbc', 'volume_size': 1} Jun 02 03:25:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2bcaa4e8-7584-43a5-b2d0-9062cd0a8061 tempest-VolumesTransfersV355Test-1301733984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:39 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-641294e8-036c-45e8-ac76-88f14d73b5a8 tempest-SnapshotsActionsTest-1531810083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2" returned: 0 in 1.146s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:39 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-641294e8-036c-45e8-ac76-88f14d73b5a8 tempest-SnapshotsActionsTest-1531810083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7eacdf65-0ba7-4817-8477-d79f05c256c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:25:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-641294e8-036c-45e8-ac76-88f14d73b5a8 tempest-SnapshotsActionsTest-1531810083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.97a33487-41f7-4e87-8f7d-9e9dbc4a0a2b 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:39 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fe473af-fd24-4f13-9203-5ec4a68f02fc tempest-VolumesSnapshotTestJSON-661765892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:25:39 devstack sudo[96887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.97a33487-41f7-4e87-8f7d-9e9dbc4a0a2b 1G Jun 02 03:25:39 devstack sudo[96887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9fe473af-fd24-4f13-9203-5ec4a68f02fc tempest-VolumesSnapshotTestJSON-661765892 None] Flow 'volume_create_manager' (49a7d652-1a5a-492b-b264-47533addf98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:25:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9fe473af-fd24-4f13-9203-5ec4a68f02fc tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2322561-e440-46e2-ad5d-71f1611c477f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9fe473af-fd24-4f13-9203-5ec4a68f02fc tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2322561-e440-46e2-ad5d-71f1611c477f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1939106845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da2e2a9-b21e-44e8-9e5d-6c39db872853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f92811de804e4da9af80175226575210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:25:39Z,use_quota=True,user_id='6c94587123b44232a21505de6aec93e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9fe473af-fd24-4f13-9203-5ec4a68f02fc tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d36ef1ca-40a8-4374-878b-3057baa5f1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:39 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9fe473af-fd24-4f13-9203-5ec4a68f02fc tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d36ef1ca-40a8-4374-878b-3057baa5f1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9fe473af-fd24-4f13-9203-5ec4a68f02fc tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99ef18fc-625d-46ef-8923-9cfc44467935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9fe473af-fd24-4f13-9203-5ec4a68f02fc tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99ef18fc-625d-46ef-8923-9cfc44467935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6da2e2a9-b21e-44e8-9e5d-6c39db872853', 'volume_name': 'volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9fe473af-fd24-4f13-9203-5ec4a68f02fc tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2318a6bc-450d-4fa9-8a27-25b186e807e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9fe473af-fd24-4f13-9203-5ec4a68f02fc tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2318a6bc-450d-4fa9-8a27-25b186e807e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9fe473af-fd24-4f13-9203-5ec4a68f02fc tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (009c2572-01d8-40a2-92e4-d6315130a0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:39 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-9fe473af-fd24-4f13-9203-5ec4a68f02fc tempest-VolumesSnapshotTestJSON-661765892 None] Volume 6da2e2a9-b21e-44e8-9e5d-6c39db872853: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853', 'volume_size': 1} Jun 02 03:25:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9fe473af-fd24-4f13-9203-5ec4a68f02fc tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7e2b48dd-acd2-4818-8606-4d32b27babb3 tempest-VolumesTransfersV355Test-853162801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 1.190s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:39 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-7e2b48dd-acd2-4818-8606-4d32b27babb3 tempest-VolumesTransfersV355Test-853162801 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:25:39 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-7e2b48dd-acd2-4818-8606-4d32b27babb3 tempest-VolumesTransfersV355Test-853162801 None] Deleted volume successfully. Jun 02 03:25:39 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7e2b48dd-acd2-4818-8606-4d32b27babb3 tempest-VolumesTransfersV355Test-853162801 None] Lock "cinder-ed479233-1d91-4e81-9395-77c5b9d9529c-delete_volume" released by "delete_volume" :: held 3.425s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:25:40 devstack sudo[96887]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-641294e8-036c-45e8-ac76-88f14d73b5a8 tempest-SnapshotsActionsTest-1531810083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.97a33487-41f7-4e87-8f7d-9e9dbc4a0a2b 1G" returned: 0 in 0.815s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-641294e8-036c-45e8-ac76-88f14d73b5a8 tempest-SnapshotsActionsTest-1531810083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.97a33487-41f7-4e87-8f7d-9e9dbc4a0a2b {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:40 devstack sudo[96893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.97a33487-41f7-4e87-8f7d-9e9dbc4a0a2b Jun 02 03:25:40 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:40 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-641294e8-036c-45e8-ac76-88f14d73b5a8 tempest-SnapshotsActionsTest-1531810083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.97a33487-41f7-4e87-8f7d-9e9dbc4a0a2b" returned: 0 in 0.654s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:40 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-641294e8-036c-45e8-ac76-88f14d73b5a8 tempest-SnapshotsActionsTest-1531810083 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.97a33487-41f7-4e87-8f7d-9e9dbc4a0a2b is being set with open permissions: ugo+rw Jun 02 03:25:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-641294e8-036c-45e8-ac76-88f14d73b5a8 tempest-SnapshotsActionsTest-1531810083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.97a33487-41f7-4e87-8f7d-9e9dbc4a0a2b {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:40 devstack sudo[96898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.97a33487-41f7-4e87-8f7d-9e9dbc4a0a2b Jun 02 03:25:40 devstack sudo[96898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:41 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:25:41 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Flow 'volume_create_manager' (2f59fd1a-23e8-47ee-923d-9382e07d3984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:25:41 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (318a399d-7723-44bc-9ef3-537e0667bb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:41 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (318a399d-7723-44bc-9ef3-537e0667bb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1994633076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=234f078a-de14-4902-befa-a027d2a4b25a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='000b89ca2f1a4e4c82bce74f256353b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:25:41Z,use_quota=True,user_id='900bd244c8d349afab2e5600caab4677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:41 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (465ecd84-10aa-4c39-a71d-6e42280080ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:41 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (465ecd84-10aa-4c39-a71d-6e42280080ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:41 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695b404a-db8e-4113-9d92-c3060f863766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:41 devstack cinder-volume[86431]: DEBUG cinder.image.glance [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Creating Keystone auth plugin from conf {{(pid=86431) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 02 03:25:41 devstack sudo[96898]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-641294e8-036c-45e8-ac76-88f14d73b5a8 tempest-SnapshotsActionsTest-1531810083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.97a33487-41f7-4e87-8f7d-9e9dbc4a0a2b" returned: 0 in 0.633s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-641294e8-036c-45e8-ac76-88f14d73b5a8 tempest-SnapshotsActionsTest-1531810083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.370s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:25:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2bcaa4e8-7584-43a5-b2d0-9062cd0a8061 tempest-VolumesTransfersV355Test-1301733984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.175s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:41 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-2bcaa4e8-7584-43a5-b2d0-9062cd0a8061 tempest-VolumesTransfersV355Test-1301733984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1469171805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f69dbe-342c-45b4-aa15-fbf8712f0fbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7c1db67e07f44f4bf231ddd64243897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:25:39Z,use_quota=True,user_id='f984366bbe11422a941e0aad817a8520',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:25:41 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-2bcaa4e8-7584-43a5-b2d0-9062cd0a8061 tempest-VolumesTransfersV355Test-1301733984 None] Creating volume 92f69dbe-342c-45b4-aa15-fbf8712f0fbc {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:25:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2bcaa4e8-7584-43a5-b2d0-9062cd0a8061 tempest-VolumesTransfersV355Test-1301733984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2bcaa4e8-7584-43a5-b2d0-9062cd0a8061 tempest-VolumesTransfersV355Test-1301733984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:41 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-2bcaa4e8-7584-43a5-b2d0-9062cd0a8061 tempest-VolumesTransfersV355Test-1301733984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:25:41 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-2bcaa4e8-7584-43a5-b2d0-9062cd0a8061 tempest-VolumesTransfersV355Test-1301733984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:25:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2bcaa4e8-7584-43a5-b2d0-9062cd0a8061 tempest-VolumesTransfersV355Test-1301733984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:25:41 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-2bcaa4e8-7584-43a5-b2d0-9062cd0a8061 tempest-VolumesTransfersV355Test-1301733984 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:25:41 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-2bcaa4e8-7584-43a5-b2d0-9062cd0a8061 tempest-VolumesTransfersV355Test-1301733984 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:25:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2bcaa4e8-7584-43a5-b2d0-9062cd0a8061 tempest-VolumesTransfersV355Test-1301733984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-92f69dbe-342c-45b4-aa15-fbf8712f0fbc 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:41 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-92f69dbe-342c-45b4-aa15-fbf8712f0fbc 1073741824 Jun 02 03:25:41 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:41 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-641294e8-036c-45e8-ac76-88f14d73b5a8 tempest-SnapshotsActionsTest-1531810083 None] Create snapshot completed successfully Jun 02 03:25:41 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695b404a-db8e-4113-9d92-c3060f863766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '234f078a-de14-4902-befa-a027d2a4b25a', 'volume_name': 'volume-234f078a-de14-4902-befa-a027d2a4b25a', 'volume_size': 1, 'image_id': '54f2c102-8f54-4d66-966a-3fc746680841', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54f2c102-8f54-4d66-966a-3fc746680841', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48b06555345b4428a30a6f37e96ddabe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '54f2c102-8f54-4d66-966a-3fc746680841', 'created_at': datetime.datetime(2026, 6, 2, 1, 9, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 1, 9, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54f2c102-8f54-4d66-966a-3fc746680841/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:41 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (534db568-4a1c-4c67-9fc6-227ec5ee9a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:41 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (534db568-4a1c-4c67-9fc6-227ec5ee9a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:41 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebf6f0bd-5b2b-4f92-902c-d1d5b0e8abb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:41 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Volume 234f078a-de14-4902-befa-a027d2a4b25a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-234f078a-de14-4902-befa-a027d2a4b25a', 'volume_size': 1, 'image_id': '54f2c102-8f54-4d66-966a-3fc746680841', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54f2c102-8f54-4d66-966a-3fc746680841', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48b06555345b4428a30a6f37e96ddabe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '54f2c102-8f54-4d66-966a-3fc746680841', 'created_at': datetime.datetime(2026, 6, 2, 1, 9, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 1, 9, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54f2c102-8f54-4d66-966a-3fc746680841/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 02 03:25:41 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Trying to clone 234f078a-de14-4902-befa-a027d2a4b25a from image 54f2c102-8f54-4d66-966a-3fc746680841 at location (None, [{'url': 'file:///opt/stack/data/glance/images/54f2c102-8f54-4d66-966a-3fc746680841', 'metadata': {}}]). {{(pid=86431) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 02 03:25:41 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_n5lpe78zdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86431) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 02 03:25:41 devstack cinder-volume[86431]: INFO cinder.image.image_utils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Image download 20.69 MB at 20.69 MB/s Jun 02 03:25:41 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[949e5c74-0fa3-4c7c-afae-10d2608a8daa]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:25:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_n5lpe78zdevstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:42 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_n5lpe78zdevstack@QuobyteHD Jun 02 03:25:42 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:42 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2bcaa4e8-7584-43a5-b2d0-9062cd0a8061 tempest-VolumesTransfersV355Test-1301733984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-92f69dbe-342c-45b4-aa15-fbf8712f0fbc 1073741824" returned: 0 in 0.904s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2bcaa4e8-7584-43a5-b2d0-9062cd0a8061 tempest-VolumesTransfersV355Test-1301733984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-92f69dbe-342c-45b4-aa15-fbf8712f0fbc {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:42 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-cde53225-9323-4e1a-971a-146dad1d0f6a tempest-SnapshotsActionsTest-999197762 None] Acquiring lock "cinder-97a33487-41f7-4e87-8f7d-9e9dbc4a0a2b-delete_snapshot" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:42 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-cde53225-9323-4e1a-971a-146dad1d0f6a tempest-SnapshotsActionsTest-999197762 None] Lock "cinder-97a33487-41f7-4e87-8f7d-9e9dbc4a0a2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:42 devstack sudo[96930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-92f69dbe-342c-45b4-aa15-fbf8712f0fbc Jun 02 03:25:42 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-cde53225-9323-4e1a-971a-146dad1d0f6a tempest-SnapshotsActionsTest-999197762 None] Acquiring lock "cinder-quobyte-7eacdf65-0ba7-4817-8477-d79f05c256c9" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:42 devstack sudo[96930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:42 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-cde53225-9323-4e1a-971a-146dad1d0f6a tempest-SnapshotsActionsTest-999197762 None] Lock "cinder-quobyte-7eacdf65-0ba7-4817-8477-d79f05c256c9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:42 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-cde53225-9323-4e1a-971a-146dad1d0f6a tempest-SnapshotsActionsTest-999197762 None] Acquiring lock "cinder-quobyte-97a33487-41f7-4e87-8f7d-9e9dbc4a0a2b" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:42 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-cde53225-9323-4e1a-971a-146dad1d0f6a tempest-SnapshotsActionsTest-999197762 None] Lock "cinder-quobyte-97a33487-41f7-4e87-8f7d-9e9dbc4a0a2b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:42 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-cde53225-9323-4e1a-971a-146dad1d0f6a tempest-SnapshotsActionsTest-999197762 None] Deleting offline snapshot 97a33487-41f7-4e87-8f7d-9e9dbc4a0a2b of volume 7eacdf65-0ba7-4817-8477-d79f05c256c9 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:25:42 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-cde53225-9323-4e1a-971a-146dad1d0f6a tempest-SnapshotsActionsTest-999197762 None] snapshot_file for this snap is: volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.97a33487-41f7-4e87-8f7d-9e9dbc4a0a2b {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:25:42 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[27187f76-53f0-44ca-9f4d-fa3b0df1f9ed]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:25:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cde53225-9323-4e1a-971a-146dad1d0f6a tempest-SnapshotsActionsTest-999197762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.97a33487-41f7-4e87-8f7d-9e9dbc4a0a2b {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:42 devstack sudo[96933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.97a33487-41f7-4e87-8f7d-9e9dbc4a0a2b Jun 02 03:25:42 devstack sudo[96933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:42 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_n5lpe78zdevstack@QuobyteHD" returned: 0 in 0.842s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:42 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Temporary image 54f2c102-8f54-4d66-966a-3fc746680841 is fetched for user 900bd244c8d349afab2e5600caab4677. {{(pid=86431) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 02 03:25:42 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7a9b4d-9582-43e3-ad32-8da7dc0d81c5]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:25:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_n5lpe78zdevstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:43 devstack sudo[96938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_n5lpe78zdevstack@QuobyteHD Jun 02 03:25:43 devstack sudo[96938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:43 devstack sudo[96930]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2bcaa4e8-7584-43a5-b2d0-9062cd0a8061 tempest-VolumesTransfersV355Test-1301733984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-92f69dbe-342c-45b4-aa15-fbf8712f0fbc" returned: 0 in 0.668s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:43 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-2bcaa4e8-7584-43a5-b2d0-9062cd0a8061 tempest-VolumesTransfersV355Test-1301733984 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:25:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2bcaa4e8-7584-43a5-b2d0-9062cd0a8061 tempest-VolumesTransfersV355Test-1301733984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:25:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9fe473af-fd24-4f13-9203-5ec4a68f02fc tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.669s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:43 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9fe473af-fd24-4f13-9203-5ec4a68f02fc tempest-VolumesSnapshotTestJSON-661765892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1939106845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da2e2a9-b21e-44e8-9e5d-6c39db872853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f92811de804e4da9af80175226575210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:25:39Z,use_quota=True,user_id='6c94587123b44232a21505de6aec93e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:25:43 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-9fe473af-fd24-4f13-9203-5ec4a68f02fc tempest-VolumesSnapshotTestJSON-661765892 None] Creating volume 6da2e2a9-b21e-44e8-9e5d-6c39db872853 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:25:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9fe473af-fd24-4f13-9203-5ec4a68f02fc tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9fe473af-fd24-4f13-9203-5ec4a68f02fc tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:43 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9fe473af-fd24-4f13-9203-5ec4a68f02fc tempest-VolumesSnapshotTestJSON-661765892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:25:43 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9fe473af-fd24-4f13-9203-5ec4a68f02fc tempest-VolumesSnapshotTestJSON-661765892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:25:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9fe473af-fd24-4f13-9203-5ec4a68f02fc tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:25:43 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9fe473af-fd24-4f13-9203-5ec4a68f02fc tempest-VolumesSnapshotTestJSON-661765892 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:25:43 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-9fe473af-fd24-4f13-9203-5ec4a68f02fc tempest-VolumesSnapshotTestJSON-661765892 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:25:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9fe473af-fd24-4f13-9203-5ec4a68f02fc tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:43 devstack sudo[96941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853 1073741824 Jun 02 03:25:43 devstack sudo[96941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2bcaa4e8-7584-43a5-b2d0-9062cd0a8061 tempest-VolumesTransfersV355Test-1301733984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ed0409-c9e1-44ce-b833-b49754c0b444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92f69dbe-342c-45b4-aa15-fbf8712f0fbc', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2bcaa4e8-7584-43a5-b2d0-9062cd0a8061 tempest-VolumesTransfersV355Test-1301733984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbdbcfa6-155e-487f-9352-d4e705e83644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:43 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-2bcaa4e8-7584-43a5-b2d0-9062cd0a8061 tempest-VolumesTransfersV355Test-1301733984 None] Volume volume-92f69dbe-342c-45b4-aa15-fbf8712f0fbc (92f69dbe-342c-45b4-aa15-fbf8712f0fbc): created successfully Jun 02 03:25:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2bcaa4e8-7584-43a5-b2d0-9062cd0a8061 tempest-VolumesTransfersV355Test-1301733984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbdbcfa6-155e-487f-9352-d4e705e83644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2bcaa4e8-7584-43a5-b2d0-9062cd0a8061 tempest-VolumesTransfersV355Test-1301733984 None] Flow 'volume_create_manager' (bf3bea9b-c368-4a45-846d-e378339907b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:25:43 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-2bcaa4e8-7584-43a5-b2d0-9062cd0a8061 tempest-VolumesTransfersV355Test-1301733984 None] Created volume successfully. Jun 02 03:25:43 devstack sudo[96933]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cde53225-9323-4e1a-971a-146dad1d0f6a tempest-SnapshotsActionsTest-999197762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.97a33487-41f7-4e87-8f7d-9e9dbc4a0a2b" returned: 0 in 0.903s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:43 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-cde53225-9323-4e1a-971a-146dad1d0f6a tempest-SnapshotsActionsTest-999197762 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7eacdf65-0ba7-4817-8477-d79f05c256c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:25:43 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec028e5-3766-4a71-be8a-b422bd432a23]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:25:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cde53225-9323-4e1a-971a-146dad1d0f6a tempest-SnapshotsActionsTest-999197762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:43 devstack sudo[96938]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_n5lpe78zdevstack@QuobyteHD" returned: 0 in 0.764s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:43 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 Jun 02 03:25:43 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:43 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5c277e42-7391-4dfe-88b3-657ece6f0ee2 tempest-VolumesTransfersV355Test-853162801 None] Acquiring lock "cinder-92f69dbe-342c-45b4-aa15-fbf8712f0fbc-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:43 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5c277e42-7391-4dfe-88b3-657ece6f0ee2 tempest-VolumesTransfersV355Test-853162801 None] Lock "cinder-92f69dbe-342c-45b4-aa15-fbf8712f0fbc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:43 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5c277e42-7391-4dfe-88b3-657ece6f0ee2 tempest-VolumesTransfersV355Test-853162801 None] Acquiring lock "cinder-quobyte-92f69dbe-342c-45b4-aa15-fbf8712f0fbc" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:43 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5c277e42-7391-4dfe-88b3-657ece6f0ee2 tempest-VolumesTransfersV355Test-853162801 None] Lock "cinder-quobyte-92f69dbe-342c-45b4-aa15-fbf8712f0fbc" acquired by "delete_volume" :: waited 0.017s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:43 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[d916f5bd-0917-4948-a6ce-05ce2feae7a3]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:25:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5c277e42-7391-4dfe-88b3-657ece6f0ee2 tempest-VolumesTransfersV355Test-853162801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-92f69dbe-342c-45b4-aa15-fbf8712f0fbc {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:43 devstack sudo[96956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-92f69dbe-342c-45b4-aa15-fbf8712f0fbc Jun 02 03:25:43 devstack sudo[96956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:44 devstack sudo[96941]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9fe473af-fd24-4f13-9203-5ec4a68f02fc tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853 1073741824" returned: 0 in 0.915s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9fe473af-fd24-4f13-9203-5ec4a68f02fc tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:44 devstack sudo[96958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853 Jun 02 03:25:44 devstack sudo[96958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:44 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cde53225-9323-4e1a-971a-146dad1d0f6a tempest-SnapshotsActionsTest-999197762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2" returned: 0 in 0.825s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:44 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-cde53225-9323-4e1a-971a-146dad1d0f6a tempest-SnapshotsActionsTest-999197762 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7eacdf65-0ba7-4817-8477-d79f05c256c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:25:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cde53225-9323-4e1a-971a-146dad1d0f6a tempest-SnapshotsActionsTest-999197762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.97a33487-41f7-4e87-8f7d-9e9dbc4a0a2b {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:44 devstack sudo[96963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.97a33487-41f7-4e87-8f7d-9e9dbc4a0a2b Jun 02 03:25:44 devstack sudo[96963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:44 devstack sudo[96956]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5c277e42-7391-4dfe-88b3-657ece6f0ee2 tempest-VolumesTransfersV355Test-853162801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-92f69dbe-342c-45b4-aa15-fbf8712f0fbc" returned: 0 in 0.763s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5c277e42-7391-4dfe-88b3-657ece6f0ee2 tempest-VolumesTransfersV355Test-853162801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-92f69dbe-342c-45b4-aa15-fbf8712f0fbc {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:44 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-92f69dbe-342c-45b4-aa15-fbf8712f0fbc Jun 02 03:25:44 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:44 devstack sudo[96958]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9fe473af-fd24-4f13-9203-5ec4a68f02fc tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853" returned: 0 in 0.650s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:44 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9fe473af-fd24-4f13-9203-5ec4a68f02fc tempest-VolumesSnapshotTestJSON-661765892 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:25:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9fe473af-fd24-4f13-9203-5ec4a68f02fc tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:25:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.087s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:44 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1994633076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=234f078a-de14-4902-befa-a027d2a4b25a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='000b89ca2f1a4e4c82bce74f256353b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:25:41Z,use_quota=True,user_id='900bd244c8d349afab2e5600caab4677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:25:44 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Creating volume 234f078a-de14-4902-befa-a027d2a4b25a {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:25:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:44 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:25:44 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:25:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:25:44 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:25:44 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:25:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-234f078a-de14-4902-befa-a027d2a4b25a 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:44 devstack sudo[96971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-234f078a-de14-4902-befa-a027d2a4b25a 1073741824 Jun 02 03:25:44 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9fe473af-fd24-4f13-9203-5ec4a68f02fc tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (009c2572-01d8-40a2-92e4-d6315130a0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9fe473af-fd24-4f13-9203-5ec4a68f02fc tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (503ac8c9-0cfb-4609-82ef-a86e4c5f239b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:44 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-9fe473af-fd24-4f13-9203-5ec4a68f02fc tempest-VolumesSnapshotTestJSON-661765892 None] Volume volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853 (6da2e2a9-b21e-44e8-9e5d-6c39db872853): created successfully Jun 02 03:25:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9fe473af-fd24-4f13-9203-5ec4a68f02fc tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (503ac8c9-0cfb-4609-82ef-a86e4c5f239b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9fe473af-fd24-4f13-9203-5ec4a68f02fc tempest-VolumesSnapshotTestJSON-661765892 None] Flow 'volume_create_manager' (49a7d652-1a5a-492b-b264-47533addf98b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:25:44 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-9fe473af-fd24-4f13-9203-5ec4a68f02fc tempest-VolumesSnapshotTestJSON-661765892 None] Created volume successfully. Jun 02 03:25:45 devstack sudo[96963]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cde53225-9323-4e1a-971a-146dad1d0f6a tempest-SnapshotsActionsTest-999197762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.97a33487-41f7-4e87-8f7d-9e9dbc4a0a2b" returned: 0 in 0.750s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cde53225-9323-4e1a-971a-146dad1d0f6a tempest-SnapshotsActionsTest-999197762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.97a33487-41f7-4e87-8f7d-9e9dbc4a0a2b {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:45 devstack sudo[96976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.97a33487-41f7-4e87-8f7d-9e9dbc4a0a2b Jun 02 03:25:45 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:45 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5c277e42-7391-4dfe-88b3-657ece6f0ee2 tempest-VolumesTransfersV355Test-853162801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-92f69dbe-342c-45b4-aa15-fbf8712f0fbc" returned: 0 in 0.630s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:45 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5c277e42-7391-4dfe-88b3-657ece6f0ee2 tempest-VolumesTransfersV355Test-853162801 None] Lock "cinder-quobyte-92f69dbe-342c-45b4-aa15-fbf8712f0fbc" released by "delete_volume" :: held 1.435s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:25:45 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-5c277e42-7391-4dfe-88b3-657ece6f0ee2 tempest-VolumesTransfersV355Test-853162801 None] Created reservations ['ad03a8aa-6bdf-49b1-bd47-5312145e882a', '6284a718-505d-4776-ab31-f267522fcde7', '993e9a95-05ca-494e-accc-098d4c398fc7', 'c8cf84c0-8c3c-4b04-bc54-ec289fe8b6ad'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:25:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5c277e42-7391-4dfe-88b3-657ece6f0ee2 tempest-VolumesTransfersV355Test-853162801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5c277e42-7391-4dfe-88b3-657ece6f0ee2 tempest-VolumesTransfersV355Test-853162801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:45 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-5c277e42-7391-4dfe-88b3-657ece6f0ee2 tempest-VolumesTransfersV355Test-853162801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:25:45 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-5c277e42-7391-4dfe-88b3-657ece6f0ee2 tempest-VolumesTransfersV355Test-853162801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:25:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5c277e42-7391-4dfe-88b3-657ece6f0ee2 tempest-VolumesTransfersV355Test-853162801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:25:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5c277e42-7391-4dfe-88b3-657ece6f0ee2 tempest-VolumesTransfersV355Test-853162801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:45 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:25:45 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:45 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-234f078a-de14-4902-befa-a027d2a4b25a 1073741824" returned: 0 in 0.876s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-234f078a-de14-4902-befa-a027d2a4b25a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:45 devstack sudo[96986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-234f078a-de14-4902-befa-a027d2a4b25a Jun 02 03:25:45 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:45 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cde53225-9323-4e1a-971a-146dad1d0f6a tempest-SnapshotsActionsTest-999197762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.97a33487-41f7-4e87-8f7d-9e9dbc4a0a2b" returned: 0 in 0.668s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:45 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-cde53225-9323-4e1a-971a-146dad1d0f6a tempest-SnapshotsActionsTest-999197762 None] Lock "cinder-quobyte-97a33487-41f7-4e87-8f7d-9e9dbc4a0a2b" released by "_delete_snapshot" :: held 3.278s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:25:45 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-cde53225-9323-4e1a-971a-146dad1d0f6a tempest-SnapshotsActionsTest-999197762 None] Lock "cinder-quobyte-7eacdf65-0ba7-4817-8477-d79f05c256c9" released by "delete_snapshot" :: held 3.306s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:25:45 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-cde53225-9323-4e1a-971a-146dad1d0f6a tempest-SnapshotsActionsTest-999197762 None] Created reservations ['4ebd11f3-e3d5-4ac7-9e54-bb67591a654f', 'df5e5e1b-7005-4246-96c3-f4a5ff7135b8', '394ffc02-39e3-4607-af65-9300b663f911', 'd3670e81-9da7-40e2-92a0-9352cf87a880'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:25:45 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-cde53225-9323-4e1a-971a-146dad1d0f6a tempest-SnapshotsActionsTest-999197762 None] Delete snapshot completed successfully. Jun 02 03:25:45 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-cde53225-9323-4e1a-971a-146dad1d0f6a tempest-SnapshotsActionsTest-999197762 None] Lock "cinder-97a33487-41f7-4e87-8f7d-9e9dbc4a0a2b-delete_snapshot" released by "delete_snapshot" :: held 3.470s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:25:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-af4e553f-a5ff-4b6c-8aac-057ba450cd3c tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:46 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5c277e42-7391-4dfe-88b3-657ece6f0ee2 tempest-VolumesTransfersV355Test-853162801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.729s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:46 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-5c277e42-7391-4dfe-88b3-657ece6f0ee2 tempest-VolumesTransfersV355Test-853162801 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:25:46 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-5c277e42-7391-4dfe-88b3-657ece6f0ee2 tempest-VolumesTransfersV355Test-853162801 None] Deleted volume successfully. Jun 02 03:25:46 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5c277e42-7391-4dfe-88b3-657ece6f0ee2 tempest-VolumesTransfersV355Test-853162801 None] Lock "cinder-92f69dbe-342c-45b4-aa15-fbf8712f0fbc-delete_volume" released by "delete_volume" :: held 2.391s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:25:46 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-234f078a-de14-4902-befa-a027d2a4b25a" returned: 0 in 0.722s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:46 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:25:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:25:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-af4e553f-a5ff-4b6c-8aac-057ba450cd3c tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.297s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:46 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-af4e553f-a5ff-4b6c-8aac-057ba450cd3c tempest-VolumesSnapshotTestJSON-661765892 None] Creating offline snapshot 76a3c4dc-2e58-467c-aabe-569b6da5ddae of volume 6da2e2a9-b21e-44e8-9e5d-6c39db872853 {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:25:46 devstack cinder-volume[86431]: DEBUG cinder.volume.volume_utils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Attempting download of 54f2c102-8f54-4d66-966a-3fc746680841 ((None, [{'url': 'file:///opt/stack/data/glance/images/54f2c102-8f54-4d66-966a-3fc746680841', 'metadata': {}}])) to volume 234f078a-de14-4902-befa-a027d2a4b25a. {{(pid=86431) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 02 03:25:46 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a38a587-1c12-4ed8-93a2-48d86b054423]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:25:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-af4e553f-a5ff-4b6c-8aac-057ba450cd3c tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:46 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc509802-8983-46bd-b66d-897f0f9b2d2d]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:25:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54f2c102-8f54-4d66-966a-3fc746680841_kex2gawb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:46 devstack sudo[96990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853 Jun 02 03:25:46 devstack sudo[96990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:46 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54f2c102-8f54-4d66-966a-3fc746680841_kex2gawb Jun 02 03:25:46 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8100346b-ba39-4f4b-9d13-14240fd99e1c tempest-SnapshotsActionsTest-1531810083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:47 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54f2c102-8f54-4d66-966a-3fc746680841_kex2gawb" returned: 0 in 0.770s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54f2c102-8f54-4d66-966a-3fc746680841_kex2gawb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:47 devstack sudo[96990]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-af4e553f-a5ff-4b6c-8aac-057ba450cd3c tempest-VolumesSnapshotTestJSON-661765892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853" returned: 0 in 0.833s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-af4e553f-a5ff-4b6c-8aac-057ba450cd3c tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853.76a3c4dc-2e58-467c-aabe-569b6da5ddae 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:47 devstack sudo[97000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853.76a3c4dc-2e58-467c-aabe-569b6da5ddae 1G Jun 02 03:25:47 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:47 devstack sudo[96999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54f2c102-8f54-4d66-966a-3fc746680841_kex2gawb Jun 02 03:25:47 devstack sudo[96999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:48 devstack sudo[96999]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54f2c102-8f54-4d66-966a-3fc746680841_kex2gawb" returned: 1 in 0.792s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54f2c102-8f54-4d66-966a-3fc746680841_kex2gawb' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:25:48 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a56b3c-a187-4bd7-8aab-aab06831f7bb]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:25:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_n5lpe78zdevstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:48 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-af4e553f-a5ff-4b6c-8aac-057ba450cd3c tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853.76a3c4dc-2e58-467c-aabe-569b6da5ddae 1G" returned: 0 in 0.879s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-af4e553f-a5ff-4b6c-8aac-057ba450cd3c tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853.76a3c4dc-2e58-467c-aabe-569b6da5ddae {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:48 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_n5lpe78zdevstack@QuobyteHD Jun 02 03:25:48 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:48 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853.76a3c4dc-2e58-467c-aabe-569b6da5ddae Jun 02 03:25:48 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:48 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_n5lpe78zdevstack@QuobyteHD" returned: 0 in 0.778s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:48 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] 54f2c102-8f54-4d66-966a-3fc746680841 was qcow2, converting to raw {{(pid=86431) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 02 03:25:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_n5lpe78zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-234f078a-de14-4902-befa-a027d2a4b25a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:48 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-af4e553f-a5ff-4b6c-8aac-057ba450cd3c tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853.76a3c4dc-2e58-467c-aabe-569b6da5ddae" returned: 0 in 0.710s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:48 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-af4e553f-a5ff-4b6c-8aac-057ba450cd3c tempest-VolumesSnapshotTestJSON-661765892 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853.76a3c4dc-2e58-467c-aabe-569b6da5ddae is being set with open permissions: ugo+rw Jun 02 03:25:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-af4e553f-a5ff-4b6c-8aac-057ba450cd3c tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853.76a3c4dc-2e58-467c-aabe-569b6da5ddae {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:48 devstack sudo[97020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_n5lpe78zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-234f078a-de14-4902-befa-a027d2a4b25a Jun 02 03:25:48 devstack sudo[97020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:48 devstack sudo[97022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853.76a3c4dc-2e58-467c-aabe-569b6da5ddae Jun 02 03:25:48 devstack sudo[97022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:49 devstack sudo[97022]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-af4e553f-a5ff-4b6c-8aac-057ba450cd3c tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853.76a3c4dc-2e58-467c-aabe-569b6da5ddae" returned: 0 in 0.665s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-af4e553f-a5ff-4b6c-8aac-057ba450cd3c tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:49 devstack sudo[97029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853.info Jun 02 03:25:49 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:50 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-af4e553f-a5ff-4b6c-8aac-057ba450cd3c tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853.info" returned: 0 in 0.688s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:50 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-af4e553f-a5ff-4b6c-8aac-057ba450cd3c tempest-VolumesSnapshotTestJSON-661765892 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853.info is being set with open permissions: ugo+rw Jun 02 03:25:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-af4e553f-a5ff-4b6c-8aac-057ba450cd3c tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:50 devstack sudo[97034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853.info Jun 02 03:25:50 devstack sudo[97034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:50 devstack sudo[97034]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-af4e553f-a5ff-4b6c-8aac-057ba450cd3c tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853.info" returned: 0 in 0.647s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-af4e553f-a5ff-4b6c-8aac-057ba450cd3c tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.544s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:25:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8100346b-ba39-4f4b-9d13-14240fd99e1c tempest-SnapshotsActionsTest-1531810083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.841s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:50 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-8100346b-ba39-4f4b-9d13-14240fd99e1c tempest-SnapshotsActionsTest-1531810083 None] Creating offline snapshot 3e239a76-32ea-483d-8099-e02f43ccfafa of volume 7eacdf65-0ba7-4817-8477-d79f05c256c9 {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:25:50 devstack sudo[97020]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_n5lpe78zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-234f078a-de14-4902-befa-a027d2a4b25a" returned: 0 in 2.169s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:51 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_n5lpe78zdevstack@QuobyteHD, size 112.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-234f078a-de14-4902-befa-a027d2a4b25a {{(pid=86431) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 02 03:25:51 devstack cinder-volume[86431]: INFO cinder.image.image_utils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Converted 112.00 MB image at 51.48 MB/s Jun 02 03:25:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-234f078a-de14-4902-befa-a027d2a4b25a 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:51 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[86683c8b-be85-4af6-bd73-2f7135d32b80]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:25:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8100346b-ba39-4f4b-9d13-14240fd99e1c tempest-SnapshotsActionsTest-1531810083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:51 devstack sudo[97037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-234f078a-de14-4902-befa-a027d2a4b25a 1G Jun 02 03:25:51 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:51 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-af4e553f-a5ff-4b6c-8aac-057ba450cd3c tempest-VolumesSnapshotTestJSON-661765892 None] Create snapshot completed successfully Jun 02 03:25:51 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 Jun 02 03:25:51 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:51 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e3834ab0-fd37-47ce-b306-2cc965c122ea tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "cinder-76a3c4dc-2e58-467c-aabe-569b6da5ddae-delete_snapshot" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:51 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e3834ab0-fd37-47ce-b306-2cc965c122ea tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-76a3c4dc-2e58-467c-aabe-569b6da5ddae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:51 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e3834ab0-fd37-47ce-b306-2cc965c122ea tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "cinder-quobyte-6da2e2a9-b21e-44e8-9e5d-6c39db872853" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:51 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e3834ab0-fd37-47ce-b306-2cc965c122ea tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-quobyte-6da2e2a9-b21e-44e8-9e5d-6c39db872853" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:51 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e3834ab0-fd37-47ce-b306-2cc965c122ea tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "cinder-quobyte-76a3c4dc-2e58-467c-aabe-569b6da5ddae" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:51 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e3834ab0-fd37-47ce-b306-2cc965c122ea tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-quobyte-76a3c4dc-2e58-467c-aabe-569b6da5ddae" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:51 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-e3834ab0-fd37-47ce-b306-2cc965c122ea tempest-VolumesSnapshotTestJSON-661765892 None] Deleting offline snapshot 76a3c4dc-2e58-467c-aabe-569b6da5ddae of volume 6da2e2a9-b21e-44e8-9e5d-6c39db872853 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:25:51 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-e3834ab0-fd37-47ce-b306-2cc965c122ea tempest-VolumesSnapshotTestJSON-661765892 None] snapshot_file for this snap is: volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853.76a3c4dc-2e58-467c-aabe-569b6da5ddae {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:25:51 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[20569d65-5d1d-4d05-b003-7d07f2595d77]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:25:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e3834ab0-fd37-47ce-b306-2cc965c122ea tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853.76a3c4dc-2e58-467c-aabe-569b6da5ddae {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:51 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-234f078a-de14-4902-befa-a027d2a4b25a 1G" returned: 0 in 0.787s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:51 devstack sudo[97044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853.76a3c4dc-2e58-467c-aabe-569b6da5ddae Jun 02 03:25:51 devstack sudo[97044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:51 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa8a763-4441-4a51-b24e-66312c5856e8]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:25:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-234f078a-de14-4902-befa-a027d2a4b25a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:51 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8100346b-ba39-4f4b-9d13-14240fd99e1c tempest-SnapshotsActionsTest-1531810083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2" returned: 0 in 0.865s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:51 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-8100346b-ba39-4f4b-9d13-14240fd99e1c tempest-SnapshotsActionsTest-1531810083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7eacdf65-0ba7-4817-8477-d79f05c256c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:25:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8100346b-ba39-4f4b-9d13-14240fd99e1c tempest-SnapshotsActionsTest-1531810083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.3e239a76-32ea-483d-8099-e02f43ccfafa 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:51 devstack sudo[97051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.3e239a76-32ea-483d-8099-e02f43ccfafa 1G Jun 02 03:25:51 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:52 devstack sudo[97050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-234f078a-de14-4902-befa-a027d2a4b25a Jun 02 03:25:52 devstack sudo[97050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:52 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-87e92b24-bc2a-4802-8be9-c851a90a1f36 tempest-VolumesCloneTest-1284791821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:25:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-87e92b24-bc2a-4802-8be9-c851a90a1f36 tempest-VolumesCloneTest-1284791821 None] Flow 'volume_create_manager' (4753f829-ba0c-4bf3-a710-705788ea0b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:25:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-87e92b24-bc2a-4802-8be9-c851a90a1f36 tempest-VolumesCloneTest-1284791821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb10e36-0a8d-4aca-aade-ba2ca69c6da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-87e92b24-bc2a-4802-8be9-c851a90a1f36 tempest-VolumesCloneTest-1284791821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb10e36-0a8d-4aca-aade-ba2ca69c6da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1450407134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9f1bfe0-87b5-4e70-91af-b12a6949fccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37df06fa682b408b88e63eb86581edec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:25:52Z,use_quota=True,user_id='95d17c20a99248068db98ae7323ae9e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-87e92b24-bc2a-4802-8be9-c851a90a1f36 tempest-VolumesCloneTest-1284791821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f74ec0f5-489f-489e-a55b-3d4f5e5b9bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-87e92b24-bc2a-4802-8be9-c851a90a1f36 tempest-VolumesCloneTest-1284791821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f74ec0f5-489f-489e-a55b-3d4f5e5b9bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-87e92b24-bc2a-4802-8be9-c851a90a1f36 tempest-VolumesCloneTest-1284791821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6904687f-4245-48a7-81d6-9006579935bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-87e92b24-bc2a-4802-8be9-c851a90a1f36 tempest-VolumesCloneTest-1284791821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6904687f-4245-48a7-81d6-9006579935bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9f1bfe0-87b5-4e70-91af-b12a6949fccb', 'volume_name': 'volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-87e92b24-bc2a-4802-8be9-c851a90a1f36 tempest-VolumesCloneTest-1284791821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af5ba730-76ef-47c6-b439-7ac448dbee6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-87e92b24-bc2a-4802-8be9-c851a90a1f36 tempest-VolumesCloneTest-1284791821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af5ba730-76ef-47c6-b439-7ac448dbee6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-87e92b24-bc2a-4802-8be9-c851a90a1f36 tempest-VolumesCloneTest-1284791821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b508fe1-9023-4900-829b-40531f1e26e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:52 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-87e92b24-bc2a-4802-8be9-c851a90a1f36 tempest-VolumesCloneTest-1284791821 None] Volume d9f1bfe0-87b5-4e70-91af-b12a6949fccb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb', 'volume_size': 1} Jun 02 03:25:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-87e92b24-bc2a-4802-8be9-c851a90a1f36 tempest-VolumesCloneTest-1284791821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:52 devstack sudo[97044]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e3834ab0-fd37-47ce-b306-2cc965c122ea tempest-VolumesSnapshotTestJSON-661765892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853.76a3c4dc-2e58-467c-aabe-569b6da5ddae" returned: 0 in 0.886s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:52 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-e3834ab0-fd37-47ce-b306-2cc965c122ea tempest-VolumesSnapshotTestJSON-661765892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:25:52 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc553e0-dc61-4f88-921f-980f63673582]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:25:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e3834ab0-fd37-47ce-b306-2cc965c122ea tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:52 devstack sudo[97050]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-234f078a-de14-4902-befa-a027d2a4b25a" returned: 0 in 0.788s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-234f078a-de14-4902-befa-a027d2a4b25a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:52 devstack sudo[97063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853 Jun 02 03:25:52 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:52 devstack sudo[97064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-234f078a-de14-4902-befa-a027d2a4b25a Jun 02 03:25:52 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:52 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8100346b-ba39-4f4b-9d13-14240fd99e1c tempest-SnapshotsActionsTest-1531810083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.3e239a76-32ea-483d-8099-e02f43ccfafa 1G" returned: 0 in 0.923s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8100346b-ba39-4f4b-9d13-14240fd99e1c tempest-SnapshotsActionsTest-1531810083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.3e239a76-32ea-483d-8099-e02f43ccfafa {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:52 devstack sudo[97068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.3e239a76-32ea-483d-8099-e02f43ccfafa Jun 02 03:25:52 devstack sudo[97068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:53 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e3834ab0-fd37-47ce-b306-2cc965c122ea tempest-VolumesSnapshotTestJSON-661765892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853" returned: 0 in 0.733s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e3834ab0-fd37-47ce-b306-2cc965c122ea tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853.76a3c4dc-2e58-467c-aabe-569b6da5ddae {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:53 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853.76a3c4dc-2e58-467c-aabe-569b6da5ddae Jun 02 03:25:53 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:53 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-234f078a-de14-4902-befa-a027d2a4b25a" returned: 1 in 0.749s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-234f078a-de14-4902-befa-a027d2a4b25a' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:25:53 devstack cinder-volume[86431]: DEBUG cinder.volume.volume_utils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Downloaded image 54f2c102-8f54-4d66-966a-3fc746680841 ((None, [{'url': 'file:///opt/stack/data/glance/images/54f2c102-8f54-4d66-966a-3fc746680841', 'metadata': {}}])) to volume 234f078a-de14-4902-befa-a027d2a4b25a successfully. {{(pid=86431) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 02 03:25:53 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Temporary image 54f2c102-8f54-4d66-966a-3fc746680841 for user 900bd244c8d349afab2e5600caab4677 is deleted. {{(pid=86431) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 02 03:25:53 devstack cinder-volume[86431]: DEBUG cinder.volume.volume_utils [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Marking volume 234f078a-de14-4902-befa-a027d2a4b25a as bootable. {{(pid=86431) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 02 03:25:53 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Copying metadata from image 54f2c102-8f54-4d66-966a-3fc746680841 to 234f078a-de14-4902-befa-a027d2a4b25a. {{(pid=86431) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 02 03:25:53 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Creating volume glance metadata for volume 234f078a-de14-4902-befa-a027d2a4b25a backed by image 54f2c102-8f54-4d66-966a-3fc746680841 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '54f2c102-8f54-4d66-966a-3fc746680841', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86431) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 02 03:25:53 devstack sudo[97068]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebf6f0bd-5b2b-4f92-902c-d1d5b0e8abb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-234f078a-de14-4902-befa-a027d2a4b25a', 'volume_size': 1, 'image_id': '54f2c102-8f54-4d66-966a-3fc746680841', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54f2c102-8f54-4d66-966a-3fc746680841', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48b06555345b4428a30a6f37e96ddabe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '54f2c102-8f54-4d66-966a-3fc746680841', 'created_at': datetime.datetime(2026, 6, 2, 1, 9, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 1, 9, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54f2c102-8f54-4d66-966a-3fc746680841/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec150c91-5e8a-44ff-bb12-4c9401097f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8100346b-ba39-4f4b-9d13-14240fd99e1c tempest-SnapshotsActionsTest-1531810083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.3e239a76-32ea-483d-8099-e02f43ccfafa" returned: 0 in 0.700s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:53 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-8100346b-ba39-4f4b-9d13-14240fd99e1c tempest-SnapshotsActionsTest-1531810083 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.3e239a76-32ea-483d-8099-e02f43ccfafa is being set with open permissions: ugo+rw Jun 02 03:25:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8100346b-ba39-4f4b-9d13-14240fd99e1c tempest-SnapshotsActionsTest-1531810083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.3e239a76-32ea-483d-8099-e02f43ccfafa {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:53 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Volume volume-234f078a-de14-4902-befa-a027d2a4b25a (234f078a-de14-4902-befa-a027d2a4b25a): created successfully Jun 02 03:25:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec150c91-5e8a-44ff-bb12-4c9401097f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:53 devstack sudo[97081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.3e239a76-32ea-483d-8099-e02f43ccfafa Jun 02 03:25:53 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Flow 'volume_create_manager' (2f59fd1a-23e8-47ee-923d-9382e07d3984) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:25:53 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-d9cccdf1-25ed-496e-b685-a8865a5a7db0 tempest-VolumesImageMetadata-1949127747 None] Created volume successfully. Jun 02 03:25:54 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e3834ab0-fd37-47ce-b306-2cc965c122ea tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853.76a3c4dc-2e58-467c-aabe-569b6da5ddae" returned: 0 in 0.735s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e3834ab0-fd37-47ce-b306-2cc965c122ea tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853.76a3c4dc-2e58-467c-aabe-569b6da5ddae {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:54 devstack sudo[97087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853.76a3c4dc-2e58-467c-aabe-569b6da5ddae Jun 02 03:25:54 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:54 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8100346b-ba39-4f4b-9d13-14240fd99e1c tempest-SnapshotsActionsTest-1531810083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.3e239a76-32ea-483d-8099-e02f43ccfafa" returned: 0 in 0.654s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8100346b-ba39-4f4b-9d13-14240fd99e1c tempest-SnapshotsActionsTest-1531810083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.264s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:25:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-87e92b24-bc2a-4802-8be9-c851a90a1f36 tempest-VolumesCloneTest-1284791821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.972s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:54 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-87e92b24-bc2a-4802-8be9-c851a90a1f36 tempest-VolumesCloneTest-1284791821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1450407134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9f1bfe0-87b5-4e70-91af-b12a6949fccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37df06fa682b408b88e63eb86581edec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:25:52Z,use_quota=True,user_id='95d17c20a99248068db98ae7323ae9e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:25:54 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-87e92b24-bc2a-4802-8be9-c851a90a1f36 tempest-VolumesCloneTest-1284791821 None] Creating volume d9f1bfe0-87b5-4e70-91af-b12a6949fccb {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:25:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-87e92b24-bc2a-4802-8be9-c851a90a1f36 tempest-VolumesCloneTest-1284791821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-87e92b24-bc2a-4802-8be9-c851a90a1f36 tempest-VolumesCloneTest-1284791821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:54 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-87e92b24-bc2a-4802-8be9-c851a90a1f36 tempest-VolumesCloneTest-1284791821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:25:54 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-87e92b24-bc2a-4802-8be9-c851a90a1f36 tempest-VolumesCloneTest-1284791821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:25:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-87e92b24-bc2a-4802-8be9-c851a90a1f36 tempest-VolumesCloneTest-1284791821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:25:54 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-87e92b24-bc2a-4802-8be9-c851a90a1f36 tempest-VolumesCloneTest-1284791821 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:25:54 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-87e92b24-bc2a-4802-8be9-c851a90a1f36 tempest-VolumesCloneTest-1284791821 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:25:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-87e92b24-bc2a-4802-8be9-c851a90a1f36 tempest-VolumesCloneTest-1284791821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:54 devstack sudo[97089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb 1073741824 Jun 02 03:25:54 devstack sudo[97089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:54 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-8100346b-ba39-4f4b-9d13-14240fd99e1c tempest-SnapshotsActionsTest-1531810083 None] Create snapshot completed successfully Jun 02 03:25:54 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-35d3d0e4-bc36-494b-a682-c997efe73032 tempest-VolumesImageMetadata-1949127747 None] Acquiring lock "cinder-234f078a-de14-4902-befa-a027d2a4b25a-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:54 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-35d3d0e4-bc36-494b-a682-c997efe73032 tempest-VolumesImageMetadata-1949127747 None] Lock "cinder-234f078a-de14-4902-befa-a027d2a4b25a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:54 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-35d3d0e4-bc36-494b-a682-c997efe73032 tempest-VolumesImageMetadata-1949127747 None] Acquiring lock "cinder-quobyte-234f078a-de14-4902-befa-a027d2a4b25a" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:54 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-35d3d0e4-bc36-494b-a682-c997efe73032 tempest-VolumesImageMetadata-1949127747 None] Lock "cinder-quobyte-234f078a-de14-4902-befa-a027d2a4b25a" acquired by "delete_volume" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:54 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-57ae9ab2-d57d-4ab6-8cdf-f0d3391ed820 tempest-SnapshotsActionsTest-999197762 None] Acquiring lock "cinder-3e239a76-32ea-483d-8099-e02f43ccfafa-delete_snapshot" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:54 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[971c95d1-b497-44f1-b0ae-8e3d22c7b5a3]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:25:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-35d3d0e4-bc36-494b-a682-c997efe73032 tempest-VolumesImageMetadata-1949127747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-234f078a-de14-4902-befa-a027d2a4b25a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:54 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-57ae9ab2-d57d-4ab6-8cdf-f0d3391ed820 tempest-SnapshotsActionsTest-999197762 None] Lock "cinder-3e239a76-32ea-483d-8099-e02f43ccfafa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:54 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-57ae9ab2-d57d-4ab6-8cdf-f0d3391ed820 tempest-SnapshotsActionsTest-999197762 None] Acquiring lock "cinder-quobyte-7eacdf65-0ba7-4817-8477-d79f05c256c9" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:54 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-57ae9ab2-d57d-4ab6-8cdf-f0d3391ed820 tempest-SnapshotsActionsTest-999197762 None] Lock "cinder-quobyte-7eacdf65-0ba7-4817-8477-d79f05c256c9" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:54 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-57ae9ab2-d57d-4ab6-8cdf-f0d3391ed820 tempest-SnapshotsActionsTest-999197762 None] Acquiring lock "cinder-quobyte-3e239a76-32ea-483d-8099-e02f43ccfafa" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:54 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-57ae9ab2-d57d-4ab6-8cdf-f0d3391ed820 tempest-SnapshotsActionsTest-999197762 None] Lock "cinder-quobyte-3e239a76-32ea-483d-8099-e02f43ccfafa" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:54 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-57ae9ab2-d57d-4ab6-8cdf-f0d3391ed820 tempest-SnapshotsActionsTest-999197762 None] Deleting offline snapshot 3e239a76-32ea-483d-8099-e02f43ccfafa of volume 7eacdf65-0ba7-4817-8477-d79f05c256c9 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:25:54 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-57ae9ab2-d57d-4ab6-8cdf-f0d3391ed820 tempest-SnapshotsActionsTest-999197762 None] snapshot_file for this snap is: volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.3e239a76-32ea-483d-8099-e02f43ccfafa {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:25:54 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca919528-54c0-4eef-a8b8-298a0bbd29bf]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:25:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-57ae9ab2-d57d-4ab6-8cdf-f0d3391ed820 tempest-SnapshotsActionsTest-999197762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.3e239a76-32ea-483d-8099-e02f43ccfafa {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:54 devstack sudo[97091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-234f078a-de14-4902-befa-a027d2a4b25a Jun 02 03:25:54 devstack sudo[97091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:54 devstack sudo[97092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.3e239a76-32ea-483d-8099-e02f43ccfafa Jun 02 03:25:54 devstack sudo[97092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:54 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e3834ab0-fd37-47ce-b306-2cc965c122ea tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853.76a3c4dc-2e58-467c-aabe-569b6da5ddae" returned: 0 in 0.768s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:54 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e3834ab0-fd37-47ce-b306-2cc965c122ea tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-quobyte-76a3c4dc-2e58-467c-aabe-569b6da5ddae" released by "_delete_snapshot" :: held 3.249s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:25:54 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e3834ab0-fd37-47ce-b306-2cc965c122ea tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-quobyte-6da2e2a9-b21e-44e8-9e5d-6c39db872853" released by "delete_snapshot" :: held 3.274s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:25:54 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-e3834ab0-fd37-47ce-b306-2cc965c122ea tempest-VolumesSnapshotTestJSON-661765892 None] Created reservations ['78da69ff-f255-4f7f-9b68-101c481452f9', 'a8bc76a7-2069-45d0-9dff-569731bf3908', '2583257e-fe7f-480b-b5fb-95e5eaa2c232', 'd0e25668-3590-4c35-a80e-540b7491ac49'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:25:54 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-e3834ab0-fd37-47ce-b306-2cc965c122ea tempest-VolumesSnapshotTestJSON-661765892 None] Delete snapshot completed successfully. Jun 02 03:25:55 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e3834ab0-fd37-47ce-b306-2cc965c122ea tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-76a3c4dc-2e58-467c-aabe-569b6da5ddae-delete_snapshot" released by "delete_snapshot" :: held 3.468s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:25:55 devstack sudo[97089]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-87e92b24-bc2a-4802-8be9-c851a90a1f36 tempest-VolumesCloneTest-1284791821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb 1073741824" returned: 0 in 0.947s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-87e92b24-bc2a-4802-8be9-c851a90a1f36 tempest-VolumesCloneTest-1284791821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:55 devstack sudo[97102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb Jun 02 03:25:55 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:55 devstack sudo[97091]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-35d3d0e4-bc36-494b-a682-c997efe73032 tempest-VolumesImageMetadata-1949127747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-234f078a-de14-4902-befa-a027d2a4b25a" returned: 0 in 0.797s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-35d3d0e4-bc36-494b-a682-c997efe73032 tempest-VolumesImageMetadata-1949127747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-234f078a-de14-4902-befa-a027d2a4b25a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:55 devstack sudo[97104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-234f078a-de14-4902-befa-a027d2a4b25a Jun 02 03:25:55 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:55 devstack sudo[97092]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-57ae9ab2-d57d-4ab6-8cdf-f0d3391ed820 tempest-SnapshotsActionsTest-999197762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.3e239a76-32ea-483d-8099-e02f43ccfafa" returned: 0 in 0.860s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:55 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-57ae9ab2-d57d-4ab6-8cdf-f0d3391ed820 tempest-SnapshotsActionsTest-999197762 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7eacdf65-0ba7-4817-8477-d79f05c256c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:25:55 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45434c0-d9c3-4fa1-9f85-2027258e741d]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:25:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-57ae9ab2-d57d-4ab6-8cdf-f0d3391ed820 tempest-SnapshotsActionsTest-999197762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:55 devstack sudo[97109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 Jun 02 03:25:55 devstack sudo[97109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:55 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-87e92b24-bc2a-4802-8be9-c851a90a1f36 tempest-VolumesCloneTest-1284791821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb" returned: 0 in 0.696s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:55 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-87e92b24-bc2a-4802-8be9-c851a90a1f36 tempest-VolumesCloneTest-1284791821 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:25:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-87e92b24-bc2a-4802-8be9-c851a90a1f36 tempest-VolumesCloneTest-1284791821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:25:55 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-87e92b24-bc2a-4802-8be9-c851a90a1f36 tempest-VolumesCloneTest-1284791821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b508fe1-9023-4900-829b-40531f1e26e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:55 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-87e92b24-bc2a-4802-8be9-c851a90a1f36 tempest-VolumesCloneTest-1284791821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (394a6f44-60e3-4986-bef8-5ed0068c0f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:55 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-87e92b24-bc2a-4802-8be9-c851a90a1f36 tempest-VolumesCloneTest-1284791821 None] Volume volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb (d9f1bfe0-87b5-4e70-91af-b12a6949fccb): created successfully Jun 02 03:25:55 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-87e92b24-bc2a-4802-8be9-c851a90a1f36 tempest-VolumesCloneTest-1284791821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (394a6f44-60e3-4986-bef8-5ed0068c0f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:55 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-87e92b24-bc2a-4802-8be9-c851a90a1f36 tempest-VolumesCloneTest-1284791821 None] Flow 'volume_create_manager' (4753f829-ba0c-4bf3-a710-705788ea0b31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:25:56 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-87e92b24-bc2a-4802-8be9-c851a90a1f36 tempest-VolumesCloneTest-1284791821 None] Created volume successfully. Jun 02 03:25:56 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-35d3d0e4-bc36-494b-a682-c997efe73032 tempest-VolumesImageMetadata-1949127747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-234f078a-de14-4902-befa-a027d2a4b25a" returned: 1 in 0.779s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-35d3d0e4-bc36-494b-a682-c997efe73032 tempest-VolumesImageMetadata-1949127747 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-234f078a-de14-4902-befa-a027d2a4b25a' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-35d3d0e4-bc36-494b-a682-c997efe73032 tempest-VolumesImageMetadata-1949127747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-234f078a-de14-4902-befa-a027d2a4b25a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:56 devstack sudo[97115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-234f078a-de14-4902-befa-a027d2a4b25a Jun 02 03:25:56 devstack sudo[97115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4318c97-f472-4aa0-8b6f-7b8b75fdb9d1 tempest-VolumesSnapshotTestJSON-661765892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a4318c97-f472-4aa0-8b6f-7b8b75fdb9d1 tempest-VolumesSnapshotTestJSON-661765892 None] Flow 'volume_create_manager' (aa5fe4c5-4862-4144-a14c-8f41211d808b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a4318c97-f472-4aa0-8b6f-7b8b75fdb9d1 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (602dba74-bc87-45df-821f-1d32e04dad9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a4318c97-f472-4aa0-8b6f-7b8b75fdb9d1 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (602dba74-bc87-45df-821f-1d32e04dad9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-635764013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5758466c-a360-472b-ae6d-dae4b565a18c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f92811de804e4da9af80175226575210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:25:56Z,use_quota=True,user_id='6c94587123b44232a21505de6aec93e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:56 devstack sudo[97109]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a4318c97-f472-4aa0-8b6f-7b8b75fdb9d1 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (503ab684-3a6f-4834-b965-877a76586680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a4318c97-f472-4aa0-8b6f-7b8b75fdb9d1 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (503ab684-3a6f-4834-b965-877a76586680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a4318c97-f472-4aa0-8b6f-7b8b75fdb9d1 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5997d673-5b95-4216-b1d3-b627e097be35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a4318c97-f472-4aa0-8b6f-7b8b75fdb9d1 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5997d673-5b95-4216-b1d3-b627e097be35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5758466c-a360-472b-ae6d-dae4b565a18c', 'volume_name': 'volume-5758466c-a360-472b-ae6d-dae4b565a18c', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a4318c97-f472-4aa0-8b6f-7b8b75fdb9d1 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d356355d-4dc3-4392-9df3-247eeac92e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a4318c97-f472-4aa0-8b6f-7b8b75fdb9d1 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d356355d-4dc3-4392-9df3-247eeac92e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a4318c97-f472-4aa0-8b6f-7b8b75fdb9d1 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4f3104-e47a-43b9-a241-74f271108888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:56 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-a4318c97-f472-4aa0-8b6f-7b8b75fdb9d1 tempest-VolumesSnapshotTestJSON-661765892 None] Volume 5758466c-a360-472b-ae6d-dae4b565a18c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5758466c-a360-472b-ae6d-dae4b565a18c', 'volume_size': 1} Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a4318c97-f472-4aa0-8b6f-7b8b75fdb9d1 tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a4318c97-f472-4aa0-8b6f-7b8b75fdb9d1 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a4318c97-f472-4aa0-8b6f-7b8b75fdb9d1 tempest-VolumesSnapshotTestJSON-661765892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-635764013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5758466c-a360-472b-ae6d-dae4b565a18c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f92811de804e4da9af80175226575210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:25:56Z,use_quota=True,user_id='6c94587123b44232a21505de6aec93e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-a4318c97-f472-4aa0-8b6f-7b8b75fdb9d1 tempest-VolumesSnapshotTestJSON-661765892 None] Creating volume 5758466c-a360-472b-ae6d-dae4b565a18c {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a4318c97-f472-4aa0-8b6f-7b8b75fdb9d1 tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a4318c97-f472-4aa0-8b6f-7b8b75fdb9d1 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a4318c97-f472-4aa0-8b6f-7b8b75fdb9d1 tempest-VolumesSnapshotTestJSON-661765892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a4318c97-f472-4aa0-8b6f-7b8b75fdb9d1 tempest-VolumesSnapshotTestJSON-661765892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a4318c97-f472-4aa0-8b6f-7b8b75fdb9d1 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a4318c97-f472-4aa0-8b6f-7b8b75fdb9d1 tempest-VolumesSnapshotTestJSON-661765892 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:25:56 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-a4318c97-f472-4aa0-8b6f-7b8b75fdb9d1 tempest-VolumesSnapshotTestJSON-661765892 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a4318c97-f472-4aa0-8b6f-7b8b75fdb9d1 tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-57ae9ab2-d57d-4ab6-8cdf-f0d3391ed820 tempest-SnapshotsActionsTest-999197762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2" returned: 0 in 0.856s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-57ae9ab2-d57d-4ab6-8cdf-f0d3391ed820 tempest-SnapshotsActionsTest-999197762 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7eacdf65-0ba7-4817-8477-d79f05c256c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-57ae9ab2-d57d-4ab6-8cdf-f0d3391ed820 tempest-SnapshotsActionsTest-999197762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.3e239a76-32ea-483d-8099-e02f43ccfafa {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:56 devstack sudo[97120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c 1073741824 Jun 02 03:25:56 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:56 devstack sudo[97121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.3e239a76-32ea-483d-8099-e02f43ccfafa Jun 02 03:25:56 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:56 devstack sudo[97115]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-35d3d0e4-bc36-494b-a682-c997efe73032 tempest-VolumesImageMetadata-1949127747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-234f078a-de14-4902-befa-a027d2a4b25a" returned: 0 in 0.698s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-35d3d0e4-bc36-494b-a682-c997efe73032 tempest-VolumesImageMetadata-1949127747 None] Lock "cinder-quobyte-234f078a-de14-4902-befa-a027d2a4b25a" released by "delete_volume" :: held 2.384s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Flow 'volume_create_manager' (20ac8efb-25d7-4c47-837f-56c507c9e686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eedbe3b4-4044-4b1f-9ddd-98c7f89cfc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-35d3d0e4-bc36-494b-a682-c997efe73032 tempest-VolumesImageMetadata-1949127747 None] Created reservations ['e717b045-7ad0-4f49-b646-6282b4956e79', 'e9521918-071c-4c9c-9e21-8dae473dff80', '39623626-bbff-4ab1-bc3b-63f45f1f0e74', '6a956641-5b35-4a10-8f89-4c762c10ab87'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eedbe3b4-4044-4b1f-9ddd-98c7f89cfc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1811794743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e7d67cb-aba8-424f-aaaf-333264c91c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37df06fa682b408b88e63eb86581edec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:25:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=d9f1bfe0-87b5-4e70-91af-b12a6949fccb,status='creating',terminated_at=None,updated_at=2026-06-02T01:25:57Z,use_quota=True,user_id='95d17c20a99248068db98ae7323ae9e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (175525e2-b099-4afe-ad68-a6a72a0c4489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (175525e2-b099-4afe-ad68-a6a72a0c4489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ff1c772-8d80-4587-8aae-d978116428ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ff1c772-8d80-4587-8aae-d978116428ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0e7d67cb-aba8-424f-aaaf-333264c91c70', 'volume_name': 'volume-0e7d67cb-aba8-424f-aaaf-333264c91c70', 'volume_size': 2, 'source_volid': 'd9f1bfe0-87b5-4e70-91af-b12a6949fccb', 'source_volstatus': 'available'}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e49a95ef-3314-44c9-b7df-1ae0247c71ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e49a95ef-3314-44c9-b7df-1ae0247c71ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (931a382a-f27d-41fa-82b7-74dc5500f57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:57 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Volume 0e7d67cb-aba8-424f-aaaf-333264c91c70: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0e7d67cb-aba8-424f-aaaf-333264c91c70', 'volume_size': 2, 'source_volid': 'd9f1bfe0-87b5-4e70-91af-b12a6949fccb', 'source_volstatus': 'available'} Jun 02 03:25:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-35d3d0e4-bc36-494b-a682-c997efe73032 tempest-VolumesImageMetadata-1949127747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-35d3d0e4-bc36-494b-a682-c997efe73032 tempest-VolumesImageMetadata-1949127747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:57 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-35d3d0e4-bc36-494b-a682-c997efe73032 tempest-VolumesImageMetadata-1949127747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:25:57 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-35d3d0e4-bc36-494b-a682-c997efe73032 tempest-VolumesImageMetadata-1949127747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:25:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-35d3d0e4-bc36-494b-a682-c997efe73032 tempest-VolumesImageMetadata-1949127747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:25:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-35d3d0e4-bc36-494b-a682-c997efe73032 tempest-VolumesImageMetadata-1949127747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:57 devstack sudo[97132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:25:57 devstack sudo[97132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:57 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-57ae9ab2-d57d-4ab6-8cdf-f0d3391ed820 tempest-SnapshotsActionsTest-999197762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.3e239a76-32ea-483d-8099-e02f43ccfafa" returned: 0 in 0.873s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-57ae9ab2-d57d-4ab6-8cdf-f0d3391ed820 tempest-SnapshotsActionsTest-999197762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.3e239a76-32ea-483d-8099-e02f43ccfafa {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:57 devstack sudo[97134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.3e239a76-32ea-483d-8099-e02f43ccfafa Jun 02 03:25:57 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:57 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a4318c97-f472-4aa0-8b6f-7b8b75fdb9d1 tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c 1073741824" returned: 0 in 0.943s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a4318c97-f472-4aa0-8b6f-7b8b75fdb9d1 tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:57 devstack sudo[97136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c Jun 02 03:25:57 devstack sudo[97136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:57 devstack sudo[97132]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-35d3d0e4-bc36-494b-a682-c997efe73032 tempest-VolumesImageMetadata-1949127747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.602s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:57 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-35d3d0e4-bc36-494b-a682-c997efe73032 tempest-VolumesImageMetadata-1949127747 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:25:57 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-35d3d0e4-bc36-494b-a682-c997efe73032 tempest-VolumesImageMetadata-1949127747 None] Deleted volume successfully. Jun 02 03:25:57 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-35d3d0e4-bc36-494b-a682-c997efe73032 tempest-VolumesImageMetadata-1949127747 None] Lock "cinder-234f078a-de14-4902-befa-a027d2a4b25a-delete_volume" released by "delete_volume" :: held 3.380s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:25:57 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-57ae9ab2-d57d-4ab6-8cdf-f0d3391ed820 tempest-SnapshotsActionsTest-999197762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.3e239a76-32ea-483d-8099-e02f43ccfafa" returned: 0 in 0.635s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:57 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-57ae9ab2-d57d-4ab6-8cdf-f0d3391ed820 tempest-SnapshotsActionsTest-999197762 None] Lock "cinder-quobyte-3e239a76-32ea-483d-8099-e02f43ccfafa" released by "_delete_snapshot" :: held 3.344s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:25:57 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-57ae9ab2-d57d-4ab6-8cdf-f0d3391ed820 tempest-SnapshotsActionsTest-999197762 None] Lock "cinder-quobyte-7eacdf65-0ba7-4817-8477-d79f05c256c9" released by "delete_snapshot" :: held 3.375s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:25:57 devstack sudo[97136]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a4318c97-f472-4aa0-8b6f-7b8b75fdb9d1 tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c" returned: 0 in 0.642s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:57 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a4318c97-f472-4aa0-8b6f-7b8b75fdb9d1 tempest-VolumesSnapshotTestJSON-661765892 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:25:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a4318c97-f472-4aa0-8b6f-7b8b75fdb9d1 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:25:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.957s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:25:57 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Cloning volume d9f1bfe0-87b5-4e70-91af-b12a6949fccb to volume 0e7d67cb-aba8-424f-aaaf-333264c91c70 Jun 02 03:25:58 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-57ae9ab2-d57d-4ab6-8cdf-f0d3391ed820 tempest-SnapshotsActionsTest-999197762 None] Created reservations ['f311b58a-c6ab-4960-8adc-ef51bda1b1c0', 'c7f8d236-c773-46c3-bd61-a4d6005b4f87', '9e08d68f-7a68-4ae3-81cc-eea31b4fe1d4', '12ee5f6e-52cf-47f1-8ba4-b76099975625'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:25:58 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a4318c97-f472-4aa0-8b6f-7b8b75fdb9d1 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4f3104-e47a-43b9-a241-74f271108888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5758466c-a360-472b-ae6d-dae4b565a18c', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:58 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a4318c97-f472-4aa0-8b6f-7b8b75fdb9d1 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4b96616-d484-49ad-8ecd-c10c4358d9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:25:58 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-a4318c97-f472-4aa0-8b6f-7b8b75fdb9d1 tempest-VolumesSnapshotTestJSON-661765892 None] Volume volume-5758466c-a360-472b-ae6d-dae4b565a18c (5758466c-a360-472b-ae6d-dae4b565a18c): created successfully Jun 02 03:25:58 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a4318c97-f472-4aa0-8b6f-7b8b75fdb9d1 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4b96616-d484-49ad-8ecd-c10c4358d9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:25:58 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a4318c97-f472-4aa0-8b6f-7b8b75fdb9d1 tempest-VolumesSnapshotTestJSON-661765892 None] Flow 'volume_create_manager' (aa5fe4c5-4862-4144-a14c-8f41211d808b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:25:58 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Creating offline snapshot 8739e56e-9a31-45e4-b1fe-646b43f3a7c8 of volume d9f1bfe0-87b5-4e70-91af-b12a6949fccb {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:25:58 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-a4318c97-f472-4aa0-8b6f-7b8b75fdb9d1 tempest-VolumesSnapshotTestJSON-661765892 None] Created volume successfully. Jun 02 03:25:58 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac01a28-3c65-4e4b-bfd6-3f0cd541d98b]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:25:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:58 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-57ae9ab2-d57d-4ab6-8cdf-f0d3391ed820 tempest-SnapshotsActionsTest-999197762 None] Delete snapshot completed successfully. Jun 02 03:25:58 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-57ae9ab2-d57d-4ab6-8cdf-f0d3391ed820 tempest-SnapshotsActionsTest-999197762 None] Lock "cinder-3e239a76-32ea-483d-8099-e02f43ccfafa-delete_snapshot" released by "delete_snapshot" :: held 3.610s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:25:58 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb Jun 02 03:25:58 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c05f0809-6271-4329-82ef-7f2ea6fbf99c tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:25:58 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb" returned: 0 in 0.799s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb.8739e56e-9a31-45e4-b1fe-646b43f3a7c8 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:58 devstack sudo[97146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb.8739e56e-9a31-45e4-b1fe-646b43f3a7c8 1G Jun 02 03:25:58 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:59 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-117d1ad6-915d-4e60-aeb5-0dcbf12cb2bd tempest-SnapshotsActionsTest-1531810083 None] Acquiring lock "cinder-8ce326a5-4e31-4bed-b874-3c712a6d14d2-delete_snapshot" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:59 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-117d1ad6-915d-4e60-aeb5-0dcbf12cb2bd tempest-SnapshotsActionsTest-1531810083 None] Lock "cinder-8ce326a5-4e31-4bed-b874-3c712a6d14d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:59 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-117d1ad6-915d-4e60-aeb5-0dcbf12cb2bd tempest-SnapshotsActionsTest-1531810083 None] Acquiring lock "cinder-quobyte-7eacdf65-0ba7-4817-8477-d79f05c256c9" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:59 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-117d1ad6-915d-4e60-aeb5-0dcbf12cb2bd tempest-SnapshotsActionsTest-1531810083 None] Lock "cinder-quobyte-7eacdf65-0ba7-4817-8477-d79f05c256c9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:59 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-117d1ad6-915d-4e60-aeb5-0dcbf12cb2bd tempest-SnapshotsActionsTest-1531810083 None] Acquiring lock "cinder-quobyte-8ce326a5-4e31-4bed-b874-3c712a6d14d2" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:25:59 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-117d1ad6-915d-4e60-aeb5-0dcbf12cb2bd tempest-SnapshotsActionsTest-1531810083 None] Lock "cinder-quobyte-8ce326a5-4e31-4bed-b874-3c712a6d14d2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:25:59 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-117d1ad6-915d-4e60-aeb5-0dcbf12cb2bd tempest-SnapshotsActionsTest-1531810083 None] Deleting offline snapshot 8ce326a5-4e31-4bed-b874-3c712a6d14d2 of volume 7eacdf65-0ba7-4817-8477-d79f05c256c9 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:25:59 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-117d1ad6-915d-4e60-aeb5-0dcbf12cb2bd tempest-SnapshotsActionsTest-1531810083 None] snapshot_file for this snap is: volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:25:59 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f41d83-e28b-4ca4-9581-1d3702a7cc02]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:25:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-117d1ad6-915d-4e60-aeb5-0dcbf12cb2bd tempest-SnapshotsActionsTest-1531810083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:59 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 Jun 02 03:25:59 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:25:59 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root Jun 02 03:25:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb.8739e56e-9a31-45e4-b1fe-646b43f3a7c8 1G" returned: 0 in 0.854s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:25:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb.8739e56e-9a31-45e4-b1fe-646b43f3a7c8 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:25:59 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb.8739e56e-9a31-45e4-b1fe-646b43f3a7c8 Jun 02 03:25:59 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:00 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-117d1ad6-915d-4e60-aeb5-0dcbf12cb2bd tempest-SnapshotsActionsTest-1531810083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2" returned: 0 in 0.760s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:00 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-117d1ad6-915d-4e60-aeb5-0dcbf12cb2bd tempest-SnapshotsActionsTest-1531810083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7eacdf65-0ba7-4817-8477-d79f05c256c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:26:00 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[758d5a8d-9190-4b68-a84f-2a7680abe2c4]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:26:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-117d1ad6-915d-4e60-aeb5-0dcbf12cb2bd tempest-SnapshotsActionsTest-1531810083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:00 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9 Jun 02 03:26:00 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:00 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb.8739e56e-9a31-45e4-b1fe-646b43f3a7c8" returned: 0 in 0.750s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:00 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb.8739e56e-9a31-45e4-b1fe-646b43f3a7c8 is being set with open permissions: ugo+rw Jun 02 03:26:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb.8739e56e-9a31-45e4-b1fe-646b43f3a7c8 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:00 devstack sudo[97165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb.8739e56e-9a31-45e4-b1fe-646b43f3a7c8 Jun 02 03:26:00 devstack sudo[97165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:00 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9feaa24-2742-48b0-add8-1852ffa72ba3 tempest-SnapshotMetadataTestJSON-2102040595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:26:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-c9feaa24-2742-48b0-add8-1852ffa72ba3 tempest-SnapshotMetadataTestJSON-2102040595 None] Flow 'volume_create_manager' (bff63d99-3aac-4f6f-b4f3-e91453ff8bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:26:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-c9feaa24-2742-48b0-add8-1852ffa72ba3 tempest-SnapshotMetadataTestJSON-2102040595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (237fa7cf-dc34-4bbc-a3d6-af15144587ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-c9feaa24-2742-48b0-add8-1852ffa72ba3 tempest-SnapshotMetadataTestJSON-2102040595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (237fa7cf-dc34-4bbc-a3d6-af15144587ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1429111978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b1fedfb-93f4-4aa5-8437-c3ad8533c08f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a8f1e430dee4d92a065dbbcd29c3b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:26:01Z,use_quota=True,user_id='94b1946ab303424e8bb7b048c0c471ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-c9feaa24-2742-48b0-add8-1852ffa72ba3 tempest-SnapshotMetadataTestJSON-2102040595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d4d080f-bccf-4ed6-ad27-9d43ffd44dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-c9feaa24-2742-48b0-add8-1852ffa72ba3 tempest-SnapshotMetadataTestJSON-2102040595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d4d080f-bccf-4ed6-ad27-9d43ffd44dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-c9feaa24-2742-48b0-add8-1852ffa72ba3 tempest-SnapshotMetadataTestJSON-2102040595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99e49222-a514-4866-9232-866744d13f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-c9feaa24-2742-48b0-add8-1852ffa72ba3 tempest-SnapshotMetadataTestJSON-2102040595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99e49222-a514-4866-9232-866744d13f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b1fedfb-93f4-4aa5-8437-c3ad8533c08f', 'volume_name': 'volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-c9feaa24-2742-48b0-add8-1852ffa72ba3 tempest-SnapshotMetadataTestJSON-2102040595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0060eaa2-0353-4ef4-b360-52959ea696ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-c9feaa24-2742-48b0-add8-1852ffa72ba3 tempest-SnapshotMetadataTestJSON-2102040595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0060eaa2-0353-4ef4-b360-52959ea696ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-c9feaa24-2742-48b0-add8-1852ffa72ba3 tempest-SnapshotMetadataTestJSON-2102040595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de08b2df-e4d0-4101-9f0b-d4cb53f8fbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:00 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-c9feaa24-2742-48b0-add8-1852ffa72ba3 tempest-SnapshotMetadataTestJSON-2102040595 None] Volume 1b1fedfb-93f4-4aa5-8437-c3ad8533c08f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f', 'volume_size': 1} Jun 02 03:26:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c9feaa24-2742-48b0-add8-1852ffa72ba3 tempest-SnapshotMetadataTestJSON-2102040595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:00 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-117d1ad6-915d-4e60-aeb5-0dcbf12cb2bd tempest-SnapshotsActionsTest-1531810083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9" returned: 0 in 0.746s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-117d1ad6-915d-4e60-aeb5-0dcbf12cb2bd tempest-SnapshotsActionsTest-1531810083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:00 devstack sudo[97170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 Jun 02 03:26:00 devstack sudo[97170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:01 devstack sudo[97165]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb.8739e56e-9a31-45e4-b1fe-646b43f3a7c8" returned: 0 in 0.607s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:01 devstack sudo[97173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb.info Jun 02 03:26:01 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:01 devstack sudo[97170]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-117d1ad6-915d-4e60-aeb5-0dcbf12cb2bd tempest-SnapshotsActionsTest-1531810083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2" returned: 0 in 0.667s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-117d1ad6-915d-4e60-aeb5-0dcbf12cb2bd tempest-SnapshotsActionsTest-1531810083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:01 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2 Jun 02 03:26:01 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:01 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb.info" returned: 0 in 0.647s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:01 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb.info is being set with open permissions: ugo+rw Jun 02 03:26:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:01 devstack sudo[97181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb.info Jun 02 03:26:01 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:02 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-117d1ad6-915d-4e60-aeb5-0dcbf12cb2bd tempest-SnapshotsActionsTest-1531810083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9.8ce326a5-4e31-4bed-b874-3c712a6d14d2" returned: 0 in 0.591s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:02 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-117d1ad6-915d-4e60-aeb5-0dcbf12cb2bd tempest-SnapshotsActionsTest-1531810083 None] Lock "cinder-quobyte-8ce326a5-4e31-4bed-b874-3c712a6d14d2" released by "_delete_snapshot" :: held 2.875s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:26:02 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-117d1ad6-915d-4e60-aeb5-0dcbf12cb2bd tempest-SnapshotsActionsTest-1531810083 None] Lock "cinder-quobyte-7eacdf65-0ba7-4817-8477-d79f05c256c9" released by "delete_snapshot" :: held 2.900s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:26:02 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-117d1ad6-915d-4e60-aeb5-0dcbf12cb2bd tempest-SnapshotsActionsTest-1531810083 None] Created reservations ['5e832250-7050-4629-aee6-d22ffc501e90', '61c8ce11-2213-4e6f-baeb-69206505f502', 'fdd2ec74-6fa0-47d6-bb48-c7c7d4d271a8', 'ef702aeb-9852-476a-9566-aca928f96b38'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:26:02 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-117d1ad6-915d-4e60-aeb5-0dcbf12cb2bd tempest-SnapshotsActionsTest-1531810083 None] Delete snapshot completed successfully. Jun 02 03:26:02 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-117d1ad6-915d-4e60-aeb5-0dcbf12cb2bd tempest-SnapshotsActionsTest-1531810083 None] Lock "cinder-8ce326a5-4e31-4bed-b874-3c712a6d14d2-delete_snapshot" released by "delete_snapshot" :: held 3.036s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:26:02 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb.info" returned: 0 in 0.623s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:02 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Acquiring lock "cinder-quobyte-0e7d67cb-aba8-424f-aaaf-333264c91c70" by "_copy_volume_from_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:26:02 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Lock "cinder-quobyte-0e7d67cb-aba8-424f-aaaf-333264c91c70" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:26:02 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] snapshot: 8739e56e-9a31-45e4-b1fe-646b43f3a7c8, volume: 0e7d67cb-aba8-424f-aaaf-333264c91c70, {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 03:26:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:02 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:26:02 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:26:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:02 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[701257c5-b9de-4ea9-ba1a-718d11deed3d]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:26:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb.8739e56e-9a31-45e4-b1fe-646b43f3a7c8 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:02 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-c4ddd554-21e2-47c0-81d7-07147f4458c7 tempest-SnapshotsActionsTest-1531810083 None] Acquiring lock "cinder-7eacdf65-0ba7-4817-8477-d79f05c256c9-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:26:02 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-c4ddd554-21e2-47c0-81d7-07147f4458c7 tempest-SnapshotsActionsTest-1531810083 None] Lock "cinder-7eacdf65-0ba7-4817-8477-d79f05c256c9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:26:02 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-c4ddd554-21e2-47c0-81d7-07147f4458c7 tempest-SnapshotsActionsTest-1531810083 None] Acquiring lock "cinder-quobyte-7eacdf65-0ba7-4817-8477-d79f05c256c9" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:26:02 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-c4ddd554-21e2-47c0-81d7-07147f4458c7 tempest-SnapshotsActionsTest-1531810083 None] Lock "cinder-quobyte-7eacdf65-0ba7-4817-8477-d79f05c256c9" acquired by "delete_volume" :: waited 0.021s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:26:02 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb.8739e56e-9a31-45e4-b1fe-646b43f3a7c8 Jun 02 03:26:02 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:02 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43835a4-e4cf-43e8-912f-6feb05f2fa78]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:26:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c4ddd554-21e2-47c0-81d7-07147f4458c7 tempest-SnapshotsActionsTest-1531810083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:02 devstack sudo[97188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9 Jun 02 03:26:02 devstack sudo[97188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:03 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb.8739e56e-9a31-45e4-b1fe-646b43f3a7c8" returned: 0 in 0.756s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:03 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:26:03 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 03:26:03 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Creating direct copy from snapshot {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 03:26:03 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fefac4-9198-41bb-bd1e-8392582cf819]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:26:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:03 devstack sudo[97188]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:03 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb Jun 02 03:26:03 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c4ddd554-21e2-47c0-81d7-07147f4458c7 tempest-SnapshotsActionsTest-1531810083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9" returned: 0 in 0.744s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c4ddd554-21e2-47c0-81d7-07147f4458c7 tempest-SnapshotsActionsTest-1531810083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:03 devstack sudo[97198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9 Jun 02 03:26:03 devstack sudo[97198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:03 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb" returned: 0 in 0.727s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:03 devstack cinder-volume[86431]: DEBUG cinder.utils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Path /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-0e7d67cb-aba8-424f-aaaf-333264c91c70 not found in is_blk_device check {{(pid=86431) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 02 03:26:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-0e7d67cb-aba8-424f-aaaf-333264c91c70 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:03 devstack sudo[97198]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c4ddd554-21e2-47c0-81d7-07147f4458c7 tempest-SnapshotsActionsTest-1531810083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7eacdf65-0ba7-4817-8477-d79f05c256c9" returned: 0 in 0.629s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:03 devstack sudo[97204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-0e7d67cb-aba8-424f-aaaf-333264c91c70 Jun 02 03:26:03 devstack sudo[97204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:03 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-c4ddd554-21e2-47c0-81d7-07147f4458c7 tempest-SnapshotsActionsTest-1531810083 None] Lock "cinder-quobyte-7eacdf65-0ba7-4817-8477-d79f05c256c9" released by "delete_volume" :: held 1.433s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:26:04 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-c4ddd554-21e2-47c0-81d7-07147f4458c7 tempest-SnapshotsActionsTest-1531810083 None] Created reservations ['b29f9f05-ebb1-420e-b5b9-6dcdda467018', 'ca4268b7-ebf2-45d7-ae6c-6f89e6437f07', 'c97adef2-40d4-4b91-add4-2aff70bfc7d2', '74e3da69-1f37-4ad6-be11-2f696817460c'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:26:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c4ddd554-21e2-47c0-81d7-07147f4458c7 tempest-SnapshotsActionsTest-1531810083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c4ddd554-21e2-47c0-81d7-07147f4458c7 tempest-SnapshotsActionsTest-1531810083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:04 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-c4ddd554-21e2-47c0-81d7-07147f4458c7 tempest-SnapshotsActionsTest-1531810083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:26:04 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-c4ddd554-21e2-47c0-81d7-07147f4458c7 tempest-SnapshotsActionsTest-1531810083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:26:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c4ddd554-21e2-47c0-81d7-07147f4458c7 tempest-SnapshotsActionsTest-1531810083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c4ddd554-21e2-47c0-81d7-07147f4458c7 tempest-SnapshotsActionsTest-1531810083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:04 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:26:04 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:04 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c4ddd554-21e2-47c0-81d7-07147f4458c7 tempest-SnapshotsActionsTest-1531810083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.616s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:04 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-c4ddd554-21e2-47c0-81d7-07147f4458c7 tempest-SnapshotsActionsTest-1531810083 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:26:04 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-c4ddd554-21e2-47c0-81d7-07147f4458c7 tempest-SnapshotsActionsTest-1531810083 None] Deleted volume successfully. Jun 02 03:26:04 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-c4ddd554-21e2-47c0-81d7-07147f4458c7 tempest-SnapshotsActionsTest-1531810083 None] Lock "cinder-7eacdf65-0ba7-4817-8477-d79f05c256c9-delete_volume" released by "delete_volume" :: held 2.259s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:26:09 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:26:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:26:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:26:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:09 devstack sudo[97222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:26:09 devstack sudo[97222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:09 devstack sudo[97204]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-0e7d67cb-aba8-424f-aaaf-333264c91c70" returned: 0 in 5.617s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:09 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a38a45a-3eff-472f-a691-197eddfd9c87]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:26:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:09 devstack sudo[97224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb Jun 02 03:26:09 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:10 devstack sudo[97222]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.634s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:10 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:26:10 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager._thread_info {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:26:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread count: 28 {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 02 03:26:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread info: [<_MainThread(MainThread, started 138618128814208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 02 03:26:10 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb" returned: 0 in 0.925s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:10 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Image conversion details: src /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb, size 1024.00 MB, duration 5.62 sec, destination /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-0e7d67cb-aba8-424f-aaaf-333264c91c70 {{(pid=86431) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 02 03:26:10 devstack cinder-volume[86431]: INFO cinder.image.image_utils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Converted 1024.00 MB image at 182.26 MB/s Jun 02 03:26:10 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-0e7d67cb-aba8-424f-aaaf-333264c91c70 is being set with open permissions: ugo+rw Jun 02 03:26:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-0e7d67cb-aba8-424f-aaaf-333264c91c70 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:10 devstack sudo[97230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-0e7d67cb-aba8-424f-aaaf-333264c91c70 Jun 02 03:26:10 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:11 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-0e7d67cb-aba8-424f-aaaf-333264c91c70" returned: 0 in 0.582s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:11 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Lock "cinder-quobyte-0e7d67cb-aba8-424f-aaaf-333264c91c70" released by "_copy_volume_from_snapshot" :: held 8.691s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:26:11 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Acquiring lock "cinder-quobyte-8739e56e-9a31-45e4-b1fe-646b43f3a7c8" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:26:11 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Lock "cinder-quobyte-8739e56e-9a31-45e4-b1fe-646b43f3a7c8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:26:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Deleting offline snapshot 8739e56e-9a31-45e4-b1fe-646b43f3a7c8 of volume d9f1bfe0-87b5-4e70-91af-b12a6949fccb {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:26:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] snapshot_file for this snap is: volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb.8739e56e-9a31-45e4-b1fe-646b43f3a7c8 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:26:11 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e1ee6c-bcab-408f-86e9-a69d4c096eb1]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:26:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb.8739e56e-9a31-45e4-b1fe-646b43f3a7c8 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:11 devstack sudo[97233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb.8739e56e-9a31-45e4-b1fe-646b43f3a7c8 Jun 02 03:26:11 devstack sudo[97233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:11 devstack sudo[97233]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb.8739e56e-9a31-45e4-b1fe-646b43f3a7c8" returned: 0 in 0.704s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:26:11 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44860cf-655e-4015-857f-882a3df8866c]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:26:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:12 devstack sudo[97238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb Jun 02 03:26:12 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:12 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb" returned: 0 in 0.696s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb.8739e56e-9a31-45e4-b1fe-646b43f3a7c8 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:12 devstack sudo[97244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb.8739e56e-9a31-45e4-b1fe-646b43f3a7c8 Jun 02 03:26:12 devstack sudo[97244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:13 devstack sudo[97244]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb.8739e56e-9a31-45e4-b1fe-646b43f3a7c8" returned: 0 in 0.718s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb.8739e56e-9a31-45e4-b1fe-646b43f3a7c8 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:13 devstack sudo[97249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb.8739e56e-9a31-45e4-b1fe-646b43f3a7c8 Jun 02 03:26:13 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:13 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb.8739e56e-9a31-45e4-b1fe-646b43f3a7c8" returned: 0 in 0.614s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:13 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Lock "cinder-quobyte-8739e56e-9a31-45e4-b1fe-646b43f3a7c8" released by "_delete_snapshot" :: held 2.847s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:26:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.045s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c05f0809-6271-4329-82ef-7f2ea6fbf99c tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 15.445s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:14 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-c05f0809-6271-4329-82ef-7f2ea6fbf99c tempest-VolumesSnapshotTestJSON-661765892 None] Creating offline snapshot 8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa of volume 5758466c-a360-472b-ae6d-dae4b565a18c {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:26:14 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (931a382a-f27d-41fa-82b7-74dc5500f57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e7d67cb-aba8-424f-aaaf-333264c91c70', 'volume_size': 2, 'source_volid': 'd9f1bfe0-87b5-4e70-91af-b12a6949fccb', 'source_volstatus': 'available'}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:14 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (686de53f-d2ae-4914-9789-f069f2728b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:14 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b5f13a-9bff-437e-89a9-86f365c93e32]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:26:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c05f0809-6271-4329-82ef-7f2ea6fbf99c tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:14 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Volume volume-0e7d67cb-aba8-424f-aaaf-333264c91c70 (0e7d67cb-aba8-424f-aaaf-333264c91c70): created successfully Jun 02 03:26:14 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (686de53f-d2ae-4914-9789-f069f2728b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:14 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Flow 'volume_create_manager' (20ac8efb-25d7-4c47-837f-56c507c9e686) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:26:14 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-0160d244-b44f-4622-9f0b-a5b42c4fa789 tempest-VolumesCloneTest-1284791821 None] Created volume successfully. Jun 02 03:26:14 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c Jun 02 03:26:14 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:14 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1d56160c-8e67-45de-aae6-4153eabdb715 tempest-VolumesCloneTest-1284791821 None] Acquiring lock "cinder-0e7d67cb-aba8-424f-aaaf-333264c91c70-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:26:14 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1d56160c-8e67-45de-aae6-4153eabdb715 tempest-VolumesCloneTest-1284791821 None] Lock "cinder-0e7d67cb-aba8-424f-aaaf-333264c91c70-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:26:14 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1d56160c-8e67-45de-aae6-4153eabdb715 tempest-VolumesCloneTest-1284791821 None] Acquiring lock "cinder-quobyte-0e7d67cb-aba8-424f-aaaf-333264c91c70" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:26:14 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1d56160c-8e67-45de-aae6-4153eabdb715 tempest-VolumesCloneTest-1284791821 None] Lock "cinder-quobyte-0e7d67cb-aba8-424f-aaaf-333264c91c70" acquired by "delete_volume" :: waited 0.017s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:26:14 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[c868b8f0-b7ee-4068-8148-70dfd45db251]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:26:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1d56160c-8e67-45de-aae6-4153eabdb715 tempest-VolumesCloneTest-1284791821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-0e7d67cb-aba8-424f-aaaf-333264c91c70 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:14 devstack sudo[97254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-0e7d67cb-aba8-424f-aaaf-333264c91c70 Jun 02 03:26:14 devstack sudo[97254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:14 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c05f0809-6271-4329-82ef-7f2ea6fbf99c tempest-VolumesSnapshotTestJSON-661765892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c" returned: 0 in 0.909s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c05f0809-6271-4329-82ef-7f2ea6fbf99c tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c.8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:15 devstack sudo[97260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c.8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa 1G Jun 02 03:26:15 devstack sudo[97260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:15 devstack sudo[97254]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1d56160c-8e67-45de-aae6-4153eabdb715 tempest-VolumesCloneTest-1284791821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-0e7d67cb-aba8-424f-aaaf-333264c91c70" returned: 0 in 0.762s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1d56160c-8e67-45de-aae6-4153eabdb715 tempest-VolumesCloneTest-1284791821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-0e7d67cb-aba8-424f-aaaf-333264c91c70 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:15 devstack sudo[97265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-0e7d67cb-aba8-424f-aaaf-333264c91c70 Jun 02 03:26:15 devstack sudo[97265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:15 devstack sudo[97260]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c05f0809-6271-4329-82ef-7f2ea6fbf99c tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c.8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa 1G" returned: 0 in 0.827s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c05f0809-6271-4329-82ef-7f2ea6fbf99c tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5758466c-a360-472b-ae6d-dae4b565a18c -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c.8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:15 devstack sudo[97271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5758466c-a360-472b-ae6d-dae4b565a18c -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c.8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa Jun 02 03:26:15 devstack sudo[97271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:16 devstack sudo[97265]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1d56160c-8e67-45de-aae6-4153eabdb715 tempest-VolumesCloneTest-1284791821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-0e7d67cb-aba8-424f-aaaf-333264c91c70" returned: 0 in 0.605s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:16 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1d56160c-8e67-45de-aae6-4153eabdb715 tempest-VolumesCloneTest-1284791821 None] Lock "cinder-quobyte-0e7d67cb-aba8-424f-aaaf-333264c91c70" released by "delete_volume" :: held 1.434s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:26:16 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-1d56160c-8e67-45de-aae6-4153eabdb715 tempest-VolumesCloneTest-1284791821 None] Created reservations ['3b4e1cee-4ebb-4c4e-97cc-fda9c1ba4807', '0e6daa29-298c-48f6-a655-a8edb19a367f', '27055285-f186-4b53-81a3-b631abe7a4bc', 'edc4b9a2-0856-4006-9220-9b3417cf32a1'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:26:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1d56160c-8e67-45de-aae6-4153eabdb715 tempest-VolumesCloneTest-1284791821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1d56160c-8e67-45de-aae6-4153eabdb715 tempest-VolumesCloneTest-1284791821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:16 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-1d56160c-8e67-45de-aae6-4153eabdb715 tempest-VolumesCloneTest-1284791821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:26:16 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-1d56160c-8e67-45de-aae6-4153eabdb715 tempest-VolumesCloneTest-1284791821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:26:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1d56160c-8e67-45de-aae6-4153eabdb715 tempest-VolumesCloneTest-1284791821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1d56160c-8e67-45de-aae6-4153eabdb715 tempest-VolumesCloneTest-1284791821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:16 devstack sudo[97275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:26:16 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:16 devstack sudo[97271]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c05f0809-6271-4329-82ef-7f2ea6fbf99c tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5758466c-a360-472b-ae6d-dae4b565a18c -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c.8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa" returned: 0 in 0.699s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:16 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-c05f0809-6271-4329-82ef-7f2ea6fbf99c tempest-VolumesSnapshotTestJSON-661765892 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c.8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa is being set with open permissions: ugo+rw Jun 02 03:26:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c05f0809-6271-4329-82ef-7f2ea6fbf99c tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c.8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:16 devstack sudo[97280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c.8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa Jun 02 03:26:16 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:16 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1d56160c-8e67-45de-aae6-4153eabdb715 tempest-VolumesCloneTest-1284791821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.664s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:16 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-1d56160c-8e67-45de-aae6-4153eabdb715 tempest-VolumesCloneTest-1284791821 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:26:16 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-1d56160c-8e67-45de-aae6-4153eabdb715 tempest-VolumesCloneTest-1284791821 None] Deleted volume successfully. Jun 02 03:26:16 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-544dfe5a-8dda-417e-9b79-4af0cd4d2f6c tempest-VolumesCloneTest-1284791821 None] Acquiring lock "cinder-d9f1bfe0-87b5-4e70-91af-b12a6949fccb-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:26:16 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1d56160c-8e67-45de-aae6-4153eabdb715 tempest-VolumesCloneTest-1284791821 None] Lock "cinder-0e7d67cb-aba8-424f-aaaf-333264c91c70-delete_volume" released by "delete_volume" :: held 2.356s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:26:16 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-544dfe5a-8dda-417e-9b79-4af0cd4d2f6c tempest-VolumesCloneTest-1284791821 None] Lock "cinder-d9f1bfe0-87b5-4e70-91af-b12a6949fccb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:26:16 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-544dfe5a-8dda-417e-9b79-4af0cd4d2f6c tempest-VolumesCloneTest-1284791821 None] Acquiring lock "cinder-quobyte-d9f1bfe0-87b5-4e70-91af-b12a6949fccb" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:26:16 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-544dfe5a-8dda-417e-9b79-4af0cd4d2f6c tempest-VolumesCloneTest-1284791821 None] Lock "cinder-quobyte-d9f1bfe0-87b5-4e70-91af-b12a6949fccb" acquired by "delete_volume" :: waited 0.022s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:26:17 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef531cc2-39d0-402c-b539-88946023350d]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:26:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-544dfe5a-8dda-417e-9b79-4af0cd4d2f6c tempest-VolumesCloneTest-1284791821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:17 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:17 devstack sudo[97284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb Jun 02 03:26:17 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c05f0809-6271-4329-82ef-7f2ea6fbf99c tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c.8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa" returned: 0 in 0.658s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c05f0809-6271-4329-82ef-7f2ea6fbf99c tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:17 devstack sudo[97286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c.info Jun 02 03:26:17 devstack sudo[97286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:17 devstack sudo[97286]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c05f0809-6271-4329-82ef-7f2ea6fbf99c tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c.info" returned: 0 in 0.617s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:17 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:17 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-c05f0809-6271-4329-82ef-7f2ea6fbf99c tempest-VolumesSnapshotTestJSON-661765892 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c.info is being set with open permissions: ugo+rw Jun 02 03:26:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c05f0809-6271-4329-82ef-7f2ea6fbf99c tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-544dfe5a-8dda-417e-9b79-4af0cd4d2f6c tempest-VolumesCloneTest-1284791821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb" returned: 0 in 0.775s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-544dfe5a-8dda-417e-9b79-4af0cd4d2f6c tempest-VolumesCloneTest-1284791821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:17 devstack sudo[97293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c.info Jun 02 03:26:17 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:17 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb Jun 02 03:26:17 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:18 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c05f0809-6271-4329-82ef-7f2ea6fbf99c tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c.info" returned: 0 in 0.604s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c05f0809-6271-4329-82ef-7f2ea6fbf99c tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.416s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c9feaa24-2742-48b0-add8-1852ffa72ba3 tempest-SnapshotMetadataTestJSON-2102040595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.672s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:18 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-c9feaa24-2742-48b0-add8-1852ffa72ba3 tempest-SnapshotMetadataTestJSON-2102040595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1429111978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b1fedfb-93f4-4aa5-8437-c3ad8533c08f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a8f1e430dee4d92a065dbbcd29c3b5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:26:01Z,use_quota=True,user_id='94b1946ab303424e8bb7b048c0c471ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:26:18 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-c9feaa24-2742-48b0-add8-1852ffa72ba3 tempest-SnapshotMetadataTestJSON-2102040595 None] Creating volume 1b1fedfb-93f4-4aa5-8437-c3ad8533c08f {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:26:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c9feaa24-2742-48b0-add8-1852ffa72ba3 tempest-SnapshotMetadataTestJSON-2102040595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c9feaa24-2742-48b0-add8-1852ffa72ba3 tempest-SnapshotMetadataTestJSON-2102040595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:18 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-c9feaa24-2742-48b0-add8-1852ffa72ba3 tempest-SnapshotMetadataTestJSON-2102040595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:26:18 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-c9feaa24-2742-48b0-add8-1852ffa72ba3 tempest-SnapshotMetadataTestJSON-2102040595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:26:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c9feaa24-2742-48b0-add8-1852ffa72ba3 tempest-SnapshotMetadataTestJSON-2102040595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:18 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-c9feaa24-2742-48b0-add8-1852ffa72ba3 tempest-SnapshotMetadataTestJSON-2102040595 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:26:18 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-c9feaa24-2742-48b0-add8-1852ffa72ba3 tempest-SnapshotMetadataTestJSON-2102040595 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:26:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c9feaa24-2742-48b0-add8-1852ffa72ba3 tempest-SnapshotMetadataTestJSON-2102040595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:18 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f 1073741824 Jun 02 03:26:18 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:18 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:18 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-c05f0809-6271-4329-82ef-7f2ea6fbf99c tempest-VolumesSnapshotTestJSON-661765892 None] Create snapshot completed successfully Jun 02 03:26:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-544dfe5a-8dda-417e-9b79-4af0cd4d2f6c tempest-VolumesCloneTest-1284791821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d9f1bfe0-87b5-4e70-91af-b12a6949fccb" returned: 0 in 0.678s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:18 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-544dfe5a-8dda-417e-9b79-4af0cd4d2f6c tempest-VolumesCloneTest-1284791821 None] Lock "cinder-quobyte-d9f1bfe0-87b5-4e70-91af-b12a6949fccb" released by "delete_volume" :: held 1.544s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:26:18 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-544dfe5a-8dda-417e-9b79-4af0cd4d2f6c tempest-VolumesCloneTest-1284791821 None] Created reservations ['0ea78c90-9901-4c41-aba4-508ea463f112', 'e39e432b-ebe2-4208-803a-3d90b2d44a1e', '82a8f7bd-488b-47a9-a0ee-27fc8b82705d', '23324b4e-151f-4d79-a740-e64aa536ef60'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:26:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-544dfe5a-8dda-417e-9b79-4af0cd4d2f6c tempest-VolumesCloneTest-1284791821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-544dfe5a-8dda-417e-9b79-4af0cd4d2f6c tempest-VolumesCloneTest-1284791821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:18 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-544dfe5a-8dda-417e-9b79-4af0cd4d2f6c tempest-VolumesCloneTest-1284791821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:26:18 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-544dfe5a-8dda-417e-9b79-4af0cd4d2f6c tempest-VolumesCloneTest-1284791821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:26:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-544dfe5a-8dda-417e-9b79-4af0cd4d2f6c tempest-VolumesCloneTest-1284791821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-544dfe5a-8dda-417e-9b79-4af0cd4d2f6c tempest-VolumesCloneTest-1284791821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:18 devstack sudo[97301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:26:18 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:19 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-544dfe5a-8dda-417e-9b79-4af0cd4d2f6c tempest-VolumesCloneTest-1284791821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.661s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:19 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-544dfe5a-8dda-417e-9b79-4af0cd4d2f6c tempest-VolumesCloneTest-1284791821 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:26:19 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-544dfe5a-8dda-417e-9b79-4af0cd4d2f6c tempest-VolumesCloneTest-1284791821 None] Deleted volume successfully. Jun 02 03:26:19 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-544dfe5a-8dda-417e-9b79-4af0cd4d2f6c tempest-VolumesCloneTest-1284791821 None] Lock "cinder-d9f1bfe0-87b5-4e70-91af-b12a6949fccb-delete_volume" released by "delete_volume" :: held 2.469s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:26:19 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c9feaa24-2742-48b0-add8-1852ffa72ba3 tempest-SnapshotMetadataTestJSON-2102040595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f 1073741824" returned: 0 in 0.995s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c9feaa24-2742-48b0-add8-1852ffa72ba3 tempest-SnapshotMetadataTestJSON-2102040595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:19 devstack sudo[97309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f Jun 02 03:26:19 devstack sudo[97309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Flow 'volume_create_manager' (4fa6bd87-51d6-4baf-bc85-87e708a7cd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (548d724f-867c-41c1-a33e-f18d9c06c50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (548d724f-867c-41c1-a33e-f18d9c06c50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1537548212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79c65626-634b-4c08-9533-63e58c0f5e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f92811de804e4da9af80175226575210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:26:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:26:20Z,use_quota=True,user_id='6c94587123b44232a21505de6aec93e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6c654c6-270d-4690-820e-fb533940cf2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:20 devstack sudo[97309]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6c654c6-270d-4690-820e-fb533940cf2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e50fdbee-882b-442b-a157-9fb32142a736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e50fdbee-882b-442b-a157-9fb32142a736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '79c65626-634b-4c08-9533-63e58c0f5e96', 'volume_name': 'volume-79c65626-634b-4c08-9533-63e58c0f5e96', 'volume_size': 2, 'snapshot_id': '8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa'}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce9fd70c-70df-479a-87f4-d6515920bf58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce9fd70c-70df-479a-87f4-d6515920bf58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6179d490-fee3-4dfa-9515-191a10d33f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:20 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Volume 79c65626-634b-4c08-9533-63e58c0f5e96: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-79c65626-634b-4c08-9533-63e58c0f5e96', 'volume_size': 2, 'snapshot_id': '8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa'} Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c9feaa24-2742-48b0-add8-1852ffa72ba3 tempest-SnapshotMetadataTestJSON-2102040595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f" returned: 0 in 0.780s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-c9feaa24-2742-48b0-add8-1852ffa72ba3 tempest-SnapshotMetadataTestJSON-2102040595 None] <== create_volume: return (1838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c9feaa24-2742-48b0-add8-1852ffa72ba3 tempest-SnapshotMetadataTestJSON-2102040595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "cinder-quobyte-8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa-79c65626-634b-4c08-9533-63e58c0f5e96" by "_create_volume_from_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-c9feaa24-2742-48b0-add8-1852ffa72ba3 tempest-SnapshotMetadataTestJSON-2102040595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de08b2df-e4d0-4101-9f0b-d4cb53f8fbf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-c9feaa24-2742-48b0-add8-1852ffa72ba3 tempest-SnapshotMetadataTestJSON-2102040595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e698201-33f8-4e2a-8c30-173a84bb87bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-quobyte-8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa-79c65626-634b-4c08-9533-63e58c0f5e96" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Creating volume 79c65626-634b-4c08-9533-63e58c0f5e96 from snapshot 8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa {{(pid=86431) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "cinder-quobyte-79c65626-634b-4c08-9533-63e58c0f5e96" by "_copy_volume_from_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:26:20 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-c9feaa24-2742-48b0-add8-1852ffa72ba3 tempest-SnapshotMetadataTestJSON-2102040595 None] Volume volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f (1b1fedfb-93f4-4aa5-8437-c3ad8533c08f): created successfully Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-c9feaa24-2742-48b0-add8-1852ffa72ba3 tempest-SnapshotMetadataTestJSON-2102040595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e698201-33f8-4e2a-8c30-173a84bb87bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-c9feaa24-2742-48b0-add8-1852ffa72ba3 tempest-SnapshotMetadataTestJSON-2102040595 None] Flow 'volume_create_manager' (bff63d99-3aac-4f6f-b4f3-e91453ff8bf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-quobyte-79c65626-634b-4c08-9533-63e58c0f5e96" acquired by "_copy_volume_from_snapshot" :: waited 0.052s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] snapshot: 8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa, volume: 79c65626-634b-4c08-9533-63e58c0f5e96, {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 03:26:20 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-c9feaa24-2742-48b0-add8-1852ffa72ba3 tempest-SnapshotMetadataTestJSON-2102040595 None] Created volume successfully. Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcfd3d4-cce3-4120-b0d1-642d5ddd5e24]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:26:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c.8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:20 devstack sudo[97346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c.8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa Jun 02 03:26:20 devstack sudo[97346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:21 devstack sudo[97346]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c.8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa" returned: 0 in 0.904s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:21 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5758466c-a360-472b-ae6d-dae4b565a18c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:26:21 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 03:26:21 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Creating direct copy from snapshot {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 03:26:21 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[929d7630-b05b-4f89-938f-da0a7d26b800]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:26:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-92452bd3-94d4-4a2f-8d5f-b24cfef2387d tempest-SnapshotMetadataTestJSON-2102040595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:21 devstack sudo[97353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c Jun 02 03:26:21 devstack sudo[97353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:22 devstack sudo[97353]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c" returned: 0 in 0.788s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:22 devstack cinder-volume[86431]: DEBUG cinder.utils [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Path /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-79c65626-634b-4c08-9533-63e58c0f5e96 not found in is_blk_device check {{(pid=86431) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 02 03:26:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-79c65626-634b-4c08-9533-63e58c0f5e96 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:22 devstack sudo[97358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-79c65626-634b-4c08-9533-63e58c0f5e96 Jun 02 03:26:22 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:22 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3d5d3d9-c35f-4320-9d17-51a65da36aa9 tempest-VolumesGetTest-41238149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:26:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b3d5d3d9-c35f-4320-9d17-51a65da36aa9 tempest-VolumesGetTest-41238149 None] Flow 'volume_create_manager' (33c7a70e-8f64-4d2f-bc74-3a48b1400639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:26:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b3d5d3d9-c35f-4320-9d17-51a65da36aa9 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5b98757-26b6-4a6c-be04-f41b95168bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b3d5d3d9-c35f-4320-9d17-51a65da36aa9 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5b98757-26b6-4a6c-be04-f41b95168bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1340870718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4060c2c-9681-4c78-88a3-1a22196b292c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='82ecbcb594f540ed9eb6bbd6f6eda02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:26:23Z,use_quota=True,user_id='3b07719d39b2468bb6daaeeeb8feb831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b3d5d3d9-c35f-4320-9d17-51a65da36aa9 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bc7f978-c9af-4030-a508-6b7169139d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b3d5d3d9-c35f-4320-9d17-51a65da36aa9 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bc7f978-c9af-4030-a508-6b7169139d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b3d5d3d9-c35f-4320-9d17-51a65da36aa9 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89047dd5-9207-485b-925f-05698a5efbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b3d5d3d9-c35f-4320-9d17-51a65da36aa9 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89047dd5-9207-485b-925f-05698a5efbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4060c2c-9681-4c78-88a3-1a22196b292c', 'volume_name': 'volume-e4060c2c-9681-4c78-88a3-1a22196b292c', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b3d5d3d9-c35f-4320-9d17-51a65da36aa9 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd1bf60-c59b-475a-8936-954926ca2d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b3d5d3d9-c35f-4320-9d17-51a65da36aa9 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd1bf60-c59b-475a-8936-954926ca2d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b3d5d3d9-c35f-4320-9d17-51a65da36aa9 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8ada05f-468a-4df3-b6a6-a4a71deac7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:22 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-b3d5d3d9-c35f-4320-9d17-51a65da36aa9 tempest-VolumesGetTest-41238149 None] Volume e4060c2c-9681-4c78-88a3-1a22196b292c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4060c2c-9681-4c78-88a3-1a22196b292c', 'volume_size': 1} Jun 02 03:26:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b3d5d3d9-c35f-4320-9d17-51a65da36aa9 tempest-VolumesGetTest-41238149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:27 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-79c65626-634b-4c08-9533-63e58c0f5e96" returned: 0 in 5.217s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:27 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6a03a4-831d-47df-b221-a3ebebcb0831]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:26:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:27 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:INSERT=48,cinder:UPDATE=129,cinder:SELECT=140,cinder:DELETE=10 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:26:27 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:INSERT=36,cinder:UPDATE=139,cinder:SELECT=106,cinder:DELETE=12 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:26:27 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3e236c1-9227-4dc3-b37b-a3ed17427cad tempest-VolumeQuotasAdminTestJSON-532628032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:26:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e3e236c1-9227-4dc3-b37b-a3ed17427cad tempest-VolumeQuotasAdminTestJSON-532628032 None] Flow 'volume_create_manager' (2fbfe17f-6ebf-4944-b038-73523a6d7279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:26:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e3e236c1-9227-4dc3-b37b-a3ed17427cad tempest-VolumeQuotasAdminTestJSON-532628032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191f66d2-0968-4f3c-9cc6-56ed95c34daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e3e236c1-9227-4dc3-b37b-a3ed17427cad tempest-VolumeQuotasAdminTestJSON-532628032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191f66d2-0968-4f3c-9cc6-56ed95c34daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-188897823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e31ea4d8-2c1a-4ee0-ad33-9abcfa543dee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4caf1e57ad31495fae9b8858093e55c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:26:27Z,use_quota=True,user_id='82080bd631e34f8db87a8e255b9c9a3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:27 devstack sudo[97374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c Jun 02 03:26:27 devstack sudo[97374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e3e236c1-9227-4dc3-b37b-a3ed17427cad tempest-VolumeQuotasAdminTestJSON-532628032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e0ba79f-0c53-4070-becd-860c13eee0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e3e236c1-9227-4dc3-b37b-a3ed17427cad tempest-VolumeQuotasAdminTestJSON-532628032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e0ba79f-0c53-4070-becd-860c13eee0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e3e236c1-9227-4dc3-b37b-a3ed17427cad tempest-VolumeQuotasAdminTestJSON-532628032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58ad1ff8-58fa-4e4c-b747-105901e4233b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e3e236c1-9227-4dc3-b37b-a3ed17427cad tempest-VolumeQuotasAdminTestJSON-532628032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58ad1ff8-58fa-4e4c-b747-105901e4233b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e31ea4d8-2c1a-4ee0-ad33-9abcfa543dee', 'volume_name': 'volume-e31ea4d8-2c1a-4ee0-ad33-9abcfa543dee', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e3e236c1-9227-4dc3-b37b-a3ed17427cad tempest-VolumeQuotasAdminTestJSON-532628032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0b2fb4d-35f8-4085-95cc-fabbe3742fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e3e236c1-9227-4dc3-b37b-a3ed17427cad tempest-VolumeQuotasAdminTestJSON-532628032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0b2fb4d-35f8-4085-95cc-fabbe3742fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e3e236c1-9227-4dc3-b37b-a3ed17427cad tempest-VolumeQuotasAdminTestJSON-532628032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e802bc35-c7ad-43d7-b363-0d02d3e128c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:27 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-e3e236c1-9227-4dc3-b37b-a3ed17427cad tempest-VolumeQuotasAdminTestJSON-532628032 None] Volume e31ea4d8-2c1a-4ee0-ad33-9abcfa543dee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e31ea4d8-2c1a-4ee0-ad33-9abcfa543dee', 'volume_size': 1} Jun 02 03:26:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e3e236c1-9227-4dc3-b37b-a3ed17427cad tempest-VolumeQuotasAdminTestJSON-532628032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:28 devstack sudo[97374]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c" returned: 0 in 0.862s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:28 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Image conversion details: src /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c, size 1024.00 MB, duration 5.22 sec, destination /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-79c65626-634b-4c08-9533-63e58c0f5e96 {{(pid=86431) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 02 03:26:28 devstack cinder-volume[86431]: INFO cinder.image.image_utils [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Converted 1024.00 MB image at 196.24 MB/s Jun 02 03:26:28 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-79c65626-634b-4c08-9533-63e58c0f5e96 is being set with open permissions: ugo+rw Jun 02 03:26:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-79c65626-634b-4c08-9533-63e58c0f5e96 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:28 devstack sudo[97379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-79c65626-634b-4c08-9533-63e58c0f5e96 Jun 02 03:26:28 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:28 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-79c65626-634b-4c08-9533-63e58c0f5e96" returned: 0 in 0.589s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:28 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-quobyte-79c65626-634b-4c08-9533-63e58c0f5e96" released by "_copy_volume_from_snapshot" :: held 8.514s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:26:28 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-quobyte-8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa-79c65626-634b-4c08-9533-63e58c0f5e96" released by "_create_volume_from_snapshot" :: held 8.584s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:26:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.621s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-92452bd3-94d4-4a2f-8d5f-b24cfef2387d tempest-SnapshotMetadataTestJSON-2102040595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.416s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:28 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-92452bd3-94d4-4a2f-8d5f-b24cfef2387d tempest-SnapshotMetadataTestJSON-2102040595 None] Creating offline snapshot 3bb5fc91-e291-4bda-baea-f21ed6370523 of volume 1b1fedfb-93f4-4aa5-8437-c3ad8533c08f {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:26:28 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6179d490-fee3-4dfa-9515-191a10d33f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79c65626-634b-4c08-9533-63e58c0f5e96', 'volume_size': 2, 'snapshot_id': '8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa'}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:28 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79bd3fda-1f18-42fa-a2ee-a029d6af0b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:28 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a895c5-a7ca-4f18-a625-2b0917afcb0d]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:26:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-92452bd3-94d4-4a2f-8d5f-b24cfef2387d tempest-SnapshotMetadataTestJSON-2102040595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:28 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Volume volume-79c65626-634b-4c08-9533-63e58c0f5e96 (79c65626-634b-4c08-9533-63e58c0f5e96): created successfully Jun 02 03:26:29 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79bd3fda-1f18-42fa-a2ee-a029d6af0b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:29 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Flow 'volume_create_manager' (4fa6bd87-51d6-4baf-bc85-87e708a7cd0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:26:29 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-0c3b7e21-03ca-48df-bee2-236ce65cb675 tempest-VolumesSnapshotTestJSON-661765892 None] Created volume successfully. Jun 02 03:26:29 devstack sudo[97390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f Jun 02 03:26:29 devstack sudo[97390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:29 devstack sudo[97390]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-92452bd3-94d4-4a2f-8d5f-b24cfef2387d tempest-SnapshotMetadataTestJSON-2102040595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f" returned: 0 in 0.704s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-92452bd3-94d4-4a2f-8d5f-b24cfef2387d tempest-SnapshotMetadataTestJSON-2102040595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f.3bb5fc91-e291-4bda-baea-f21ed6370523 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:29 devstack sudo[97395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f.3bb5fc91-e291-4bda-baea-f21ed6370523 1G Jun 02 03:26:29 devstack sudo[97395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:30 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2831b6b7-d844-44e5-8dfa-390ab778c8d9 tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "cinder-79c65626-634b-4c08-9533-63e58c0f5e96-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:26:30 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2831b6b7-d844-44e5-8dfa-390ab778c8d9 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-79c65626-634b-4c08-9533-63e58c0f5e96-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:26:30 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2831b6b7-d844-44e5-8dfa-390ab778c8d9 tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "cinder-quobyte-79c65626-634b-4c08-9533-63e58c0f5e96" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:26:30 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2831b6b7-d844-44e5-8dfa-390ab778c8d9 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-quobyte-79c65626-634b-4c08-9533-63e58c0f5e96" acquired by "delete_volume" :: waited 0.017s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:26:30 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4383328-b168-4a07-a7ec-08b42ef2cfd5]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:26:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2831b6b7-d844-44e5-8dfa-390ab778c8d9 tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-79c65626-634b-4c08-9533-63e58c0f5e96 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:30 devstack sudo[97397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-79c65626-634b-4c08-9533-63e58c0f5e96 Jun 02 03:26:30 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:30 devstack sudo[97395]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-92452bd3-94d4-4a2f-8d5f-b24cfef2387d tempest-SnapshotMetadataTestJSON-2102040595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f.3bb5fc91-e291-4bda-baea-f21ed6370523 1G" returned: 0 in 0.733s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-92452bd3-94d4-4a2f-8d5f-b24cfef2387d tempest-SnapshotMetadataTestJSON-2102040595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f.3bb5fc91-e291-4bda-baea-f21ed6370523 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:30 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f.3bb5fc91-e291-4bda-baea-f21ed6370523 Jun 02 03:26:30 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:30 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2831b6b7-d844-44e5-8dfa-390ab778c8d9 tempest-VolumesSnapshotTestJSON-661765892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-79c65626-634b-4c08-9533-63e58c0f5e96" returned: 0 in 0.726s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2831b6b7-d844-44e5-8dfa-390ab778c8d9 tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-79c65626-634b-4c08-9533-63e58c0f5e96 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:30 devstack sudo[97408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-79c65626-634b-4c08-9533-63e58c0f5e96 Jun 02 03:26:30 devstack sudo[97408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:31 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-92452bd3-94d4-4a2f-8d5f-b24cfef2387d tempest-SnapshotMetadataTestJSON-2102040595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f.3bb5fc91-e291-4bda-baea-f21ed6370523" returned: 0 in 0.650s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:31 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-92452bd3-94d4-4a2f-8d5f-b24cfef2387d tempest-SnapshotMetadataTestJSON-2102040595 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f.3bb5fc91-e291-4bda-baea-f21ed6370523 is being set with open permissions: ugo+rw Jun 02 03:26:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-92452bd3-94d4-4a2f-8d5f-b24cfef2387d tempest-SnapshotMetadataTestJSON-2102040595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f.3bb5fc91-e291-4bda-baea-f21ed6370523 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:31 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f.3bb5fc91-e291-4bda-baea-f21ed6370523 Jun 02 03:26:31 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:31 devstack sudo[97408]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2831b6b7-d844-44e5-8dfa-390ab778c8d9 tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-79c65626-634b-4c08-9533-63e58c0f5e96" returned: 0 in 0.606s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:31 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2831b6b7-d844-44e5-8dfa-390ab778c8d9 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-quobyte-79c65626-634b-4c08-9533-63e58c0f5e96" released by "delete_volume" :: held 1.379s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:26:31 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-2831b6b7-d844-44e5-8dfa-390ab778c8d9 tempest-VolumesSnapshotTestJSON-661765892 None] Created reservations ['fe70dbdd-82be-40b3-a1de-d36cd7235aa0', '777d44f0-d6f0-438c-b90b-4e59c4a2d9ff', '79574ed6-d3c4-45a7-b006-b82449d9020c', 'ad922150-73c2-414e-9238-5d5bd99331cf'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:26:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2831b6b7-d844-44e5-8dfa-390ab778c8d9 tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2831b6b7-d844-44e5-8dfa-390ab778c8d9 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:31 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-2831b6b7-d844-44e5-8dfa-390ab778c8d9 tempest-VolumesSnapshotTestJSON-661765892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:26:31 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-2831b6b7-d844-44e5-8dfa-390ab778c8d9 tempest-VolumesSnapshotTestJSON-661765892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:26:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2831b6b7-d844-44e5-8dfa-390ab778c8d9 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2831b6b7-d844-44e5-8dfa-390ab778c8d9 tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:31 devstack sudo[97417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:26:31 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:31 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-92452bd3-94d4-4a2f-8d5f-b24cfef2387d tempest-SnapshotMetadataTestJSON-2102040595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f.3bb5fc91-e291-4bda-baea-f21ed6370523" returned: 0 in 0.603s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-92452bd3-94d4-4a2f-8d5f-b24cfef2387d tempest-SnapshotMetadataTestJSON-2102040595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:31 devstack sudo[97419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f.info Jun 02 03:26:31 devstack sudo[97419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:32 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2831b6b7-d844-44e5-8dfa-390ab778c8d9 tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.607s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:32 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-2831b6b7-d844-44e5-8dfa-390ab778c8d9 tempest-VolumesSnapshotTestJSON-661765892 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:26:32 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-2831b6b7-d844-44e5-8dfa-390ab778c8d9 tempest-VolumesSnapshotTestJSON-661765892 None] Deleted volume successfully. Jun 02 03:26:32 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2831b6b7-d844-44e5-8dfa-390ab778c8d9 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-79c65626-634b-4c08-9533-63e58c0f5e96-delete_volume" released by "delete_volume" :: held 2.208s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:26:32 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-fc1fc430-6179-4139-9074-d3b90a661b46 tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "cinder-8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa-delete_snapshot" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:26:32 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-fc1fc430-6179-4139-9074-d3b90a661b46 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:26:32 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-fc1fc430-6179-4139-9074-d3b90a661b46 tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "cinder-quobyte-5758466c-a360-472b-ae6d-dae4b565a18c" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:26:32 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-fc1fc430-6179-4139-9074-d3b90a661b46 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-quobyte-5758466c-a360-472b-ae6d-dae4b565a18c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:26:32 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-fc1fc430-6179-4139-9074-d3b90a661b46 tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "cinder-quobyte-8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:26:32 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-fc1fc430-6179-4139-9074-d3b90a661b46 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-quobyte-8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:26:32 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-fc1fc430-6179-4139-9074-d3b90a661b46 tempest-VolumesSnapshotTestJSON-661765892 None] Deleting offline snapshot 8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa of volume 5758466c-a360-472b-ae6d-dae4b565a18c {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:26:32 devstack sudo[97419]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:32 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-fc1fc430-6179-4139-9074-d3b90a661b46 tempest-VolumesSnapshotTestJSON-661765892 None] snapshot_file for this snap is: volume-5758466c-a360-472b-ae6d-dae4b565a18c.8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:26:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-92452bd3-94d4-4a2f-8d5f-b24cfef2387d tempest-SnapshotMetadataTestJSON-2102040595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f.info" returned: 0 in 0.643s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:32 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-92452bd3-94d4-4a2f-8d5f-b24cfef2387d tempest-SnapshotMetadataTestJSON-2102040595 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f.info is being set with open permissions: ugo+rw Jun 02 03:26:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-92452bd3-94d4-4a2f-8d5f-b24cfef2387d tempest-SnapshotMetadataTestJSON-2102040595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:32 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d71d3b8-26d5-4207-9a63-394c8891535a]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:26:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fc1fc430-6179-4139-9074-d3b90a661b46 tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c.8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:32 devstack sudo[97423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f.info Jun 02 03:26:32 devstack sudo[97423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:32 devstack sudo[97424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c.8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa Jun 02 03:26:32 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:32 devstack sudo[97423]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-92452bd3-94d4-4a2f-8d5f-b24cfef2387d tempest-SnapshotMetadataTestJSON-2102040595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f.info" returned: 0 in 0.590s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-92452bd3-94d4-4a2f-8d5f-b24cfef2387d tempest-SnapshotMetadataTestJSON-2102040595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.034s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b3d5d3d9-c35f-4320-9d17-51a65da36aa9 tempest-VolumesGetTest-41238149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.028s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:32 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b3d5d3d9-c35f-4320-9d17-51a65da36aa9 tempest-VolumesGetTest-41238149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1340870718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4060c2c-9681-4c78-88a3-1a22196b292c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='82ecbcb594f540ed9eb6bbd6f6eda02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:26:23Z,use_quota=True,user_id='3b07719d39b2468bb6daaeeeb8feb831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:26:32 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-b3d5d3d9-c35f-4320-9d17-51a65da36aa9 tempest-VolumesGetTest-41238149 None] Creating volume e4060c2c-9681-4c78-88a3-1a22196b292c {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:26:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b3d5d3d9-c35f-4320-9d17-51a65da36aa9 tempest-VolumesGetTest-41238149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b3d5d3d9-c35f-4320-9d17-51a65da36aa9 tempest-VolumesGetTest-41238149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:32 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b3d5d3d9-c35f-4320-9d17-51a65da36aa9 tempest-VolumesGetTest-41238149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:26:32 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b3d5d3d9-c35f-4320-9d17-51a65da36aa9 tempest-VolumesGetTest-41238149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:26:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b3d5d3d9-c35f-4320-9d17-51a65da36aa9 tempest-VolumesGetTest-41238149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:32 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b3d5d3d9-c35f-4320-9d17-51a65da36aa9 tempest-VolumesGetTest-41238149 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:26:32 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-b3d5d3d9-c35f-4320-9d17-51a65da36aa9 tempest-VolumesGetTest-41238149 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:26:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b3d5d3d9-c35f-4320-9d17-51a65da36aa9 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e4060c2c-9681-4c78-88a3-1a22196b292c 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:33 devstack sudo[97432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e4060c2c-9681-4c78-88a3-1a22196b292c 1073741824 Jun 02 03:26:33 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:33 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-92452bd3-94d4-4a2f-8d5f-b24cfef2387d tempest-SnapshotMetadataTestJSON-2102040595 None] Create snapshot completed successfully Jun 02 03:26:33 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fc1fc430-6179-4139-9074-d3b90a661b46 tempest-VolumesSnapshotTestJSON-661765892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c.8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa" returned: 0 in 0.727s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:33 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-fc1fc430-6179-4139-9074-d3b90a661b46 tempest-VolumesSnapshotTestJSON-661765892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5758466c-a360-472b-ae6d-dae4b565a18c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:26:33 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34f49f3-3c0a-4845-98ca-deb6176c0ee7]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:26:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fc1fc430-6179-4139-9074-d3b90a661b46 tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:33 devstack sudo[97435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c Jun 02 03:26:33 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:33 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b3d5d3d9-c35f-4320-9d17-51a65da36aa9 tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e4060c2c-9681-4c78-88a3-1a22196b292c 1073741824" returned: 0 in 0.809s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b3d5d3d9-c35f-4320-9d17-51a65da36aa9 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e4060c2c-9681-4c78-88a3-1a22196b292c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:33 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fc1fc430-6179-4139-9074-d3b90a661b46 tempest-VolumesSnapshotTestJSON-661765892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c" returned: 0 in 0.740s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fc1fc430-6179-4139-9074-d3b90a661b46 tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c.8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:33 devstack sudo[97443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e4060c2c-9681-4c78-88a3-1a22196b292c Jun 02 03:26:33 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:33 devstack sudo[97445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c.8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa Jun 02 03:26:33 devstack sudo[97445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:34 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b3d5d3d9-c35f-4320-9d17-51a65da36aa9 tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e4060c2c-9681-4c78-88a3-1a22196b292c" returned: 0 in 0.613s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:34 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b3d5d3d9-c35f-4320-9d17-51a65da36aa9 tempest-VolumesGetTest-41238149 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:26:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b3d5d3d9-c35f-4320-9d17-51a65da36aa9 tempest-VolumesGetTest-41238149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e3e236c1-9227-4dc3-b37b-a3ed17427cad tempest-VolumeQuotasAdminTestJSON-532628032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.858s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:34 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e3e236c1-9227-4dc3-b37b-a3ed17427cad tempest-VolumeQuotasAdminTestJSON-532628032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-188897823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e31ea4d8-2c1a-4ee0-ad33-9abcfa543dee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4caf1e57ad31495fae9b8858093e55c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:26:27Z,use_quota=True,user_id='82080bd631e34f8db87a8e255b9c9a3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:26:34 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-e3e236c1-9227-4dc3-b37b-a3ed17427cad tempest-VolumeQuotasAdminTestJSON-532628032 None] Creating volume e31ea4d8-2c1a-4ee0-ad33-9abcfa543dee {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:26:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e3e236c1-9227-4dc3-b37b-a3ed17427cad tempest-VolumeQuotasAdminTestJSON-532628032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e3e236c1-9227-4dc3-b37b-a3ed17427cad tempest-VolumeQuotasAdminTestJSON-532628032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:34 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e3e236c1-9227-4dc3-b37b-a3ed17427cad tempest-VolumeQuotasAdminTestJSON-532628032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:26:34 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e3e236c1-9227-4dc3-b37b-a3ed17427cad tempest-VolumeQuotasAdminTestJSON-532628032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:26:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e3e236c1-9227-4dc3-b37b-a3ed17427cad tempest-VolumeQuotasAdminTestJSON-532628032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:34 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e3e236c1-9227-4dc3-b37b-a3ed17427cad tempest-VolumeQuotasAdminTestJSON-532628032 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:26:34 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-e3e236c1-9227-4dc3-b37b-a3ed17427cad tempest-VolumeQuotasAdminTestJSON-532628032 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:26:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e3e236c1-9227-4dc3-b37b-a3ed17427cad tempest-VolumeQuotasAdminTestJSON-532628032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e31ea4d8-2c1a-4ee0-ad33-9abcfa543dee 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b3d5d3d9-c35f-4320-9d17-51a65da36aa9 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8ada05f-468a-4df3-b6a6-a4a71deac7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4060c2c-9681-4c78-88a3-1a22196b292c', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b3d5d3d9-c35f-4320-9d17-51a65da36aa9 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ae91009-5f68-4076-a855-227bda47d730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:34 devstack sudo[97452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e31ea4d8-2c1a-4ee0-ad33-9abcfa543dee 1073741824 Jun 02 03:26:34 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:34 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-b3d5d3d9-c35f-4320-9d17-51a65da36aa9 tempest-VolumesGetTest-41238149 None] Volume volume-e4060c2c-9681-4c78-88a3-1a22196b292c (e4060c2c-9681-4c78-88a3-1a22196b292c): created successfully Jun 02 03:26:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b3d5d3d9-c35f-4320-9d17-51a65da36aa9 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ae91009-5f68-4076-a855-227bda47d730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b3d5d3d9-c35f-4320-9d17-51a65da36aa9 tempest-VolumesGetTest-41238149 None] Flow 'volume_create_manager' (33c7a70e-8f64-4d2f-bc74-3a48b1400639) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:26:34 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-b3d5d3d9-c35f-4320-9d17-51a65da36aa9 tempest-VolumesGetTest-41238149 None] Created volume successfully. Jun 02 03:26:34 devstack sudo[97445]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fc1fc430-6179-4139-9074-d3b90a661b46 tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c.8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa" returned: 0 in 0.753s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fc1fc430-6179-4139-9074-d3b90a661b46 tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c.8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:34 devstack sudo[97454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c.8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa Jun 02 03:26:34 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-223e7126-5c26-43e1-adde-9e7f0335cf1a tempest-SnapshotMetadataTestJSON-2102040595 None] Acquiring lock "cinder-3bb5fc91-e291-4bda-baea-f21ed6370523-delete_snapshot" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:26:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-223e7126-5c26-43e1-adde-9e7f0335cf1a tempest-SnapshotMetadataTestJSON-2102040595 None] Lock "cinder-3bb5fc91-e291-4bda-baea-f21ed6370523-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:26:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-223e7126-5c26-43e1-adde-9e7f0335cf1a tempest-SnapshotMetadataTestJSON-2102040595 None] Acquiring lock "cinder-quobyte-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:26:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-223e7126-5c26-43e1-adde-9e7f0335cf1a tempest-SnapshotMetadataTestJSON-2102040595 None] Lock "cinder-quobyte-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:26:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-223e7126-5c26-43e1-adde-9e7f0335cf1a tempest-SnapshotMetadataTestJSON-2102040595 None] Acquiring lock "cinder-quobyte-3bb5fc91-e291-4bda-baea-f21ed6370523" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:26:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-223e7126-5c26-43e1-adde-9e7f0335cf1a tempest-SnapshotMetadataTestJSON-2102040595 None] Lock "cinder-quobyte-3bb5fc91-e291-4bda-baea-f21ed6370523" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:26:34 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-223e7126-5c26-43e1-adde-9e7f0335cf1a tempest-SnapshotMetadataTestJSON-2102040595 None] Deleting offline snapshot 3bb5fc91-e291-4bda-baea-f21ed6370523 of volume 1b1fedfb-93f4-4aa5-8437-c3ad8533c08f {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:26:34 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-223e7126-5c26-43e1-adde-9e7f0335cf1a tempest-SnapshotMetadataTestJSON-2102040595 None] snapshot_file for this snap is: volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f.3bb5fc91-e291-4bda-baea-f21ed6370523 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:26:34 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[858281d4-1695-462e-9be1-a085658d8cc9]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:26:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-223e7126-5c26-43e1-adde-9e7f0335cf1a tempest-SnapshotMetadataTestJSON-2102040595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f.3bb5fc91-e291-4bda-baea-f21ed6370523 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:35 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f.3bb5fc91-e291-4bda-baea-f21ed6370523 Jun 02 03:26:35 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:35 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fc1fc430-6179-4139-9074-d3b90a661b46 tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c.8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa" returned: 0 in 0.703s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:35 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-fc1fc430-6179-4139-9074-d3b90a661b46 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-quobyte-8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa" released by "_delete_snapshot" :: held 3.046s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:26:35 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-fc1fc430-6179-4139-9074-d3b90a661b46 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-quobyte-5758466c-a360-472b-ae6d-dae4b565a18c" released by "delete_snapshot" :: held 3.069s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:26:35 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e3e236c1-9227-4dc3-b37b-a3ed17427cad tempest-VolumeQuotasAdminTestJSON-532628032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e31ea4d8-2c1a-4ee0-ad33-9abcfa543dee 1073741824" returned: 0 in 0.938s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e3e236c1-9227-4dc3-b37b-a3ed17427cad tempest-VolumeQuotasAdminTestJSON-532628032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e31ea4d8-2c1a-4ee0-ad33-9abcfa543dee {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:35 devstack sudo[97463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e31ea4d8-2c1a-4ee0-ad33-9abcfa543dee Jun 02 03:26:35 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:35 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-fc1fc430-6179-4139-9074-d3b90a661b46 tempest-VolumesSnapshotTestJSON-661765892 None] Created reservations ['6f41b920-b5ab-4f77-9e5a-bd13da0f9b53', '4c995378-60e9-4be1-a0f4-b9562557a99b', 'f0e4e98a-b225-46a2-ae27-1b684cbae266', '9048ce8e-3a7f-4f8a-af85-8799f9f9740b'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:26:35 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-fc1fc430-6179-4139-9074-d3b90a661b46 tempest-VolumesSnapshotTestJSON-661765892 None] Delete snapshot completed successfully. Jun 02 03:26:35 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-fc1fc430-6179-4139-9074-d3b90a661b46 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-8aa66823-1eb5-43ea-95fb-4cc6d31b0aaa-delete_snapshot" released by "delete_snapshot" :: held 3.295s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:26:35 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-ded6b442-3c3e-4c60-adf7-692afd9be3a0 tempest-VolumesGetTest-41238149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:26:35 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ded6b442-3c3e-4c60-adf7-692afd9be3a0 tempest-VolumesGetTest-41238149 None] Flow 'volume_create_manager' (c9db8560-4722-48f7-8bb2-590194916775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:26:35 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ded6b442-3c3e-4c60-adf7-692afd9be3a0 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f440a69-385c-4c1c-b232-f383e103d53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:35 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ded6b442-3c3e-4c60-adf7-692afd9be3a0 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f440a69-385c-4c1c-b232-f383e103d53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:26:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1726900852',display_name='tempest-VolumesGetTest-Volume-967211058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5dcfde7-21a2-46ee-a3d3-187d6debf766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ecbcb594f540ed9eb6bbd6f6eda02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:26:36Z,use_quota=True,user_id='3b07719d39b2468bb6daaeeeb8feb831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:35 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ded6b442-3c3e-4c60-adf7-692afd9be3a0 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb531a98-bff9-45dc-9fd7-22e178611784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:35 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ded6b442-3c3e-4c60-adf7-692afd9be3a0 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb531a98-bff9-45dc-9fd7-22e178611784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:35 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ded6b442-3c3e-4c60-adf7-692afd9be3a0 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2ed544e-4094-4a2e-be52-3a42c5f26ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:35 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ded6b442-3c3e-4c60-adf7-692afd9be3a0 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2ed544e-4094-4a2e-be52-3a42c5f26ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5dcfde7-21a2-46ee-a3d3-187d6debf766', 'volume_name': 'volume-d5dcfde7-21a2-46ee-a3d3-187d6debf766', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:35 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ded6b442-3c3e-4c60-adf7-692afd9be3a0 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f99ecebf-cacc-4dd6-8c0e-92c57cec1eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:35 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ded6b442-3c3e-4c60-adf7-692afd9be3a0 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f99ecebf-cacc-4dd6-8c0e-92c57cec1eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:35 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ded6b442-3c3e-4c60-adf7-692afd9be3a0 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f71abc90-7b4f-4d9c-8e3c-f555dafcf1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:35 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-ded6b442-3c3e-4c60-adf7-692afd9be3a0 tempest-VolumesGetTest-41238149 None] Volume d5dcfde7-21a2-46ee-a3d3-187d6debf766: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5dcfde7-21a2-46ee-a3d3-187d6debf766', 'volume_size': 1} Jun 02 03:26:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ded6b442-3c3e-4c60-adf7-692afd9be3a0 tempest-VolumesGetTest-41238149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:35 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-223e7126-5c26-43e1-adde-9e7f0335cf1a tempest-SnapshotMetadataTestJSON-2102040595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f.3bb5fc91-e291-4bda-baea-f21ed6370523" returned: 0 in 0.853s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:35 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-223e7126-5c26-43e1-adde-9e7f0335cf1a tempest-SnapshotMetadataTestJSON-2102040595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:26:35 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bf8997-328b-42d9-ab44-a03375a440fd]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:26:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-223e7126-5c26-43e1-adde-9e7f0335cf1a tempest-SnapshotMetadataTestJSON-2102040595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:35 devstack sudo[97468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f Jun 02 03:26:35 devstack sudo[97468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:36 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e3e236c1-9227-4dc3-b37b-a3ed17427cad tempest-VolumeQuotasAdminTestJSON-532628032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e31ea4d8-2c1a-4ee0-ad33-9abcfa543dee" returned: 0 in 0.653s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:36 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e3e236c1-9227-4dc3-b37b-a3ed17427cad tempest-VolumeQuotasAdminTestJSON-532628032 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:26:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e3e236c1-9227-4dc3-b37b-a3ed17427cad tempest-VolumeQuotasAdminTestJSON-532628032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ded6b442-3c3e-4c60-adf7-692afd9be3a0 tempest-VolumesGetTest-41238149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.392s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:36 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ded6b442-3c3e-4c60-adf7-692afd9be3a0 tempest-VolumesGetTest-41238149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:26:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1726900852',display_name='tempest-VolumesGetTest-Volume-967211058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5dcfde7-21a2-46ee-a3d3-187d6debf766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ecbcb594f540ed9eb6bbd6f6eda02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:26:36Z,use_quota=True,user_id='3b07719d39b2468bb6daaeeeb8feb831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:26:36 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-ded6b442-3c3e-4c60-adf7-692afd9be3a0 tempest-VolumesGetTest-41238149 None] Creating volume d5dcfde7-21a2-46ee-a3d3-187d6debf766 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:26:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ded6b442-3c3e-4c60-adf7-692afd9be3a0 tempest-VolumesGetTest-41238149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ded6b442-3c3e-4c60-adf7-692afd9be3a0 tempest-VolumesGetTest-41238149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:36 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ded6b442-3c3e-4c60-adf7-692afd9be3a0 tempest-VolumesGetTest-41238149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:26:36 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ded6b442-3c3e-4c60-adf7-692afd9be3a0 tempest-VolumesGetTest-41238149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:26:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ded6b442-3c3e-4c60-adf7-692afd9be3a0 tempest-VolumesGetTest-41238149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:36 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ded6b442-3c3e-4c60-adf7-692afd9be3a0 tempest-VolumesGetTest-41238149 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:26:36 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-ded6b442-3c3e-4c60-adf7-692afd9be3a0 tempest-VolumesGetTest-41238149 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:26:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ded6b442-3c3e-4c60-adf7-692afd9be3a0 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d5dcfde7-21a2-46ee-a3d3-187d6debf766 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:36 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e3e236c1-9227-4dc3-b37b-a3ed17427cad tempest-VolumeQuotasAdminTestJSON-532628032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e802bc35-c7ad-43d7-b363-0d02d3e128c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e31ea4d8-2c1a-4ee0-ad33-9abcfa543dee', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:36 devstack sudo[97471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d5dcfde7-21a2-46ee-a3d3-187d6debf766 1073741824 Jun 02 03:26:36 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e3e236c1-9227-4dc3-b37b-a3ed17427cad tempest-VolumeQuotasAdminTestJSON-532628032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30518797-95db-478b-8bc7-4eab60893a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:36 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:36 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-e3e236c1-9227-4dc3-b37b-a3ed17427cad tempest-VolumeQuotasAdminTestJSON-532628032 None] Volume volume-e31ea4d8-2c1a-4ee0-ad33-9abcfa543dee (e31ea4d8-2c1a-4ee0-ad33-9abcfa543dee): created successfully Jun 02 03:26:36 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e3e236c1-9227-4dc3-b37b-a3ed17427cad tempest-VolumeQuotasAdminTestJSON-532628032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30518797-95db-478b-8bc7-4eab60893a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:36 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e3e236c1-9227-4dc3-b37b-a3ed17427cad tempest-VolumeQuotasAdminTestJSON-532628032 None] Flow 'volume_create_manager' (2fbfe17f-6ebf-4944-b038-73523a6d7279) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:26:36 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-e3e236c1-9227-4dc3-b37b-a3ed17427cad tempest-VolumeQuotasAdminTestJSON-532628032 None] Created volume successfully. Jun 02 03:26:36 devstack sudo[97468]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-223e7126-5c26-43e1-adde-9e7f0335cf1a tempest-SnapshotMetadataTestJSON-2102040595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f" returned: 0 in 0.702s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-223e7126-5c26-43e1-adde-9e7f0335cf1a tempest-SnapshotMetadataTestJSON-2102040595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f.3bb5fc91-e291-4bda-baea-f21ed6370523 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:36 devstack sudo[97476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f.3bb5fc91-e291-4bda-baea-f21ed6370523 Jun 02 03:26:36 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-894d3248-a0b0-4c0d-b2d3-940e30ab451c tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "cinder-5758466c-a360-472b-ae6d-dae4b565a18c-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:26:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-894d3248-a0b0-4c0d-b2d3-940e30ab451c tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-5758466c-a360-472b-ae6d-dae4b565a18c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:26:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-894d3248-a0b0-4c0d-b2d3-940e30ab451c tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "cinder-quobyte-5758466c-a360-472b-ae6d-dae4b565a18c" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:26:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-894d3248-a0b0-4c0d-b2d3-940e30ab451c tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-quobyte-5758466c-a360-472b-ae6d-dae4b565a18c" acquired by "delete_volume" :: waited 0.014s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:26:36 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f341bb-3270-4a58-ab77-5d2624772992]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:26:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-894d3248-a0b0-4c0d-b2d3-940e30ab451c tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:36 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c Jun 02 03:26:36 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:36 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ded6b442-3c3e-4c60-adf7-692afd9be3a0 tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d5dcfde7-21a2-46ee-a3d3-187d6debf766 1073741824" returned: 0 in 0.821s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ded6b442-3c3e-4c60-adf7-692afd9be3a0 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d5dcfde7-21a2-46ee-a3d3-187d6debf766 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:37 devstack sudo[97484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d5dcfde7-21a2-46ee-a3d3-187d6debf766 Jun 02 03:26:37 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:37 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5555af88-7f91-4a2f-b2df-74dca1cd4fd9 tempest-VolumeQuotasAdminTestJSON-532628032 None] Acquiring lock "cinder-e31ea4d8-2c1a-4ee0-ad33-9abcfa543dee-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:26:37 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5555af88-7f91-4a2f-b2df-74dca1cd4fd9 tempest-VolumeQuotasAdminTestJSON-532628032 None] Lock "cinder-e31ea4d8-2c1a-4ee0-ad33-9abcfa543dee-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:26:37 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5555af88-7f91-4a2f-b2df-74dca1cd4fd9 tempest-VolumeQuotasAdminTestJSON-532628032 None] Acquiring lock "cinder-quobyte-e31ea4d8-2c1a-4ee0-ad33-9abcfa543dee" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:26:37 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5555af88-7f91-4a2f-b2df-74dca1cd4fd9 tempest-VolumeQuotasAdminTestJSON-532628032 None] Lock "cinder-quobyte-e31ea4d8-2c1a-4ee0-ad33-9abcfa543dee" acquired by "delete_volume" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:26:37 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-223e7126-5c26-43e1-adde-9e7f0335cf1a tempest-SnapshotMetadataTestJSON-2102040595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f.3bb5fc91-e291-4bda-baea-f21ed6370523" returned: 0 in 0.848s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-223e7126-5c26-43e1-adde-9e7f0335cf1a tempest-SnapshotMetadataTestJSON-2102040595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f.3bb5fc91-e291-4bda-baea-f21ed6370523 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:37 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfa497d-8c80-468b-9ee7-6aa5fa8ec8f5]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:26:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5555af88-7f91-4a2f-b2df-74dca1cd4fd9 tempest-VolumeQuotasAdminTestJSON-532628032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e31ea4d8-2c1a-4ee0-ad33-9abcfa543dee {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:37 devstack sudo[97490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f.3bb5fc91-e291-4bda-baea-f21ed6370523 Jun 02 03:26:37 devstack sudo[97490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:37 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-894d3248-a0b0-4c0d-b2d3-940e30ab451c tempest-VolumesSnapshotTestJSON-661765892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c" returned: 0 in 0.773s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-894d3248-a0b0-4c0d-b2d3-940e30ab451c tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:37 devstack sudo[97492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e31ea4d8-2c1a-4ee0-ad33-9abcfa543dee Jun 02 03:26:37 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:37 devstack sudo[97495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c Jun 02 03:26:37 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:37 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ded6b442-3c3e-4c60-adf7-692afd9be3a0 tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d5dcfde7-21a2-46ee-a3d3-187d6debf766" returned: 0 in 0.785s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:37 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ded6b442-3c3e-4c60-adf7-692afd9be3a0 tempest-VolumesGetTest-41238149 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:26:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ded6b442-3c3e-4c60-adf7-692afd9be3a0 tempest-VolumesGetTest-41238149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:37 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ded6b442-3c3e-4c60-adf7-692afd9be3a0 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f71abc90-7b4f-4d9c-8e3c-f555dafcf1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5dcfde7-21a2-46ee-a3d3-187d6debf766', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:37 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ded6b442-3c3e-4c60-adf7-692afd9be3a0 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0e8a93-11ab-4840-b839-1cbd9b359776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:37 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-ded6b442-3c3e-4c60-adf7-692afd9be3a0 tempest-VolumesGetTest-41238149 None] Volume volume-d5dcfde7-21a2-46ee-a3d3-187d6debf766 (d5dcfde7-21a2-46ee-a3d3-187d6debf766): created successfully Jun 02 03:26:37 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ded6b442-3c3e-4c60-adf7-692afd9be3a0 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0e8a93-11ab-4840-b839-1cbd9b359776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:37 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ded6b442-3c3e-4c60-adf7-692afd9be3a0 tempest-VolumesGetTest-41238149 None] Flow 'volume_create_manager' (c9db8560-4722-48f7-8bb2-590194916775) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:26:37 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-ded6b442-3c3e-4c60-adf7-692afd9be3a0 tempest-VolumesGetTest-41238149 None] Created volume successfully. Jun 02 03:26:38 devstack sudo[97490]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-223e7126-5c26-43e1-adde-9e7f0335cf1a tempest-SnapshotMetadataTestJSON-2102040595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f.3bb5fc91-e291-4bda-baea-f21ed6370523" returned: 0 in 0.681s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:38 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-223e7126-5c26-43e1-adde-9e7f0335cf1a tempest-SnapshotMetadataTestJSON-2102040595 None] Lock "cinder-quobyte-3bb5fc91-e291-4bda-baea-f21ed6370523" released by "_delete_snapshot" :: held 3.211s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:26:38 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-223e7126-5c26-43e1-adde-9e7f0335cf1a tempest-SnapshotMetadataTestJSON-2102040595 None] Lock "cinder-quobyte-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f" released by "delete_snapshot" :: held 3.254s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:26:38 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-223e7126-5c26-43e1-adde-9e7f0335cf1a tempest-SnapshotMetadataTestJSON-2102040595 None] Created reservations ['039d1f80-be8f-4c24-a223-7cc75ca028a0', '2784ffef-ee0c-4c6a-b23b-5744ee804699', '85859c21-7b1e-4f4f-9319-7b8460ae0abe', 'ac3cd274-600d-452c-9ed9-f6c55e71c755'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:26:38 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5555af88-7f91-4a2f-b2df-74dca1cd4fd9 tempest-VolumeQuotasAdminTestJSON-532628032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e31ea4d8-2c1a-4ee0-ad33-9abcfa543dee" returned: 0 in 0.779s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5555af88-7f91-4a2f-b2df-74dca1cd4fd9 tempest-VolumeQuotasAdminTestJSON-532628032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e31ea4d8-2c1a-4ee0-ad33-9abcfa543dee {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:38 devstack sudo[97504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e31ea4d8-2c1a-4ee0-ad33-9abcfa543dee Jun 02 03:26:38 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:38 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-894d3248-a0b0-4c0d-b2d3-940e30ab451c tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5758466c-a360-472b-ae6d-dae4b565a18c" returned: 0 in 0.708s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:38 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-223e7126-5c26-43e1-adde-9e7f0335cf1a tempest-SnapshotMetadataTestJSON-2102040595 None] Delete snapshot completed successfully. Jun 02 03:26:38 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-894d3248-a0b0-4c0d-b2d3-940e30ab451c tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-quobyte-5758466c-a360-472b-ae6d-dae4b565a18c" released by "delete_volume" :: held 1.538s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:26:38 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-223e7126-5c26-43e1-adde-9e7f0335cf1a tempest-SnapshotMetadataTestJSON-2102040595 None] Lock "cinder-3bb5fc91-e291-4bda-baea-f21ed6370523-delete_snapshot" released by "delete_snapshot" :: held 3.431s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:26:38 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-894d3248-a0b0-4c0d-b2d3-940e30ab451c tempest-VolumesSnapshotTestJSON-661765892 None] Created reservations ['aecf450e-180f-4502-8340-75eadeef46b7', '64234817-089c-459d-9912-9eb4301bec3f', '2e2fd511-115b-4a02-a490-34aed4b79ec7', '70918dc4-7fe1-42b7-afe1-972e5f05f856'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:26:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-894d3248-a0b0-4c0d-b2d3-940e30ab451c tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-894d3248-a0b0-4c0d-b2d3-940e30ab451c tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:38 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-894d3248-a0b0-4c0d-b2d3-940e30ab451c tempest-VolumesSnapshotTestJSON-661765892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:26:38 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-894d3248-a0b0-4c0d-b2d3-940e30ab451c tempest-VolumesSnapshotTestJSON-661765892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:26:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-894d3248-a0b0-4c0d-b2d3-940e30ab451c tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-894d3248-a0b0-4c0d-b2d3-940e30ab451c tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:38 devstack sudo[97506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:26:38 devstack sudo[97506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:38 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5555af88-7f91-4a2f-b2df-74dca1cd4fd9 tempest-VolumeQuotasAdminTestJSON-532628032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e31ea4d8-2c1a-4ee0-ad33-9abcfa543dee" returned: 0 in 0.663s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:38 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5555af88-7f91-4a2f-b2df-74dca1cd4fd9 tempest-VolumeQuotasAdminTestJSON-532628032 None] Lock "cinder-quobyte-e31ea4d8-2c1a-4ee0-ad33-9abcfa543dee" released by "delete_volume" :: held 1.503s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:26:38 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-5555af88-7f91-4a2f-b2df-74dca1cd4fd9 tempest-VolumeQuotasAdminTestJSON-532628032 None] Created reservations ['739b7b0a-7951-4210-b8ad-f12e3345b813', 'a3affff3-376d-4db1-8a7a-b393d6de84e8', '4b1e2f31-049a-4507-9739-66496a602566', 'c4e4782a-15b0-4b2b-8040-fb84368864a6'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5555af88-7f91-4a2f-b2df-74dca1cd4fd9 tempest-VolumeQuotasAdminTestJSON-532628032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5555af88-7f91-4a2f-b2df-74dca1cd4fd9 tempest-VolumeQuotasAdminTestJSON-532628032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-5555af88-7f91-4a2f-b2df-74dca1cd4fd9 tempest-VolumeQuotasAdminTestJSON-532628032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-5555af88-7f91-4a2f-b2df-74dca1cd4fd9 tempest-VolumeQuotasAdminTestJSON-532628032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5555af88-7f91-4a2f-b2df-74dca1cd4fd9 tempest-VolumeQuotasAdminTestJSON-532628032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5555af88-7f91-4a2f-b2df-74dca1cd4fd9 tempest-VolumeQuotasAdminTestJSON-532628032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0ab35612-f1e1-4f0b-8ea4-55d25d1c9a05 tempest-VolumesGetTest-41238149 None] Acquiring lock "cinder-d5dcfde7-21a2-46ee-a3d3-187d6debf766-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:26:39 devstack sudo[97506]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-894d3248-a0b0-4c0d-b2d3-940e30ab451c tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.696s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-894d3248-a0b0-4c0d-b2d3-940e30ab451c tempest-VolumesSnapshotTestJSON-661765892 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:26:39 devstack sudo[97510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:26:39 devstack sudo[97510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:39 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-894d3248-a0b0-4c0d-b2d3-940e30ab451c tempest-VolumesSnapshotTestJSON-661765892 None] Deleted volume successfully. Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0ab35612-f1e1-4f0b-8ea4-55d25d1c9a05 tempest-VolumesGetTest-41238149 None] Lock "cinder-d5dcfde7-21a2-46ee-a3d3-187d6debf766-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-894d3248-a0b0-4c0d-b2d3-940e30ab451c tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-5758466c-a360-472b-ae6d-dae4b565a18c-delete_volume" released by "delete_volume" :: held 2.471s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0ab35612-f1e1-4f0b-8ea4-55d25d1c9a05 tempest-VolumesGetTest-41238149 None] Acquiring lock "cinder-quobyte-d5dcfde7-21a2-46ee-a3d3-187d6debf766" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0ab35612-f1e1-4f0b-8ea4-55d25d1c9a05 tempest-VolumesGetTest-41238149 None] Lock "cinder-quobyte-d5dcfde7-21a2-46ee-a3d3-187d6debf766" acquired by "delete_volume" :: waited 0.025s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[767d93fa-bd2a-48bc-97ae-c228ec145881]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0ab35612-f1e1-4f0b-8ea4-55d25d1c9a05 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d5dcfde7-21a2-46ee-a3d3-187d6debf766 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-786a056b-bdca-4375-a35e-f45e3615e2f1 tempest-SnapshotMetadataTestJSON-2102040595 None] Acquiring lock "cinder-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-786a056b-bdca-4375-a35e-f45e3615e2f1 tempest-SnapshotMetadataTestJSON-2102040595 None] Lock "cinder-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:26:39 devstack sudo[97512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d5dcfde7-21a2-46ee-a3d3-187d6debf766 Jun 02 03:26:39 devstack sudo[97512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-786a056b-bdca-4375-a35e-f45e3615e2f1 tempest-SnapshotMetadataTestJSON-2102040595 None] Acquiring lock "cinder-quobyte-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-786a056b-bdca-4375-a35e-f45e3615e2f1 tempest-SnapshotMetadataTestJSON-2102040595 None] Lock "cinder-quobyte-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f" acquired by "delete_volume" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02cddb4-dccd-4207-af8e-b13b1d1f6645]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-786a056b-bdca-4375-a35e-f45e3615e2f1 tempest-SnapshotMetadataTestJSON-2102040595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f7b9733-c6c2-42b5-8123-f57d97f13ae8 tempest-VolumesSnapshotTestJSON-661765892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0f7b9733-c6c2-42b5-8123-f57d97f13ae8 tempest-VolumesSnapshotTestJSON-661765892 None] Flow 'volume_create_manager' (95f71c1b-4e04-4761-8033-3c04d4cfa317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0f7b9733-c6c2-42b5-8123-f57d97f13ae8 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1610867a-763a-484a-99b2-2f2c090ffbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0f7b9733-c6c2-42b5-8123-f57d97f13ae8 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1610867a-763a-484a-99b2-2f2c090ffbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1183757886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cde36c0c-2d55-4cc9-b116-86b41425bdfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f92811de804e4da9af80175226575210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:26:39Z,use_quota=True,user_id='6c94587123b44232a21505de6aec93e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0f7b9733-c6c2-42b5-8123-f57d97f13ae8 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb95fc0-0902-4874-b22f-6a5ddc677174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0f7b9733-c6c2-42b5-8123-f57d97f13ae8 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb95fc0-0902-4874-b22f-6a5ddc677174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0f7b9733-c6c2-42b5-8123-f57d97f13ae8 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b72ea6a4-fdc0-45f3-a92b-6e68d70158b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0f7b9733-c6c2-42b5-8123-f57d97f13ae8 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b72ea6a4-fdc0-45f3-a92b-6e68d70158b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cde36c0c-2d55-4cc9-b116-86b41425bdfb', 'volume_name': 'volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0f7b9733-c6c2-42b5-8123-f57d97f13ae8 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddb31ad9-9043-46b7-a717-9e855f1cdd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0f7b9733-c6c2-42b5-8123-f57d97f13ae8 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddb31ad9-9043-46b7-a717-9e855f1cdd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0f7b9733-c6c2-42b5-8123-f57d97f13ae8 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d554c40-3b44-4af2-b938-75b36a731b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:39 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-0f7b9733-c6c2-42b5-8123-f57d97f13ae8 tempest-VolumesSnapshotTestJSON-661765892 None] Volume cde36c0c-2d55-4cc9-b116-86b41425bdfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb', 'volume_size': 1} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0f7b9733-c6c2-42b5-8123-f57d97f13ae8 tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0f7b9733-c6c2-42b5-8123-f57d97f13ae8 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0f7b9733-c6c2-42b5-8123-f57d97f13ae8 tempest-VolumesSnapshotTestJSON-661765892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1183757886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cde36c0c-2d55-4cc9-b116-86b41425bdfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f92811de804e4da9af80175226575210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:26:39Z,use_quota=True,user_id='6c94587123b44232a21505de6aec93e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-0f7b9733-c6c2-42b5-8123-f57d97f13ae8 tempest-VolumesSnapshotTestJSON-661765892 None] Creating volume cde36c0c-2d55-4cc9-b116-86b41425bdfb {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0f7b9733-c6c2-42b5-8123-f57d97f13ae8 tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0f7b9733-c6c2-42b5-8123-f57d97f13ae8 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0f7b9733-c6c2-42b5-8123-f57d97f13ae8 tempest-VolumesSnapshotTestJSON-661765892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0f7b9733-c6c2-42b5-8123-f57d97f13ae8 tempest-VolumesSnapshotTestJSON-661765892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0f7b9733-c6c2-42b5-8123-f57d97f13ae8 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0f7b9733-c6c2-42b5-8123-f57d97f13ae8 tempest-VolumesSnapshotTestJSON-661765892 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:26:39 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-0f7b9733-c6c2-42b5-8123-f57d97f13ae8 tempest-VolumesSnapshotTestJSON-661765892 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0f7b9733-c6c2-42b5-8123-f57d97f13ae8 tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:39 devstack sudo[97515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb 1073741824 Jun 02 03:26:39 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:39 devstack sudo[97514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f Jun 02 03:26:39 devstack sudo[97514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:39 devstack sudo[97510]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5555af88-7f91-4a2f-b2df-74dca1cd4fd9 tempest-VolumeQuotasAdminTestJSON-532628032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.769s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-5555af88-7f91-4a2f-b2df-74dca1cd4fd9 tempest-VolumeQuotasAdminTestJSON-532628032 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:26:39 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-5555af88-7f91-4a2f-b2df-74dca1cd4fd9 tempest-VolumeQuotasAdminTestJSON-532628032 None] Deleted volume successfully. Jun 02 03:26:39 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5555af88-7f91-4a2f-b2df-74dca1cd4fd9 tempest-VolumeQuotasAdminTestJSON-532628032 None] Lock "cinder-e31ea4d8-2c1a-4ee0-ad33-9abcfa543dee-delete_volume" released by "delete_volume" :: held 2.563s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:26:40 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-11921eb4-4afd-44e7-b7a3-71ce1d1f598f tempest-VolumeQuotasAdminTestJSON-532628032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:26:40 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-11921eb4-4afd-44e7-b7a3-71ce1d1f598f tempest-VolumeQuotasAdminTestJSON-532628032 None] Flow 'volume_create_manager' (4f4f4599-4360-428b-8930-6aa2d3cc776d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:26:40 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-11921eb4-4afd-44e7-b7a3-71ce1d1f598f tempest-VolumeQuotasAdminTestJSON-532628032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ae0db6-f592-41cf-8777-1d90a2eddf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:40 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-11921eb4-4afd-44e7-b7a3-71ce1d1f598f tempest-VolumeQuotasAdminTestJSON-532628032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ae0db6-f592-41cf-8777-1d90a2eddf9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-412815046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d2f8dd-a989-4798-a6db-aca539b755e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4caf1e57ad31495fae9b8858093e55c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:26:40Z,use_quota=True,user_id='82080bd631e34f8db87a8e255b9c9a3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:40 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-11921eb4-4afd-44e7-b7a3-71ce1d1f598f tempest-VolumeQuotasAdminTestJSON-532628032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a71cd3a-0f8d-495d-9357-5d2a92a76f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:40 devstack sudo[97512]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:40 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-11921eb4-4afd-44e7-b7a3-71ce1d1f598f tempest-VolumeQuotasAdminTestJSON-532628032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a71cd3a-0f8d-495d-9357-5d2a92a76f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:40 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-11921eb4-4afd-44e7-b7a3-71ce1d1f598f tempest-VolumeQuotasAdminTestJSON-532628032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a537db1f-29bf-42e2-9014-06b7e53080fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:40 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-11921eb4-4afd-44e7-b7a3-71ce1d1f598f tempest-VolumeQuotasAdminTestJSON-532628032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a537db1f-29bf-42e2-9014-06b7e53080fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4d2f8dd-a989-4798-a6db-aca539b755e9', 'volume_name': 'volume-f4d2f8dd-a989-4798-a6db-aca539b755e9', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:40 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-11921eb4-4afd-44e7-b7a3-71ce1d1f598f tempest-VolumeQuotasAdminTestJSON-532628032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64131c59-6e9b-41f3-b890-d93563a71e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:40 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-11921eb4-4afd-44e7-b7a3-71ce1d1f598f tempest-VolumeQuotasAdminTestJSON-532628032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64131c59-6e9b-41f3-b890-d93563a71e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:40 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-11921eb4-4afd-44e7-b7a3-71ce1d1f598f tempest-VolumeQuotasAdminTestJSON-532628032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c785d216-eea8-4827-92a9-d10be30ae567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:40 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-11921eb4-4afd-44e7-b7a3-71ce1d1f598f tempest-VolumeQuotasAdminTestJSON-532628032 None] Volume f4d2f8dd-a989-4798-a6db-aca539b755e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4d2f8dd-a989-4798-a6db-aca539b755e9', 'volume_size': 1} Jun 02 03:26:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-11921eb4-4afd-44e7-b7a3-71ce1d1f598f tempest-VolumeQuotasAdminTestJSON-532628032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0ab35612-f1e1-4f0b-8ea4-55d25d1c9a05 tempest-VolumesGetTest-41238149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d5dcfde7-21a2-46ee-a3d3-187d6debf766" returned: 0 in 1.043s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0ab35612-f1e1-4f0b-8ea4-55d25d1c9a05 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d5dcfde7-21a2-46ee-a3d3-187d6debf766 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:40 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d5dcfde7-21a2-46ee-a3d3-187d6debf766 Jun 02 03:26:40 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:40 devstack sudo[97514]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-786a056b-bdca-4375-a35e-f45e3615e2f1 tempest-SnapshotMetadataTestJSON-2102040595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f" returned: 0 in 0.956s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-786a056b-bdca-4375-a35e-f45e3615e2f1 tempest-SnapshotMetadataTestJSON-2102040595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:40 devstack sudo[97531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f Jun 02 03:26:40 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:40 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0f7b9733-c6c2-42b5-8123-f57d97f13ae8 tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb 1073741824" returned: 0 in 0.993s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0f7b9733-c6c2-42b5-8123-f57d97f13ae8 tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:40 devstack sudo[97533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb Jun 02 03:26:40 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:40 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0ab35612-f1e1-4f0b-8ea4-55d25d1c9a05 tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d5dcfde7-21a2-46ee-a3d3-187d6debf766" returned: 0 in 0.612s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0ab35612-f1e1-4f0b-8ea4-55d25d1c9a05 tempest-VolumesGetTest-41238149 None] Lock "cinder-quobyte-d5dcfde7-21a2-46ee-a3d3-187d6debf766" released by "delete_volume" :: held 1.708s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:26:40 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-0ab35612-f1e1-4f0b-8ea4-55d25d1c9a05 tempest-VolumesGetTest-41238149 None] Created reservations ['8f160c72-bcfb-4965-8f9a-40e2a995259b', '2cb669c3-8b47-4e98-a015-6c05a1fa553b', '4ffe10dc-e158-455f-aaa2-d9a39ac67b0c', '5768c8dc-f380-45f8-bd16-5baef211a846'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:26:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0ab35612-f1e1-4f0b-8ea4-55d25d1c9a05 tempest-VolumesGetTest-41238149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0ab35612-f1e1-4f0b-8ea4-55d25d1c9a05 tempest-VolumesGetTest-41238149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:40 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0ab35612-f1e1-4f0b-8ea4-55d25d1c9a05 tempest-VolumesGetTest-41238149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:26:40 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0ab35612-f1e1-4f0b-8ea4-55d25d1c9a05 tempest-VolumesGetTest-41238149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:26:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0ab35612-f1e1-4f0b-8ea4-55d25d1c9a05 tempest-VolumesGetTest-41238149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0ab35612-f1e1-4f0b-8ea4-55d25d1c9a05 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:40 devstack sudo[97536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:26:40 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:41 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-786a056b-bdca-4375-a35e-f45e3615e2f1 tempest-SnapshotMetadataTestJSON-2102040595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f" returned: 0 in 0.597s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:41 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-786a056b-bdca-4375-a35e-f45e3615e2f1 tempest-SnapshotMetadataTestJSON-2102040595 None] Lock "cinder-quobyte-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f" released by "delete_volume" :: held 1.665s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:26:41 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-786a056b-bdca-4375-a35e-f45e3615e2f1 tempest-SnapshotMetadataTestJSON-2102040595 None] Created reservations ['c414db26-0a5b-4546-822f-f6459f77efbc', '80323f6a-98af-4048-961e-86531d97319b', '892c89ac-4c2d-4422-9161-ddfd16060823', 'd3bb5bb2-1d69-43cc-83ac-d406729f16e1'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:26:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-786a056b-bdca-4375-a35e-f45e3615e2f1 tempest-SnapshotMetadataTestJSON-2102040595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-786a056b-bdca-4375-a35e-f45e3615e2f1 tempest-SnapshotMetadataTestJSON-2102040595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:41 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-786a056b-bdca-4375-a35e-f45e3615e2f1 tempest-SnapshotMetadataTestJSON-2102040595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:26:41 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-786a056b-bdca-4375-a35e-f45e3615e2f1 tempest-SnapshotMetadataTestJSON-2102040595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:26:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-786a056b-bdca-4375-a35e-f45e3615e2f1 tempest-SnapshotMetadataTestJSON-2102040595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-786a056b-bdca-4375-a35e-f45e3615e2f1 tempest-SnapshotMetadataTestJSON-2102040595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:41 devstack sudo[97540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:26:41 devstack sudo[97540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:41 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0f7b9733-c6c2-42b5-8123-f57d97f13ae8 tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb" returned: 0 in 0.640s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:41 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0f7b9733-c6c2-42b5-8123-f57d97f13ae8 tempest-VolumesSnapshotTestJSON-661765892 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:26:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0f7b9733-c6c2-42b5-8123-f57d97f13ae8 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.684s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-11921eb4-4afd-44e7-b7a3-71ce1d1f598f tempest-VolumeQuotasAdminTestJSON-532628032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.119s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:41 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-11921eb4-4afd-44e7-b7a3-71ce1d1f598f tempest-VolumeQuotasAdminTestJSON-532628032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-412815046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d2f8dd-a989-4798-a6db-aca539b755e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4caf1e57ad31495fae9b8858093e55c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:26:40Z,use_quota=True,user_id='82080bd631e34f8db87a8e255b9c9a3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:26:41 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-11921eb4-4afd-44e7-b7a3-71ce1d1f598f tempest-VolumeQuotasAdminTestJSON-532628032 None] Creating volume f4d2f8dd-a989-4798-a6db-aca539b755e9 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:26:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-11921eb4-4afd-44e7-b7a3-71ce1d1f598f tempest-VolumeQuotasAdminTestJSON-532628032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-11921eb4-4afd-44e7-b7a3-71ce1d1f598f tempest-VolumeQuotasAdminTestJSON-532628032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:41 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-11921eb4-4afd-44e7-b7a3-71ce1d1f598f tempest-VolumeQuotasAdminTestJSON-532628032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:26:41 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-11921eb4-4afd-44e7-b7a3-71ce1d1f598f tempest-VolumeQuotasAdminTestJSON-532628032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:26:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-11921eb4-4afd-44e7-b7a3-71ce1d1f598f tempest-VolumeQuotasAdminTestJSON-532628032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:41 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-11921eb4-4afd-44e7-b7a3-71ce1d1f598f tempest-VolumeQuotasAdminTestJSON-532628032 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:26:41 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-11921eb4-4afd-44e7-b7a3-71ce1d1f598f tempest-VolumeQuotasAdminTestJSON-532628032 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:26:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-11921eb4-4afd-44e7-b7a3-71ce1d1f598f tempest-VolumeQuotasAdminTestJSON-532628032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f4d2f8dd-a989-4798-a6db-aca539b755e9 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:41 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0f7b9733-c6c2-42b5-8123-f57d97f13ae8 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d554c40-3b44-4af2-b938-75b36a731b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:41 devstack sudo[97542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f4d2f8dd-a989-4798-a6db-aca539b755e9 1073741824 Jun 02 03:26:41 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:41 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0f7b9733-c6c2-42b5-8123-f57d97f13ae8 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6bfd1f1-2dfe-481f-8db8-c855b358f641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:41 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e0256011-7096-40a3-8985-1c90aafcfe8b tempest-VolumesGetTest-41238149 None] Acquiring lock "cinder-e4060c2c-9681-4c78-88a3-1a22196b292c-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:26:41 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-0f7b9733-c6c2-42b5-8123-f57d97f13ae8 tempest-VolumesSnapshotTestJSON-661765892 None] Volume volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb (cde36c0c-2d55-4cc9-b116-86b41425bdfb): created successfully Jun 02 03:26:41 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0f7b9733-c6c2-42b5-8123-f57d97f13ae8 tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6bfd1f1-2dfe-481f-8db8-c855b358f641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:41 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0f7b9733-c6c2-42b5-8123-f57d97f13ae8 tempest-VolumesSnapshotTestJSON-661765892 None] Flow 'volume_create_manager' (95f71c1b-4e04-4761-8033-3c04d4cfa317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:26:41 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e0256011-7096-40a3-8985-1c90aafcfe8b tempest-VolumesGetTest-41238149 None] Lock "cinder-e4060c2c-9681-4c78-88a3-1a22196b292c-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:26:41 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-0f7b9733-c6c2-42b5-8123-f57d97f13ae8 tempest-VolumesSnapshotTestJSON-661765892 None] Created volume successfully. Jun 02 03:26:41 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e0256011-7096-40a3-8985-1c90aafcfe8b tempest-VolumesGetTest-41238149 None] Acquiring lock "cinder-quobyte-e4060c2c-9681-4c78-88a3-1a22196b292c" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:26:41 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e0256011-7096-40a3-8985-1c90aafcfe8b tempest-VolumesGetTest-41238149 None] Lock "cinder-quobyte-e4060c2c-9681-4c78-88a3-1a22196b292c" acquired by "delete_volume" :: waited 0.023s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:26:41 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[191a3235-ec8a-4fcb-a76b-f118240c791a]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:26:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e0256011-7096-40a3-8985-1c90aafcfe8b tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e4060c2c-9681-4c78-88a3-1a22196b292c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:41 devstack sudo[97545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e4060c2c-9681-4c78-88a3-1a22196b292c Jun 02 03:26:41 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:41 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0ab35612-f1e1-4f0b-8ea4-55d25d1c9a05 tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.789s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:41 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-0ab35612-f1e1-4f0b-8ea4-55d25d1c9a05 tempest-VolumesGetTest-41238149 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:26:41 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-0ab35612-f1e1-4f0b-8ea4-55d25d1c9a05 tempest-VolumesGetTest-41238149 None] Deleted volume successfully. Jun 02 03:26:41 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0ab35612-f1e1-4f0b-8ea4-55d25d1c9a05 tempest-VolumesGetTest-41238149 None] Lock "cinder-d5dcfde7-21a2-46ee-a3d3-187d6debf766-delete_volume" released by "delete_volume" :: held 2.729s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:26:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4bb4c565-627c-4678-a0f5-83a09e55f0c0 tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:42 devstack sudo[97540]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-786a056b-bdca-4375-a35e-f45e3615e2f1 tempest-SnapshotMetadataTestJSON-2102040595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.917s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:42 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-786a056b-bdca-4375-a35e-f45e3615e2f1 tempest-SnapshotMetadataTestJSON-2102040595 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:26:42 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-786a056b-bdca-4375-a35e-f45e3615e2f1 tempest-SnapshotMetadataTestJSON-2102040595 None] Deleted volume successfully. Jun 02 03:26:42 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-786a056b-bdca-4375-a35e-f45e3615e2f1 tempest-SnapshotMetadataTestJSON-2102040595 None] Lock "cinder-1b1fedfb-93f4-4aa5-8437-c3ad8533c08f-delete_volume" released by "delete_volume" :: held 2.876s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:26:42 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-11921eb4-4afd-44e7-b7a3-71ce1d1f598f tempest-VolumeQuotasAdminTestJSON-532628032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f4d2f8dd-a989-4798-a6db-aca539b755e9 1073741824" returned: 0 in 1.069s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:42 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-11921eb4-4afd-44e7-b7a3-71ce1d1f598f tempest-VolumeQuotasAdminTestJSON-532628032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f4d2f8dd-a989-4798-a6db-aca539b755e9 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e0256011-7096-40a3-8985-1c90aafcfe8b tempest-VolumesGetTest-41238149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e4060c2c-9681-4c78-88a3-1a22196b292c" returned: 0 in 0.838s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e0256011-7096-40a3-8985-1c90aafcfe8b tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e4060c2c-9681-4c78-88a3-1a22196b292c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:42 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f4d2f8dd-a989-4798-a6db-aca539b755e9 Jun 02 03:26:42 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:42 devstack sudo[97557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e4060c2c-9681-4c78-88a3-1a22196b292c Jun 02 03:26:42 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:43 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e0256011-7096-40a3-8985-1c90aafcfe8b tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e4060c2c-9681-4c78-88a3-1a22196b292c" returned: 0 in 0.630s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:43 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-11921eb4-4afd-44e7-b7a3-71ce1d1f598f tempest-VolumeQuotasAdminTestJSON-532628032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f4d2f8dd-a989-4798-a6db-aca539b755e9" returned: 0 in 0.654s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:43 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-11921eb4-4afd-44e7-b7a3-71ce1d1f598f tempest-VolumeQuotasAdminTestJSON-532628032 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:26:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-11921eb4-4afd-44e7-b7a3-71ce1d1f598f tempest-VolumeQuotasAdminTestJSON-532628032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4bb4c565-627c-4678-a0f5-83a09e55f0c0 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.056s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:43 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e0256011-7096-40a3-8985-1c90aafcfe8b tempest-VolumesGetTest-41238149 None] Lock "cinder-quobyte-e4060c2c-9681-4c78-88a3-1a22196b292c" released by "delete_volume" :: held 1.541s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:26:43 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-4bb4c565-627c-4678-a0f5-83a09e55f0c0 tempest-VolumesSnapshotTestJSON-661765892 None] Creating offline snapshot c593944b-dcac-4529-864b-83fd1713f86a of volume cde36c0c-2d55-4cc9-b116-86b41425bdfb {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:26:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-11921eb4-4afd-44e7-b7a3-71ce1d1f598f tempest-VolumeQuotasAdminTestJSON-532628032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c785d216-eea8-4827-92a9-d10be30ae567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4d2f8dd-a989-4798-a6db-aca539b755e9', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-11921eb4-4afd-44e7-b7a3-71ce1d1f598f tempest-VolumeQuotasAdminTestJSON-532628032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b3a74d-c754-4564-af3b-504dda213569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:43 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe1776d-a1aa-4d52-a944-42eba0103b38]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:26:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4bb4c565-627c-4678-a0f5-83a09e55f0c0 tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:43 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-11921eb4-4afd-44e7-b7a3-71ce1d1f598f tempest-VolumeQuotasAdminTestJSON-532628032 None] Volume volume-f4d2f8dd-a989-4798-a6db-aca539b755e9 (f4d2f8dd-a989-4798-a6db-aca539b755e9): created successfully Jun 02 03:26:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-11921eb4-4afd-44e7-b7a3-71ce1d1f598f tempest-VolumeQuotasAdminTestJSON-532628032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b3a74d-c754-4564-af3b-504dda213569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-11921eb4-4afd-44e7-b7a3-71ce1d1f598f tempest-VolumeQuotasAdminTestJSON-532628032 None] Flow 'volume_create_manager' (4f4f4599-4360-428b-8930-6aa2d3cc776d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:26:43 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-11921eb4-4afd-44e7-b7a3-71ce1d1f598f tempest-VolumeQuotasAdminTestJSON-532628032 None] Created volume successfully. Jun 02 03:26:43 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-e0256011-7096-40a3-8985-1c90aafcfe8b tempest-VolumesGetTest-41238149 None] Created reservations ['a01c402b-2b68-47c5-b5d3-735d7e81ab72', '9f98eca7-64a2-4c63-bf91-844ddf6a92f4', 'c0cb8060-6177-4270-b91e-76dd48c11b02', 'a3fb0eab-afbd-48ed-a7fc-fbcffe07f876'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:26:43 devstack sudo[97563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb Jun 02 03:26:43 devstack sudo[97563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e0256011-7096-40a3-8985-1c90aafcfe8b tempest-VolumesGetTest-41238149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e0256011-7096-40a3-8985-1c90aafcfe8b tempest-VolumesGetTest-41238149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:43 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e0256011-7096-40a3-8985-1c90aafcfe8b tempest-VolumesGetTest-41238149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:26:43 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e0256011-7096-40a3-8985-1c90aafcfe8b tempest-VolumesGetTest-41238149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:26:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e0256011-7096-40a3-8985-1c90aafcfe8b tempest-VolumesGetTest-41238149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e0256011-7096-40a3-8985-1c90aafcfe8b tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:43 devstack sudo[97565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:26:43 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:43 devstack sudo[97563]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4bb4c565-627c-4678-a0f5-83a09e55f0c0 tempest-VolumesSnapshotTestJSON-661765892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb" returned: 0 in 0.820s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4bb4c565-627c-4678-a0f5-83a09e55f0c0 tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb.c593944b-dcac-4529-864b-83fd1713f86a 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:44 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb.c593944b-dcac-4529-864b-83fd1713f86a 1G Jun 02 03:26:44 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:44 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e0256011-7096-40a3-8985-1c90aafcfe8b tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.739s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:44 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-e0256011-7096-40a3-8985-1c90aafcfe8b tempest-VolumesGetTest-41238149 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:26:44 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-e0256011-7096-40a3-8985-1c90aafcfe8b tempest-VolumesGetTest-41238149 None] Deleted volume successfully. Jun 02 03:26:44 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e0256011-7096-40a3-8985-1c90aafcfe8b tempest-VolumesGetTest-41238149 None] Lock "cinder-e4060c2c-9681-4c78-88a3-1a22196b292c-delete_volume" released by "delete_volume" :: held 2.674s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:26:44 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b002cca-7e49-4e27-b9f2-6c8e6f1217b7 tempest-VolumesGetTest-41238149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:26:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3b002cca-7e49-4e27-b9f2-6c8e6f1217b7 tempest-VolumesGetTest-41238149 None] Flow 'volume_create_manager' (02190717-e2b3-4213-a0b7-d7abe14295f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:26:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3b002cca-7e49-4e27-b9f2-6c8e6f1217b7 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16f35f42-2734-42d3-bb84-febcea644b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3b002cca-7e49-4e27-b9f2-6c8e6f1217b7 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16f35f42-2734-42d3-bb84-febcea644b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1317463161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d55dcc37-9b4e-4621-b961-348d0b1cc7b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ecbcb594f540ed9eb6bbd6f6eda02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:26:44Z,use_quota=True,user_id='3b07719d39b2468bb6daaeeeb8feb831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3b002cca-7e49-4e27-b9f2-6c8e6f1217b7 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bf77f80-6281-46ae-9dee-a65503b043cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3b002cca-7e49-4e27-b9f2-6c8e6f1217b7 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bf77f80-6281-46ae-9dee-a65503b043cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3b002cca-7e49-4e27-b9f2-6c8e6f1217b7 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e52cade0-262c-44f0-be55-02676bd244c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3b002cca-7e49-4e27-b9f2-6c8e6f1217b7 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e52cade0-262c-44f0-be55-02676bd244c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd55dcc37-9b4e-4621-b961-348d0b1cc7b9', 'volume_name': 'volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3b002cca-7e49-4e27-b9f2-6c8e6f1217b7 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b28919-5568-413e-abcd-56efa59f6fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3b002cca-7e49-4e27-b9f2-6c8e6f1217b7 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b28919-5568-413e-abcd-56efa59f6fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3b002cca-7e49-4e27-b9f2-6c8e6f1217b7 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (351b6932-987e-45c0-9e5b-3ae32b0445d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:44 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-3b002cca-7e49-4e27-b9f2-6c8e6f1217b7 tempest-VolumesGetTest-41238149 None] Volume d55dcc37-9b4e-4621-b961-348d0b1cc7b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9', 'volume_size': 1} Jun 02 03:26:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3b002cca-7e49-4e27-b9f2-6c8e6f1217b7 tempest-VolumesGetTest-41238149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:44 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4bb4c565-627c-4678-a0f5-83a09e55f0c0 tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb.c593944b-dcac-4529-864b-83fd1713f86a 1G" returned: 0 in 0.846s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4bb4c565-627c-4678-a0f5-83a09e55f0c0 tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb.c593944b-dcac-4529-864b-83fd1713f86a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:44 devstack sudo[97577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb.c593944b-dcac-4529-864b-83fd1713f86a Jun 02 03:26:44 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:45 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e0d9612-6556-4e43-b04a-75d40f3a51ef tempest-VolumesDeleteCascade-451749405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:26:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9e0d9612-6556-4e43-b04a-75d40f3a51ef tempest-VolumesDeleteCascade-451749405 None] Flow 'volume_create_manager' (d871ab12-fd72-410c-bde0-571af2a4f817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:26:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9e0d9612-6556-4e43-b04a-75d40f3a51ef tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49bf0786-978f-4211-be70-78f4ba6fba80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9e0d9612-6556-4e43-b04a-75d40f3a51ef tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49bf0786-978f-4211-be70-78f4ba6fba80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1038586564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a71e977c-ba4b-4011-99ea-7da7688fdac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff2e68c2b8a44d478abefd101c9ba76d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:26:45Z,use_quota=True,user_id='57230c43bfc04a86a8d4f033f6831d1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9e0d9612-6556-4e43-b04a-75d40f3a51ef tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f929d08-db53-45eb-ad27-aaddcb86cdff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9e0d9612-6556-4e43-b04a-75d40f3a51ef tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f929d08-db53-45eb-ad27-aaddcb86cdff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9e0d9612-6556-4e43-b04a-75d40f3a51ef tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a05629a-ac84-4f44-adab-f825924c2986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9e0d9612-6556-4e43-b04a-75d40f3a51ef tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a05629a-ac84-4f44-adab-f825924c2986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a71e977c-ba4b-4011-99ea-7da7688fdac0', 'volume_name': 'volume-a71e977c-ba4b-4011-99ea-7da7688fdac0', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9e0d9612-6556-4e43-b04a-75d40f3a51ef tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff48110-c96d-450d-a2b6-b11188273b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9e0d9612-6556-4e43-b04a-75d40f3a51ef tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff48110-c96d-450d-a2b6-b11188273b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9e0d9612-6556-4e43-b04a-75d40f3a51ef tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71745536-bbf1-45c5-8f9d-edd55baecf81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:45 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-9e0d9612-6556-4e43-b04a-75d40f3a51ef tempest-VolumesDeleteCascade-451749405 None] Volume a71e977c-ba4b-4011-99ea-7da7688fdac0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a71e977c-ba4b-4011-99ea-7da7688fdac0', 'volume_size': 1} Jun 02 03:26:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9e0d9612-6556-4e43-b04a-75d40f3a51ef tempest-VolumesDeleteCascade-451749405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:45 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-c99a28d7-fe75-4242-85ce-5f7d5cfc5fa0 tempest-VolumeQuotasAdminTestJSON-2093980058 None] Transfer volume completed successfully. Jun 02 03:26:45 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4bb4c565-627c-4678-a0f5-83a09e55f0c0 tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb.c593944b-dcac-4529-864b-83fd1713f86a" returned: 0 in 0.653s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:45 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-4bb4c565-627c-4678-a0f5-83a09e55f0c0 tempest-VolumesSnapshotTestJSON-661765892 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb.c593944b-dcac-4529-864b-83fd1713f86a is being set with open permissions: ugo+rw Jun 02 03:26:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4bb4c565-627c-4678-a0f5-83a09e55f0c0 tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb.c593944b-dcac-4529-864b-83fd1713f86a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:45 devstack sudo[97582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb.c593944b-dcac-4529-864b-83fd1713f86a Jun 02 03:26:45 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:46 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-cbdfd28f-46ec-454d-8b14-520bcdf75276 tempest-VolumeQuotasAdminTestJSON-258124665 None] Acquiring lock "cinder-f4d2f8dd-a989-4798-a6db-aca539b755e9-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:26:46 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-cbdfd28f-46ec-454d-8b14-520bcdf75276 tempest-VolumeQuotasAdminTestJSON-258124665 None] Lock "cinder-f4d2f8dd-a989-4798-a6db-aca539b755e9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:26:46 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-cbdfd28f-46ec-454d-8b14-520bcdf75276 tempest-VolumeQuotasAdminTestJSON-258124665 None] Acquiring lock "cinder-quobyte-f4d2f8dd-a989-4798-a6db-aca539b755e9" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:26:46 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-cbdfd28f-46ec-454d-8b14-520bcdf75276 tempest-VolumeQuotasAdminTestJSON-258124665 None] Lock "cinder-quobyte-f4d2f8dd-a989-4798-a6db-aca539b755e9" acquired by "delete_volume" :: waited 0.014s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:26:46 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a48900b-e521-47f8-907d-28297d46eb18]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:26:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cbdfd28f-46ec-454d-8b14-520bcdf75276 tempest-VolumeQuotasAdminTestJSON-258124665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f4d2f8dd-a989-4798-a6db-aca539b755e9 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:46 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4bb4c565-627c-4678-a0f5-83a09e55f0c0 tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb.c593944b-dcac-4529-864b-83fd1713f86a" returned: 0 in 0.631s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4bb4c565-627c-4678-a0f5-83a09e55f0c0 tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:46 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb.info Jun 02 03:26:46 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:46 devstack sudo[97585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f4d2f8dd-a989-4798-a6db-aca539b755e9 Jun 02 03:26:46 devstack sudo[97585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:46 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4bb4c565-627c-4678-a0f5-83a09e55f0c0 tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb.info" returned: 0 in 0.615s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:46 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-4bb4c565-627c-4678-a0f5-83a09e55f0c0 tempest-VolumesSnapshotTestJSON-661765892 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb.info is being set with open permissions: ugo+rw Jun 02 03:26:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4bb4c565-627c-4678-a0f5-83a09e55f0c0 tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:46 devstack sudo[97593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb.info Jun 02 03:26:46 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:46 devstack sudo[97585]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cbdfd28f-46ec-454d-8b14-520bcdf75276 tempest-VolumeQuotasAdminTestJSON-258124665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f4d2f8dd-a989-4798-a6db-aca539b755e9" returned: 0 in 0.701s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cbdfd28f-46ec-454d-8b14-520bcdf75276 tempest-VolumeQuotasAdminTestJSON-258124665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f4d2f8dd-a989-4798-a6db-aca539b755e9 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:46 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f4d2f8dd-a989-4798-a6db-aca539b755e9 Jun 02 03:26:46 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:47 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4bb4c565-627c-4678-a0f5-83a09e55f0c0 tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb.info" returned: 0 in 0.602s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4bb4c565-627c-4678-a0f5-83a09e55f0c0 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.283s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3b002cca-7e49-4e27-b9f2-6c8e6f1217b7 tempest-VolumesGetTest-41238149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.088s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3b002cca-7e49-4e27-b9f2-6c8e6f1217b7 tempest-VolumesGetTest-41238149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1317463161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d55dcc37-9b4e-4621-b961-348d0b1cc7b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ecbcb594f540ed9eb6bbd6f6eda02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:26:44Z,use_quota=True,user_id='3b07719d39b2468bb6daaeeeb8feb831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:26:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-3b002cca-7e49-4e27-b9f2-6c8e6f1217b7 tempest-VolumesGetTest-41238149 None] Creating volume d55dcc37-9b4e-4621-b961-348d0b1cc7b9 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:26:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3b002cca-7e49-4e27-b9f2-6c8e6f1217b7 tempest-VolumesGetTest-41238149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3b002cca-7e49-4e27-b9f2-6c8e6f1217b7 tempest-VolumesGetTest-41238149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3b002cca-7e49-4e27-b9f2-6c8e6f1217b7 tempest-VolumesGetTest-41238149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:26:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3b002cca-7e49-4e27-b9f2-6c8e6f1217b7 tempest-VolumesGetTest-41238149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:26:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3b002cca-7e49-4e27-b9f2-6c8e6f1217b7 tempest-VolumesGetTest-41238149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3b002cca-7e49-4e27-b9f2-6c8e6f1217b7 tempest-VolumesGetTest-41238149 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:26:47 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-3b002cca-7e49-4e27-b9f2-6c8e6f1217b7 tempest-VolumesGetTest-41238149 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:26:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3b002cca-7e49-4e27-b9f2-6c8e6f1217b7 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:47 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cbdfd28f-46ec-454d-8b14-520bcdf75276 tempest-VolumeQuotasAdminTestJSON-258124665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f4d2f8dd-a989-4798-a6db-aca539b755e9" returned: 0 in 0.622s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:47 devstack sudo[97599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9 1073741824 Jun 02 03:26:47 devstack sudo[97599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:47 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-cbdfd28f-46ec-454d-8b14-520bcdf75276 tempest-VolumeQuotasAdminTestJSON-258124665 None] Lock "cinder-quobyte-f4d2f8dd-a989-4798-a6db-aca539b755e9" released by "delete_volume" :: held 1.374s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:26:47 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-4bb4c565-627c-4678-a0f5-83a09e55f0c0 tempest-VolumesSnapshotTestJSON-661765892 None] Create snapshot completed successfully Jun 02 03:26:47 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-cbdfd28f-46ec-454d-8b14-520bcdf75276 tempest-VolumeQuotasAdminTestJSON-258124665 None] Created reservations ['61a187fc-1413-41e6-9c61-840e7b8fbc1e', 'bc9b75c7-e055-4ec9-bb72-2f4fb0480e37', '4a104a88-a1ff-4960-9844-9e9d36fb8b6b', '7cd39b10-4dd8-49bb-8a5b-5911e5b71517'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:26:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-cbdfd28f-46ec-454d-8b14-520bcdf75276 tempest-VolumeQuotasAdminTestJSON-258124665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-cbdfd28f-46ec-454d-8b14-520bcdf75276 tempest-VolumeQuotasAdminTestJSON-258124665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-cbdfd28f-46ec-454d-8b14-520bcdf75276 tempest-VolumeQuotasAdminTestJSON-258124665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:26:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-cbdfd28f-46ec-454d-8b14-520bcdf75276 tempest-VolumeQuotasAdminTestJSON-258124665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:26:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-cbdfd28f-46ec-454d-8b14-520bcdf75276 tempest-VolumeQuotasAdminTestJSON-258124665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cbdfd28f-46ec-454d-8b14-520bcdf75276 tempest-VolumeQuotasAdminTestJSON-258124665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:47 devstack sudo[97601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:26:47 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:48 devstack sudo[97599]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3b002cca-7e49-4e27-b9f2-6c8e6f1217b7 tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9 1073741824" returned: 0 in 0.736s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:48 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cbdfd28f-46ec-454d-8b14-520bcdf75276 tempest-VolumeQuotasAdminTestJSON-258124665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.612s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:48 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-cbdfd28f-46ec-454d-8b14-520bcdf75276 tempest-VolumeQuotasAdminTestJSON-258124665 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:26:48 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-cbdfd28f-46ec-454d-8b14-520bcdf75276 tempest-VolumeQuotasAdminTestJSON-258124665 None] Deleted volume successfully. Jun 02 03:26:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3b002cca-7e49-4e27-b9f2-6c8e6f1217b7 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:48 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-cbdfd28f-46ec-454d-8b14-520bcdf75276 tempest-VolumeQuotasAdminTestJSON-258124665 None] Lock "cinder-f4d2f8dd-a989-4798-a6db-aca539b755e9-delete_volume" released by "delete_volume" :: held 2.187s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:26:48 devstack sudo[97607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9 Jun 02 03:26:48 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:48 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3b002cca-7e49-4e27-b9f2-6c8e6f1217b7 tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9" returned: 0 in 0.691s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:48 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3b002cca-7e49-4e27-b9f2-6c8e6f1217b7 tempest-VolumesGetTest-41238149 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:26:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3b002cca-7e49-4e27-b9f2-6c8e6f1217b7 tempest-VolumesGetTest-41238149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9e0d9612-6556-4e43-b04a-75d40f3a51ef tempest-VolumesDeleteCascade-451749405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.805s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:48 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9e0d9612-6556-4e43-b04a-75d40f3a51ef tempest-VolumesDeleteCascade-451749405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1038586564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a71e977c-ba4b-4011-99ea-7da7688fdac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff2e68c2b8a44d478abefd101c9ba76d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:26:45Z,use_quota=True,user_id='57230c43bfc04a86a8d4f033f6831d1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:26:48 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-9e0d9612-6556-4e43-b04a-75d40f3a51ef tempest-VolumesDeleteCascade-451749405 None] Creating volume a71e977c-ba4b-4011-99ea-7da7688fdac0 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:26:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9e0d9612-6556-4e43-b04a-75d40f3a51ef tempest-VolumesDeleteCascade-451749405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9e0d9612-6556-4e43-b04a-75d40f3a51ef tempest-VolumesDeleteCascade-451749405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:48 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9e0d9612-6556-4e43-b04a-75d40f3a51ef tempest-VolumesDeleteCascade-451749405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:26:48 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9e0d9612-6556-4e43-b04a-75d40f3a51ef tempest-VolumesDeleteCascade-451749405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:26:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9e0d9612-6556-4e43-b04a-75d40f3a51ef tempest-VolumesDeleteCascade-451749405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:48 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9e0d9612-6556-4e43-b04a-75d40f3a51ef tempest-VolumesDeleteCascade-451749405 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:26:48 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-9e0d9612-6556-4e43-b04a-75d40f3a51ef tempest-VolumesDeleteCascade-451749405 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:26:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9e0d9612-6556-4e43-b04a-75d40f3a51ef tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:48 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:26:48 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0 1073741824 Jun 02 03:26:48 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3b002cca-7e49-4e27-b9f2-6c8e6f1217b7 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (351b6932-987e-45c0-9e5b-3ae32b0445d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3b002cca-7e49-4e27-b9f2-6c8e6f1217b7 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81fb24e5-8348-49ba-82c4-b8f813a019a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Flow 'volume_create_manager' (ea6fe6d2-76bb-4aee-a3f4-6c34a92dfd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:26:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06417508-ae7d-4fa2-9cda-8a2c3340a523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:48 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-3b002cca-7e49-4e27-b9f2-6c8e6f1217b7 tempest-VolumesGetTest-41238149 None] Volume volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9 (d55dcc37-9b4e-4621-b961-348d0b1cc7b9): created successfully Jun 02 03:26:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3b002cca-7e49-4e27-b9f2-6c8e6f1217b7 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81fb24e5-8348-49ba-82c4-b8f813a019a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3b002cca-7e49-4e27-b9f2-6c8e6f1217b7 tempest-VolumesGetTest-41238149 None] Flow 'volume_create_manager' (02190717-e2b3-4213-a0b7-d7abe14295f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:26:49 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06417508-ae7d-4fa2-9cda-8a2c3340a523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-925743644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98af1d38-c460-4dce-98d2-9c6fe704a111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f92811de804e4da9af80175226575210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c593944b-dcac-4529-864b-83fd1713f86a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:26:49Z,use_quota=True,user_id='6c94587123b44232a21505de6aec93e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:49 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e741da52-3493-4e69-853c-f8e2ea165eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:49 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e741da52-3493-4e69-853c-f8e2ea165eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:49 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd3b09d0-375c-4838-a0ff-f2462ec01d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:49 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd3b09d0-375c-4838-a0ff-f2462ec01d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '98af1d38-c460-4dce-98d2-9c6fe704a111', 'volume_name': 'volume-98af1d38-c460-4dce-98d2-9c6fe704a111', 'volume_size': 1, 'snapshot_id': 'c593944b-dcac-4529-864b-83fd1713f86a'}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:49 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9d7fe36-863b-477c-bd00-412a4b4aa109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:49 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9d7fe36-863b-477c-bd00-412a4b4aa109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:49 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2f8c639-8d11-4985-aa1c-84db82c9b2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:49 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Volume 98af1d38-c460-4dce-98d2-9c6fe704a111: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-98af1d38-c460-4dce-98d2-9c6fe704a111', 'volume_size': 1, 'snapshot_id': 'c593944b-dcac-4529-864b-83fd1713f86a'} Jun 02 03:26:49 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-3b002cca-7e49-4e27-b9f2-6c8e6f1217b7 tempest-VolumesGetTest-41238149 None] Created volume successfully. Jun 02 03:26:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:49 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9e0d9612-6556-4e43-b04a-75d40f3a51ef tempest-VolumesDeleteCascade-451749405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0 1073741824" returned: 0 in 0.896s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9e0d9612-6556-4e43-b04a-75d40f3a51ef tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:49 devstack sudo[97616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0 Jun 02 03:26:49 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:49 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Flow 'volume_create_manager' (aedb4b90-bf1d-44a5-9c14-6ff80c1c6fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09122fb7-cc27-441d-a50d-c88259de6b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09122fb7-cc27-441d-a50d-c88259de6b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-148417316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d26de39c-7e2f-4c99-a7b5-8d602dc41e56,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='82ecbcb594f540ed9eb6bbd6f6eda02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=d55dcc37-9b4e-4621-b961-348d0b1cc7b9,status='creating',terminated_at=None,updated_at=2026-06-02T01:26:50Z,use_quota=True,user_id='3b07719d39b2468bb6daaeeeb8feb831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f36b6f-935a-4119-b95d-e8c9b0372455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f36b6f-935a-4119-b95d-e8c9b0372455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f41f1145-07eb-45c6-8896-76620a798020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f41f1145-07eb-45c6-8896-76620a798020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd26de39c-7e2f-4c99-a7b5-8d602dc41e56', 'volume_name': 'volume-d26de39c-7e2f-4c99-a7b5-8d602dc41e56', 'volume_size': 1, 'source_volid': 'd55dcc37-9b4e-4621-b961-348d0b1cc7b9', 'source_volstatus': 'available'}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b41f12e-df32-484a-9ef5-348e9a172fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b41f12e-df32-484a-9ef5-348e9a172fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dae3057a-1d36-43c8-bf81-0a219fa71ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:50 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Volume d26de39c-7e2f-4c99-a7b5-8d602dc41e56: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d26de39c-7e2f-4c99-a7b5-8d602dc41e56', 'volume_size': 1, 'source_volid': 'd55dcc37-9b4e-4621-b961-348d0b1cc7b9', 'source_volstatus': 'available'} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:50 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9e0d9612-6556-4e43-b04a-75d40f3a51ef tempest-VolumesDeleteCascade-451749405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0" returned: 0 in 0.636s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9e0d9612-6556-4e43-b04a-75d40f3a51ef tempest-VolumesDeleteCascade-451749405 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9e0d9612-6556-4e43-b04a-75d40f3a51ef tempest-VolumesDeleteCascade-451749405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.431s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "cinder-quobyte-c593944b-dcac-4529-864b-83fd1713f86a-98af1d38-c460-4dce-98d2-9c6fe704a111" by "_create_volume_from_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-quobyte-c593944b-dcac-4529-864b-83fd1713f86a-98af1d38-c460-4dce-98d2-9c6fe704a111" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Creating volume 98af1d38-c460-4dce-98d2-9c6fe704a111 from snapshot c593944b-dcac-4529-864b-83fd1713f86a {{(pid=86431) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "cinder-quobyte-98af1d38-c460-4dce-98d2-9c6fe704a111" by "_copy_volume_from_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9e0d9612-6556-4e43-b04a-75d40f3a51ef tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71745536-bbf1-45c5-8f9d-edd55baecf81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a71e977c-ba4b-4011-99ea-7da7688fdac0', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9e0d9612-6556-4e43-b04a-75d40f3a51ef tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc22a924-c6eb-40cd-9247-5bf290cb5113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-quobyte-98af1d38-c460-4dce-98d2-9c6fe704a111" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] snapshot: c593944b-dcac-4529-864b-83fd1713f86a, volume: 98af1d38-c460-4dce-98d2-9c6fe704a111, {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:50 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-9e0d9612-6556-4e43-b04a-75d40f3a51ef tempest-VolumesDeleteCascade-451749405 None] Volume volume-a71e977c-ba4b-4011-99ea-7da7688fdac0 (a71e977c-ba4b-4011-99ea-7da7688fdac0): created successfully Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9e0d9612-6556-4e43-b04a-75d40f3a51ef tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc22a924-c6eb-40cd-9247-5bf290cb5113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9e0d9612-6556-4e43-b04a-75d40f3a51ef tempest-VolumesDeleteCascade-451749405 None] Flow 'volume_create_manager' (d871ab12-fd72-410c-bde0-571af2a4f817) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9bff8f-fe38-4ec3-990f-d2cf90a33e41]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:26:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb.c593944b-dcac-4529-864b-83fd1713f86a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:50 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-9e0d9612-6556-4e43-b04a-75d40f3a51ef tempest-VolumesDeleteCascade-451749405 None] Created volume successfully. Jun 02 03:26:50 devstack sudo[97619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb.c593944b-dcac-4529-864b-83fd1713f86a Jun 02 03:26:50 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:51 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb.c593944b-dcac-4529-864b-83fd1713f86a" returned: 0 in 0.792s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:51 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:26:51 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 03:26:51 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Creating direct copy from snapshot {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 03:26:51 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5ed398-6f97-4de1-9ce9-b9ed8fdaa6d7]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:26:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:51 devstack sudo[97624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb Jun 02 03:26:51 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-60c6fd78-95e9-4108-ba72-f5d2a34f9f99 tempest-VolumesDeleteCascade-451749405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:52 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb" returned: 0 in 0.771s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:52 devstack cinder-volume[86431]: DEBUG cinder.utils [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Path /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-98af1d38-c460-4dce-98d2-9c6fe704a111 not found in is_blk_device check {{(pid=86431) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 02 03:26:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-98af1d38-c460-4dce-98d2-9c6fe704a111 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:52 devstack sudo[97629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-98af1d38-c460-4dce-98d2-9c6fe704a111 Jun 02 03:26:52 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:57 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-98af1d38-c460-4dce-98d2-9c6fe704a111" returned: 0 in 5.107s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:57 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b8f49a-dcf2-4851-87e6-ac0b3995f955]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:26:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:57 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb Jun 02 03:26:57 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:57 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-71e34e3c-94d4-4456-9fc0-125d474fd426 tempest-VolumesServicesTestJSON-1020493186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:26:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-71e34e3c-94d4-4456-9fc0-125d474fd426 tempest-VolumesServicesTestJSON-1020493186 None] Flow 'volume_create_manager' (5b1a3e81-727c-4579-b6ac-151457ad765c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:26:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-71e34e3c-94d4-4456-9fc0-125d474fd426 tempest-VolumesServicesTestJSON-1020493186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd4b955f-7909-497e-9786-047eff420373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-71e34e3c-94d4-4456-9fc0-125d474fd426 tempest-VolumesServicesTestJSON-1020493186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd4b955f-7909-497e-9786-047eff420373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-18768910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a263146-2e32-4e14-bd86-49e5eb99becb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75bc466524ae4ad5a14d1784809ac2d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:26:58Z,use_quota=True,user_id='169f2096a9e94152b6a2476a0dce9002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-71e34e3c-94d4-4456-9fc0-125d474fd426 tempest-VolumesServicesTestJSON-1020493186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (690784b1-d043-4e62-b694-a20e30d458d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-71e34e3c-94d4-4456-9fc0-125d474fd426 tempest-VolumesServicesTestJSON-1020493186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (690784b1-d043-4e62-b694-a20e30d458d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-71e34e3c-94d4-4456-9fc0-125d474fd426 tempest-VolumesServicesTestJSON-1020493186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01a65881-8bad-4218-84d9-e228425478dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-71e34e3c-94d4-4456-9fc0-125d474fd426 tempest-VolumesServicesTestJSON-1020493186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01a65881-8bad-4218-84d9-e228425478dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a263146-2e32-4e14-bd86-49e5eb99becb', 'volume_name': 'volume-5a263146-2e32-4e14-bd86-49e5eb99becb', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-71e34e3c-94d4-4456-9fc0-125d474fd426 tempest-VolumesServicesTestJSON-1020493186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fabac852-fb23-4dea-a45f-0f0e5da864dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-71e34e3c-94d4-4456-9fc0-125d474fd426 tempest-VolumesServicesTestJSON-1020493186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fabac852-fb23-4dea-a45f-0f0e5da864dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-71e34e3c-94d4-4456-9fc0-125d474fd426 tempest-VolumesServicesTestJSON-1020493186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25e04502-a568-4cb7-9cb8-30ef59eaebf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:57 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-71e34e3c-94d4-4456-9fc0-125d474fd426 tempest-VolumesServicesTestJSON-1020493186 None] Volume 5a263146-2e32-4e14-bd86-49e5eb99becb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a263146-2e32-4e14-bd86-49e5eb99becb', 'volume_size': 1} Jun 02 03:26:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-71e34e3c-94d4-4456-9fc0-125d474fd426 tempest-VolumesServicesTestJSON-1020493186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:26:58 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb" returned: 0 in 0.860s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:58 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Image conversion details: src /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb, size 1024.00 MB, duration 5.11 sec, destination /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-98af1d38-c460-4dce-98d2-9c6fe704a111 {{(pid=86431) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 02 03:26:58 devstack cinder-volume[86431]: INFO cinder.image.image_utils [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Converted 1024.00 MB image at 200.48 MB/s Jun 02 03:26:58 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-98af1d38-c460-4dce-98d2-9c6fe704a111 is being set with open permissions: ugo+rw Jun 02 03:26:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-98af1d38-c460-4dce-98d2-9c6fe704a111 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:58 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-98af1d38-c460-4dce-98d2-9c6fe704a111 Jun 02 03:26:58 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:58 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-98af1d38-c460-4dce-98d2-9c6fe704a111" returned: 0 in 0.574s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:58 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-quobyte-98af1d38-c460-4dce-98d2-9c6fe704a111" released by "_copy_volume_from_snapshot" :: held 8.214s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:26:58 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-quobyte-c593944b-dcac-4529-864b-83fd1713f86a-98af1d38-c460-4dce-98d2-9c6fe704a111" released by "_create_volume_from_snapshot" :: held 8.261s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:26:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.284s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:26:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.683s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:26:58 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Cloning volume d55dcc37-9b4e-4621-b961-348d0b1cc7b9 to volume d26de39c-7e2f-4c99-a7b5-8d602dc41e56 Jun 02 03:26:58 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2f8c639-8d11-4985-aa1c-84db82c9b2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98af1d38-c460-4dce-98d2-9c6fe704a111', 'volume_size': 1, 'snapshot_id': 'c593944b-dcac-4529-864b-83fd1713f86a'}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:58 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (443a573d-79a5-414c-8b32-a8de5d558a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:26:58 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Creating offline snapshot 30cbebdb-1044-495a-9516-cad6f8cf137a of volume d55dcc37-9b4e-4621-b961-348d0b1cc7b9 {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:26:58 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Volume volume-98af1d38-c460-4dce-98d2-9c6fe704a111 (98af1d38-c460-4dce-98d2-9c6fe704a111): created successfully Jun 02 03:26:58 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (443a573d-79a5-414c-8b32-a8de5d558a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:26:58 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Flow 'volume_create_manager' (ea6fe6d2-76bb-4aee-a3f4-6c34a92dfd0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:26:58 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[d440f9c8-aa60-438d-9ff5-0191a11a17c7]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:26:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:58 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-196eae78-df9f-4a69-8319-8474a450ddee tempest-VolumesSnapshotTestJSON-661765892 None] Created volume successfully. Jun 02 03:26:58 devstack sudo[97651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9 Jun 02 03:26:58 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:59 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root Jun 02 03:26:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9" returned: 0 in 0.716s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:26:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9.30cbebdb-1044-495a-9516-cad6f8cf137a 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:26:59 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9.30cbebdb-1044-495a-9516-cad6f8cf137a 1G Jun 02 03:26:59 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:26:59 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-92bd5de5-1b79-41b0-b41c-e143c43bf563 tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "cinder-98af1d38-c460-4dce-98d2-9c6fe704a111-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:26:59 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-92bd5de5-1b79-41b0-b41c-e143c43bf563 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-98af1d38-c460-4dce-98d2-9c6fe704a111-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:26:59 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-92bd5de5-1b79-41b0-b41c-e143c43bf563 tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "cinder-quobyte-98af1d38-c460-4dce-98d2-9c6fe704a111" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:26:59 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-92bd5de5-1b79-41b0-b41c-e143c43bf563 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-quobyte-98af1d38-c460-4dce-98d2-9c6fe704a111" acquired by "delete_volume" :: waited 0.015s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:26:59 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b199c1-6491-4e18-88f8-15b30d6b8c48]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:26:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-92bd5de5-1b79-41b0-b41c-e143c43bf563 tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-98af1d38-c460-4dce-98d2-9c6fe704a111 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:00 devstack sudo[97659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-98af1d38-c460-4dce-98d2-9c6fe704a111 Jun 02 03:27:00 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:00 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9.30cbebdb-1044-495a-9516-cad6f8cf137a 1G" returned: 0 in 0.757s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9.30cbebdb-1044-495a-9516-cad6f8cf137a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:00 devstack sudo[97664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9.30cbebdb-1044-495a-9516-cad6f8cf137a Jun 02 03:27:00 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:00 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-92bd5de5-1b79-41b0-b41c-e143c43bf563 tempest-VolumesSnapshotTestJSON-661765892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-98af1d38-c460-4dce-98d2-9c6fe704a111" returned: 0 in 0.706s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-92bd5de5-1b79-41b0-b41c-e143c43bf563 tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-98af1d38-c460-4dce-98d2-9c6fe704a111 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:00 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-98af1d38-c460-4dce-98d2-9c6fe704a111 Jun 02 03:27:00 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:00 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9.30cbebdb-1044-495a-9516-cad6f8cf137a" returned: 0 in 0.650s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:01 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9.30cbebdb-1044-495a-9516-cad6f8cf137a is being set with open permissions: ugo+rw Jun 02 03:27:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9.30cbebdb-1044-495a-9516-cad6f8cf137a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:01 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9.30cbebdb-1044-495a-9516-cad6f8cf137a Jun 02 03:27:01 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:01 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-92bd5de5-1b79-41b0-b41c-e143c43bf563 tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-98af1d38-c460-4dce-98d2-9c6fe704a111" returned: 0 in 0.607s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:01 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-92bd5de5-1b79-41b0-b41c-e143c43bf563 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-quobyte-98af1d38-c460-4dce-98d2-9c6fe704a111" released by "delete_volume" :: held 1.363s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:27:01 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-92bd5de5-1b79-41b0-b41c-e143c43bf563 tempest-VolumesSnapshotTestJSON-661765892 None] Created reservations ['f936b146-6e25-42a0-b921-118487c86da9', '3f78f68b-7b47-470a-94b8-f81c45486855', '3e1fd5a3-0a6b-4a0e-9200-34b4ee776e21', '15352b80-cbd1-4cf9-b0f8-9ae5f9795bcb'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:27:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-92bd5de5-1b79-41b0-b41c-e143c43bf563 tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-92bd5de5-1b79-41b0-b41c-e143c43bf563 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:01 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-92bd5de5-1b79-41b0-b41c-e143c43bf563 tempest-VolumesSnapshotTestJSON-661765892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:27:01 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-92bd5de5-1b79-41b0-b41c-e143c43bf563 tempest-VolumesSnapshotTestJSON-661765892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:27:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-92bd5de5-1b79-41b0-b41c-e143c43bf563 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-92bd5de5-1b79-41b0-b41c-e143c43bf563 tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:01 devstack sudo[97677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:27:01 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:01 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9.30cbebdb-1044-495a-9516-cad6f8cf137a" returned: 0 in 0.592s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:01 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9.info Jun 02 03:27:01 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:02 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-92bd5de5-1b79-41b0-b41c-e143c43bf563 tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.583s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:02 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-92bd5de5-1b79-41b0-b41c-e143c43bf563 tempest-VolumesSnapshotTestJSON-661765892 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:27:02 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-92bd5de5-1b79-41b0-b41c-e143c43bf563 tempest-VolumesSnapshotTestJSON-661765892 None] Deleted volume successfully. Jun 02 03:27:02 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-92bd5de5-1b79-41b0-b41c-e143c43bf563 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-98af1d38-c460-4dce-98d2-9c6fe704a111-delete_volume" released by "delete_volume" :: held 2.152s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:27:02 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-bd68282d-3964-44fa-9c9b-cfcf94c7aa22 tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "cinder-c593944b-dcac-4529-864b-83fd1713f86a-delete_snapshot" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:27:02 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-bd68282d-3964-44fa-9c9b-cfcf94c7aa22 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-c593944b-dcac-4529-864b-83fd1713f86a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:27:02 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-bd68282d-3964-44fa-9c9b-cfcf94c7aa22 tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "cinder-quobyte-cde36c0c-2d55-4cc9-b116-86b41425bdfb" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:27:02 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-bd68282d-3964-44fa-9c9b-cfcf94c7aa22 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-quobyte-cde36c0c-2d55-4cc9-b116-86b41425bdfb" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:27:02 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-bd68282d-3964-44fa-9c9b-cfcf94c7aa22 tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "cinder-quobyte-c593944b-dcac-4529-864b-83fd1713f86a" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:27:02 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-bd68282d-3964-44fa-9c9b-cfcf94c7aa22 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-quobyte-c593944b-dcac-4529-864b-83fd1713f86a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:27:02 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-bd68282d-3964-44fa-9c9b-cfcf94c7aa22 tempest-VolumesSnapshotTestJSON-661765892 None] Deleting offline snapshot c593944b-dcac-4529-864b-83fd1713f86a of volume cde36c0c-2d55-4cc9-b116-86b41425bdfb {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:27:02 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:02 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-bd68282d-3964-44fa-9c9b-cfcf94c7aa22 tempest-VolumesSnapshotTestJSON-661765892 None] snapshot_file for this snap is: volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb.c593944b-dcac-4529-864b-83fd1713f86a {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:27:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9.info" returned: 0 in 0.652s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:02 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9.info is being set with open permissions: ugo+rw Jun 02 03:27:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:02 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[502362f6-4f18-495b-85c3-be2c419e0b60]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:27:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bd68282d-3964-44fa-9c9b-cfcf94c7aa22 tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb.c593944b-dcac-4529-864b-83fd1713f86a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:02 devstack sudo[97684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9.info Jun 02 03:27:02 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:02 devstack sudo[97685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb.c593944b-dcac-4529-864b-83fd1713f86a Jun 02 03:27:02 devstack sudo[97685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:02 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9.info" returned: 0 in 0.598s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:02 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Acquiring lock "cinder-quobyte-d26de39c-7e2f-4c99-a7b5-8d602dc41e56" by "_copy_volume_from_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:27:02 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Lock "cinder-quobyte-d26de39c-7e2f-4c99-a7b5-8d602dc41e56" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:27:02 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] snapshot: 30cbebdb-1044-495a-9516-cad6f8cf137a, volume: d26de39c-7e2f-4c99-a7b5-8d602dc41e56, {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 03:27:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:02 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:27:02 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:27:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:02 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b23613-9a9c-4fd8-85b3-b084db310f7f]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:27:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9.30cbebdb-1044-495a-9516-cad6f8cf137a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:02 devstack sudo[97685]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bd68282d-3964-44fa-9c9b-cfcf94c7aa22 tempest-VolumesSnapshotTestJSON-661765892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb.c593944b-dcac-4529-864b-83fd1713f86a" returned: 0 in 0.715s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:02 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-bd68282d-3964-44fa-9c9b-cfcf94c7aa22 tempest-VolumesSnapshotTestJSON-661765892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:27:03 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6b07af-07a9-4e75-b593-4c0103c6f411]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:27:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bd68282d-3964-44fa-9c9b-cfcf94c7aa22 tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:03 devstack sudo[97693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9.30cbebdb-1044-495a-9516-cad6f8cf137a Jun 02 03:27:03 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:03 devstack sudo[97694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb Jun 02 03:27:03 devstack sudo[97694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:03 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9.30cbebdb-1044-495a-9516-cad6f8cf137a" returned: 0 in 0.699s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:03 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:27:03 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9 {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 03:27:03 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Creating direct copy from snapshot {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 03:27:03 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[507b67dd-9df5-420a-af19-8344e00ab11b]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:27:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:03 devstack sudo[97694]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bd68282d-3964-44fa-9c9b-cfcf94c7aa22 tempest-VolumesSnapshotTestJSON-661765892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb" returned: 0 in 0.719s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bd68282d-3964-44fa-9c9b-cfcf94c7aa22 tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb.c593944b-dcac-4529-864b-83fd1713f86a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:03 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9 Jun 02 03:27:03 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:03 devstack sudo[97704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb.c593944b-dcac-4529-864b-83fd1713f86a Jun 02 03:27:03 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:04 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9" returned: 0 in 0.765s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:04 devstack cinder-volume[86431]: DEBUG cinder.utils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Path /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d26de39c-7e2f-4c99-a7b5-8d602dc41e56 not found in is_blk_device check {{(pid=86431) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 02 03:27:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d26de39c-7e2f-4c99-a7b5-8d602dc41e56 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:04 devstack sudo[97713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d26de39c-7e2f-4c99-a7b5-8d602dc41e56 Jun 02 03:27:04 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:04 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bd68282d-3964-44fa-9c9b-cfcf94c7aa22 tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb.c593944b-dcac-4529-864b-83fd1713f86a" returned: 0 in 0.730s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bd68282d-3964-44fa-9c9b-cfcf94c7aa22 tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb.c593944b-dcac-4529-864b-83fd1713f86a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:04 devstack sudo[97715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb.c593944b-dcac-4529-864b-83fd1713f86a Jun 02 03:27:04 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:05 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bd68282d-3964-44fa-9c9b-cfcf94c7aa22 tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb.c593944b-dcac-4529-864b-83fd1713f86a" returned: 0 in 0.597s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:05 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-bd68282d-3964-44fa-9c9b-cfcf94c7aa22 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-quobyte-c593944b-dcac-4529-864b-83fd1713f86a" released by "_delete_snapshot" :: held 2.869s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:27:05 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-bd68282d-3964-44fa-9c9b-cfcf94c7aa22 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-quobyte-cde36c0c-2d55-4cc9-b116-86b41425bdfb" released by "delete_snapshot" :: held 2.890s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:27:05 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-bd68282d-3964-44fa-9c9b-cfcf94c7aa22 tempest-VolumesSnapshotTestJSON-661765892 None] Created reservations ['cc51ba3e-4e10-4deb-8d8c-905d609554da', 'd4550541-e8bc-418b-a15b-e15b5c30415f', 'eb2b647d-1a31-4d24-b495-aff1c732735e', '47a98177-9809-4fb1-84a1-ee08f8404f21'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:27:05 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-bd68282d-3964-44fa-9c9b-cfcf94c7aa22 tempest-VolumesSnapshotTestJSON-661765892 None] Delete snapshot completed successfully. Jun 02 03:27:05 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-bd68282d-3964-44fa-9c9b-cfcf94c7aa22 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-c593944b-dcac-4529-864b-83fd1713f86a-delete_snapshot" released by "delete_snapshot" :: held 3.111s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:27:05 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0fbc1ce5-b044-489e-bb5b-a6aed278db10 tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "cinder-cde36c0c-2d55-4cc9-b116-86b41425bdfb-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:27:05 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0fbc1ce5-b044-489e-bb5b-a6aed278db10 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-cde36c0c-2d55-4cc9-b116-86b41425bdfb-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:27:05 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0fbc1ce5-b044-489e-bb5b-a6aed278db10 tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "cinder-quobyte-cde36c0c-2d55-4cc9-b116-86b41425bdfb" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:27:05 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0fbc1ce5-b044-489e-bb5b-a6aed278db10 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-quobyte-cde36c0c-2d55-4cc9-b116-86b41425bdfb" acquired by "delete_volume" :: waited 0.044s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:27:05 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[3742136c-471b-48b7-aff4-f37ff8ff65e8]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:27:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0fbc1ce5-b044-489e-bb5b-a6aed278db10 tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:06 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb Jun 02 03:27:06 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:07 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0fbc1ce5-b044-489e-bb5b-a6aed278db10 tempest-VolumesSnapshotTestJSON-661765892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb" returned: 0 in 1.850s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0fbc1ce5-b044-489e-bb5b-a6aed278db10 tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:07 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb Jun 02 03:27:07 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:09 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0fbc1ce5-b044-489e-bb5b-a6aed278db10 tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-cde36c0c-2d55-4cc9-b116-86b41425bdfb" returned: 0 in 1.303s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:09 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0fbc1ce5-b044-489e-bb5b-a6aed278db10 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-quobyte-cde36c0c-2d55-4cc9-b116-86b41425bdfb" released by "delete_volume" :: held 3.308s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:27:09 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-0fbc1ce5-b044-489e-bb5b-a6aed278db10 tempest-VolumesSnapshotTestJSON-661765892 None] Created reservations ['23bb491f-3358-4847-9097-bdf8a790500c', '65a74899-85d8-43cb-ac39-9086e09a4f7f', '91d3434c-1898-44f3-9b2d-0c50500150fb', '9d32372e-14e1-45ba-8adf-58c4ea3a6b17'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:27:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0fbc1ce5-b044-489e-bb5b-a6aed278db10 tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0fbc1ce5-b044-489e-bb5b-a6aed278db10 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0fbc1ce5-b044-489e-bb5b-a6aed278db10 tempest-VolumesSnapshotTestJSON-661765892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:27:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0fbc1ce5-b044-489e-bb5b-a6aed278db10 tempest-VolumesSnapshotTestJSON-661765892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:27:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0fbc1ce5-b044-489e-bb5b-a6aed278db10 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0fbc1ce5-b044-489e-bb5b-a6aed278db10 tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:09 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:27:09 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:09 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:27:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:27:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:27:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:09 devstack sudo[97740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:27:09 devstack sudo[97740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:09 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d26de39c-7e2f-4c99-a7b5-8d602dc41e56" returned: 0 in 5.526s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:09 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[4981283a-e5a9-4d28-a54e-96555b59847b]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:27:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:10 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9 Jun 02 03:27:10 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:10 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0fbc1ce5-b044-489e-bb5b-a6aed278db10 tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.857s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:10 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-0fbc1ce5-b044-489e-bb5b-a6aed278db10 tempest-VolumesSnapshotTestJSON-661765892 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:27:10 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-0fbc1ce5-b044-489e-bb5b-a6aed278db10 tempest-VolumesSnapshotTestJSON-661765892 None] Deleted volume successfully. Jun 02 03:27:10 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0fbc1ce5-b044-489e-bb5b-a6aed278db10 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-cde36c0c-2d55-4cc9-b116-86b41425bdfb-delete_volume" released by "delete_volume" :: held 4.622s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:27:10 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0c40d887-1e97-4d54-88cf-29b3ab0e5097 tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "cinder-6da2e2a9-b21e-44e8-9e5d-6c39db872853-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:27:10 devstack sudo[97740]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.778s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:10 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:27:10 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0c40d887-1e97-4d54-88cf-29b3ab0e5097 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-6da2e2a9-b21e-44e8-9e5d-6c39db872853-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:27:10 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager._thread_info {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:27:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread count: 28 {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 02 03:27:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread info: [<_MainThread(MainThread, started 138618128814208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 02 03:27:10 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0c40d887-1e97-4d54-88cf-29b3ab0e5097 tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "cinder-quobyte-6da2e2a9-b21e-44e8-9e5d-6c39db872853" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:27:10 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0c40d887-1e97-4d54-88cf-29b3ab0e5097 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-quobyte-6da2e2a9-b21e-44e8-9e5d-6c39db872853" acquired by "delete_volume" :: waited 0.020s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:27:10 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eff03f3-d993-4e08-8b62-33ef549c2a37]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:27:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0c40d887-1e97-4d54-88cf-29b3ab0e5097 tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:10 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853 Jun 02 03:27:10 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:10 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9" returned: 0 in 0.916s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:10 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Image conversion details: src /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9, size 1024.00 MB, duration 5.53 sec, destination /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d26de39c-7e2f-4c99-a7b5-8d602dc41e56 {{(pid=86431) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 02 03:27:10 devstack cinder-volume[86431]: INFO cinder.image.image_utils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Converted 1024.00 MB image at 185.25 MB/s Jun 02 03:27:10 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d26de39c-7e2f-4c99-a7b5-8d602dc41e56 is being set with open permissions: ugo+rw Jun 02 03:27:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d26de39c-7e2f-4c99-a7b5-8d602dc41e56 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:10 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d26de39c-7e2f-4c99-a7b5-8d602dc41e56 Jun 02 03:27:10 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:11 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0c40d887-1e97-4d54-88cf-29b3ab0e5097 tempest-VolumesSnapshotTestJSON-661765892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853" returned: 0 in 0.713s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0c40d887-1e97-4d54-88cf-29b3ab0e5097 tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:11 devstack sudo[97756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853 Jun 02 03:27:11 devstack sudo[97756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:11 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d26de39c-7e2f-4c99-a7b5-8d602dc41e56" returned: 0 in 0.565s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:11 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Lock "cinder-quobyte-d26de39c-7e2f-4c99-a7b5-8d602dc41e56" released by "_copy_volume_from_snapshot" :: held 8.566s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:27:11 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Acquiring lock "cinder-quobyte-30cbebdb-1044-495a-9516-cad6f8cf137a" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:27:11 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Lock "cinder-quobyte-30cbebdb-1044-495a-9516-cad6f8cf137a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:27:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Deleting offline snapshot 30cbebdb-1044-495a-9516-cad6f8cf137a of volume d55dcc37-9b4e-4621-b961-348d0b1cc7b9 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:27:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] snapshot_file for this snap is: volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9.30cbebdb-1044-495a-9516-cad6f8cf137a {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:27:11 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e166d0c-2f5c-4b34-b74e-b940a06731dd]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:27:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9.30cbebdb-1044-495a-9516-cad6f8cf137a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:11 devstack sudo[97759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9.30cbebdb-1044-495a-9516-cad6f8cf137a Jun 02 03:27:11 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:11 devstack sudo[97756]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0c40d887-1e97-4d54-88cf-29b3ab0e5097 tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6da2e2a9-b21e-44e8-9e5d-6c39db872853" returned: 0 in 0.612s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:11 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0c40d887-1e97-4d54-88cf-29b3ab0e5097 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-quobyte-6da2e2a9-b21e-44e8-9e5d-6c39db872853" released by "delete_volume" :: held 1.385s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:27:11 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-0c40d887-1e97-4d54-88cf-29b3ab0e5097 tempest-VolumesSnapshotTestJSON-661765892 None] Created reservations ['0db40c6e-3bb8-464f-a632-9c071347f2ea', 'e9b0c1ac-82ce-4290-a743-8fd0fdebbd9f', '266e0a43-bae9-450c-8ca1-24f419b11deb', '1a832e54-a4f6-4a58-a48a-e3da1be1e50e'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:27:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0c40d887-1e97-4d54-88cf-29b3ab0e5097 tempest-VolumesSnapshotTestJSON-661765892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0c40d887-1e97-4d54-88cf-29b3ab0e5097 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0c40d887-1e97-4d54-88cf-29b3ab0e5097 tempest-VolumesSnapshotTestJSON-661765892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:27:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0c40d887-1e97-4d54-88cf-29b3ab0e5097 tempest-VolumesSnapshotTestJSON-661765892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:27:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0c40d887-1e97-4d54-88cf-29b3ab0e5097 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0c40d887-1e97-4d54-88cf-29b3ab0e5097 tempest-VolumesSnapshotTestJSON-661765892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:11 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:27:11 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:12 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9.30cbebdb-1044-495a-9516-cad6f8cf137a" returned: 0 in 0.729s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:12 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:27:12 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb8163a-52d2-4db9-bac0-e726f92914b6]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:27:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:12 devstack sudo[97767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9 Jun 02 03:27:12 devstack sudo[97767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:12 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0c40d887-1e97-4d54-88cf-29b3ab0e5097 tempest-VolumesSnapshotTestJSON-661765892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.574s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:12 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-0c40d887-1e97-4d54-88cf-29b3ab0e5097 tempest-VolumesSnapshotTestJSON-661765892 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:27:12 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-0c40d887-1e97-4d54-88cf-29b3ab0e5097 tempest-VolumesSnapshotTestJSON-661765892 None] Deleted volume successfully. Jun 02 03:27:12 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0c40d887-1e97-4d54-88cf-29b3ab0e5097 tempest-VolumesSnapshotTestJSON-661765892 None] Lock "cinder-6da2e2a9-b21e-44e8-9e5d-6c39db872853-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:27:12 devstack sudo[97767]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9" returned: 0 in 0.707s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9.30cbebdb-1044-495a-9516-cad6f8cf137a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:13 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9.30cbebdb-1044-495a-9516-cad6f8cf137a Jun 02 03:27:13 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:13 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9.30cbebdb-1044-495a-9516-cad6f8cf137a" returned: 0 in 0.696s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9.30cbebdb-1044-495a-9516-cad6f8cf137a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:13 devstack sudo[97779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9.30cbebdb-1044-495a-9516-cad6f8cf137a Jun 02 03:27:13 devstack sudo[97779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:14 devstack sudo[97779]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9.30cbebdb-1044-495a-9516-cad6f8cf137a" returned: 0 in 0.616s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:14 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Lock "cinder-quobyte-30cbebdb-1044-495a-9516-cad6f8cf137a" released by "_delete_snapshot" :: held 2.832s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:27:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.588s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-60c6fd78-95e9-4108-ba72-f5d2a34f9f99 tempest-VolumesDeleteCascade-451749405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 22.732s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:14 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dae3057a-1d36-43c8-bf81-0a219fa71ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d26de39c-7e2f-4c99-a7b5-8d602dc41e56', 'volume_size': 1, 'source_volid': 'd55dcc37-9b4e-4621-b961-348d0b1cc7b9', 'source_volstatus': 'available'}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:14 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c057dd9b-dbb2-41d8-8249-598bec7b70ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:14 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-60c6fd78-95e9-4108-ba72-f5d2a34f9f99 tempest-VolumesDeleteCascade-451749405 None] Creating offline snapshot 073c6eca-a9f7-4cdb-9fba-34ba4fae6f68 of volume a71e977c-ba4b-4011-99ea-7da7688fdac0 {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:27:14 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Volume volume-d26de39c-7e2f-4c99-a7b5-8d602dc41e56 (d26de39c-7e2f-4c99-a7b5-8d602dc41e56): created successfully Jun 02 03:27:14 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c057dd9b-dbb2-41d8-8249-598bec7b70ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:14 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Flow 'volume_create_manager' (aedb4b90-bf1d-44a5-9c14-6ff80c1c6fc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:27:14 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2383d1-0978-4dfe-9f82-157fa92dbd48]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:27:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-60c6fd78-95e9-4108-ba72-f5d2a34f9f99 tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:14 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-b98c6b8f-0cb1-4098-a080-198953e11ea0 tempest-VolumesGetTest-41238149 None] Created volume successfully. Jun 02 03:27:14 devstack sudo[97783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0 Jun 02 03:27:14 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:15 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-60c6fd78-95e9-4108-ba72-f5d2a34f9f99 tempest-VolumesDeleteCascade-451749405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0" returned: 0 in 0.823s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-60c6fd78-95e9-4108-ba72-f5d2a34f9f99 tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.073c6eca-a9f7-4cdb-9fba-34ba4fae6f68 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:15 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.073c6eca-a9f7-4cdb-9fba-34ba4fae6f68 1G Jun 02 03:27:15 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:16 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c331d2f-166f-4859-b497-a6cb0b97c1e7 tempest-VolumesGetTest-41238149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:27:16 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7c331d2f-166f-4859-b497-a6cb0b97c1e7 tempest-VolumesGetTest-41238149 None] Flow 'volume_create_manager' (174d221b-ba80-4355-8ac1-bc344988193c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:27:16 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7c331d2f-166f-4859-b497-a6cb0b97c1e7 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee11ba1-4edf-40ec-9ab6-a79e088a63e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:16 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7c331d2f-166f-4859-b497-a6cb0b97c1e7 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee11ba1-4edf-40ec-9ab6-a79e088a63e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:27:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1658257748',display_name='tempest-VolumesGetTest-Volume-1936581041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8949a5a-0c4c-4cd5-9de9-2fa5c8651c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ecbcb594f540ed9eb6bbd6f6eda02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:27:16Z,use_quota=True,user_id='3b07719d39b2468bb6daaeeeb8feb831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:16 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7c331d2f-166f-4859-b497-a6cb0b97c1e7 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9b71075-34c3-4181-8cc2-b337d2b79d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:16 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7c331d2f-166f-4859-b497-a6cb0b97c1e7 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9b71075-34c3-4181-8cc2-b337d2b79d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:16 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7c331d2f-166f-4859-b497-a6cb0b97c1e7 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b8f94dd-17ab-46c7-834e-580fa122260e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:16 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7c331d2f-166f-4859-b497-a6cb0b97c1e7 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b8f94dd-17ab-46c7-834e-580fa122260e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8949a5a-0c4c-4cd5-9de9-2fa5c8651c47', 'volume_name': 'volume-a8949a5a-0c4c-4cd5-9de9-2fa5c8651c47', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:16 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7c331d2f-166f-4859-b497-a6cb0b97c1e7 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aedbb4de-13b1-493b-8912-3f65a00ce232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:16 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7c331d2f-166f-4859-b497-a6cb0b97c1e7 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aedbb4de-13b1-493b-8912-3f65a00ce232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:16 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7c331d2f-166f-4859-b497-a6cb0b97c1e7 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096d934b-2288-4821-9859-636389ee1b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:16 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-7c331d2f-166f-4859-b497-a6cb0b97c1e7 tempest-VolumesGetTest-41238149 None] Volume a8949a5a-0c4c-4cd5-9de9-2fa5c8651c47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8949a5a-0c4c-4cd5-9de9-2fa5c8651c47', 'volume_size': 1} Jun 02 03:27:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7c331d2f-166f-4859-b497-a6cb0b97c1e7 tempest-VolumesGetTest-41238149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:16 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-60c6fd78-95e9-4108-ba72-f5d2a34f9f99 tempest-VolumesDeleteCascade-451749405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.073c6eca-a9f7-4cdb-9fba-34ba4fae6f68 1G" returned: 0 in 0.952s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-60c6fd78-95e9-4108-ba72-f5d2a34f9f99 tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a71e977c-ba4b-4011-99ea-7da7688fdac0 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.073c6eca-a9f7-4cdb-9fba-34ba4fae6f68 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:16 devstack sudo[97795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a71e977c-ba4b-4011-99ea-7da7688fdac0 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.073c6eca-a9f7-4cdb-9fba-34ba4fae6f68 Jun 02 03:27:16 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:16 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-60c6fd78-95e9-4108-ba72-f5d2a34f9f99 tempest-VolumesDeleteCascade-451749405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a71e977c-ba4b-4011-99ea-7da7688fdac0 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.073c6eca-a9f7-4cdb-9fba-34ba4fae6f68" returned: 0 in 0.671s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:16 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-60c6fd78-95e9-4108-ba72-f5d2a34f9f99 tempest-VolumesDeleteCascade-451749405 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.073c6eca-a9f7-4cdb-9fba-34ba4fae6f68 is being set with open permissions: ugo+rw Jun 02 03:27:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-60c6fd78-95e9-4108-ba72-f5d2a34f9f99 tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.073c6eca-a9f7-4cdb-9fba-34ba4fae6f68 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:16 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.073c6eca-a9f7-4cdb-9fba-34ba4fae6f68 Jun 02 03:27:16 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:17 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-60c6fd78-95e9-4108-ba72-f5d2a34f9f99 tempest-VolumesDeleteCascade-451749405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.073c6eca-a9f7-4cdb-9fba-34ba4fae6f68" returned: 0 in 0.601s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-60c6fd78-95e9-4108-ba72-f5d2a34f9f99 tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:17 devstack sudo[97803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.info Jun 02 03:27:17 devstack sudo[97803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:18 devstack sudo[97803]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-60c6fd78-95e9-4108-ba72-f5d2a34f9f99 tempest-VolumesDeleteCascade-451749405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.info" returned: 0 in 0.608s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:18 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-60c6fd78-95e9-4108-ba72-f5d2a34f9f99 tempest-VolumesDeleteCascade-451749405 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.info is being set with open permissions: ugo+rw Jun 02 03:27:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-60c6fd78-95e9-4108-ba72-f5d2a34f9f99 tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:18 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.info Jun 02 03:27:18 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:18 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-60c6fd78-95e9-4108-ba72-f5d2a34f9f99 tempest-VolumesDeleteCascade-451749405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.info" returned: 0 in 0.615s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-60c6fd78-95e9-4108-ba72-f5d2a34f9f99 tempest-VolumesDeleteCascade-451749405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.388s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-71e34e3c-94d4-4456-9fc0-125d474fd426 tempest-VolumesServicesTestJSON-1020493186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.016s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:18 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-71e34e3c-94d4-4456-9fc0-125d474fd426 tempest-VolumesServicesTestJSON-1020493186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-18768910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a263146-2e32-4e14-bd86-49e5eb99becb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75bc466524ae4ad5a14d1784809ac2d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:26:58Z,use_quota=True,user_id='169f2096a9e94152b6a2476a0dce9002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:27:18 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-71e34e3c-94d4-4456-9fc0-125d474fd426 tempest-VolumesServicesTestJSON-1020493186 None] Creating volume 5a263146-2e32-4e14-bd86-49e5eb99becb {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:27:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-71e34e3c-94d4-4456-9fc0-125d474fd426 tempest-VolumesServicesTestJSON-1020493186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-71e34e3c-94d4-4456-9fc0-125d474fd426 tempest-VolumesServicesTestJSON-1020493186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:18 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-71e34e3c-94d4-4456-9fc0-125d474fd426 tempest-VolumesServicesTestJSON-1020493186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:27:18 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-71e34e3c-94d4-4456-9fc0-125d474fd426 tempest-VolumesServicesTestJSON-1020493186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:27:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-71e34e3c-94d4-4456-9fc0-125d474fd426 tempest-VolumesServicesTestJSON-1020493186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:18 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-71e34e3c-94d4-4456-9fc0-125d474fd426 tempest-VolumesServicesTestJSON-1020493186 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:27:18 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-71e34e3c-94d4-4456-9fc0-125d474fd426 tempest-VolumesServicesTestJSON-1020493186 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:27:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-71e34e3c-94d4-4456-9fc0-125d474fd426 tempest-VolumesServicesTestJSON-1020493186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5a263146-2e32-4e14-bd86-49e5eb99becb 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:18 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5a263146-2e32-4e14-bd86-49e5eb99becb 1073741824 Jun 02 03:27:18 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:18 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-60c6fd78-95e9-4108-ba72-f5d2a34f9f99 tempest-VolumesDeleteCascade-451749405 None] Create snapshot completed successfully Jun 02 03:27:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-63389f66-a6ea-4700-9700-d2e6922c45ff tempest-VolumesDeleteCascade-451749405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:19 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-71e34e3c-94d4-4456-9fc0-125d474fd426 tempest-VolumesServicesTestJSON-1020493186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5a263146-2e32-4e14-bd86-49e5eb99becb 1073741824" returned: 0 in 0.854s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-71e34e3c-94d4-4456-9fc0-125d474fd426 tempest-VolumesServicesTestJSON-1020493186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5a263146-2e32-4e14-bd86-49e5eb99becb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:19 devstack sudo[97815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5a263146-2e32-4e14-bd86-49e5eb99becb Jun 02 03:27:19 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:20 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-71e34e3c-94d4-4456-9fc0-125d474fd426 tempest-VolumesServicesTestJSON-1020493186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5a263146-2e32-4e14-bd86-49e5eb99becb" returned: 0 in 0.607s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-71e34e3c-94d4-4456-9fc0-125d474fd426 tempest-VolumesServicesTestJSON-1020493186 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:27:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-71e34e3c-94d4-4456-9fc0-125d474fd426 tempest-VolumesServicesTestJSON-1020493186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7c331d2f-166f-4859-b497-a6cb0b97c1e7 tempest-VolumesGetTest-41238149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.178s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-7c331d2f-166f-4859-b497-a6cb0b97c1e7 tempest-VolumesGetTest-41238149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:27:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1658257748',display_name='tempest-VolumesGetTest-Volume-1936581041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8949a5a-0c4c-4cd5-9de9-2fa5c8651c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ecbcb594f540ed9eb6bbd6f6eda02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:27:16Z,use_quota=True,user_id='3b07719d39b2468bb6daaeeeb8feb831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:27:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-7c331d2f-166f-4859-b497-a6cb0b97c1e7 tempest-VolumesGetTest-41238149 None] Creating volume a8949a5a-0c4c-4cd5-9de9-2fa5c8651c47 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:27:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7c331d2f-166f-4859-b497-a6cb0b97c1e7 tempest-VolumesGetTest-41238149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7c331d2f-166f-4859-b497-a6cb0b97c1e7 tempest-VolumesGetTest-41238149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-7c331d2f-166f-4859-b497-a6cb0b97c1e7 tempest-VolumesGetTest-41238149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:27:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-7c331d2f-166f-4859-b497-a6cb0b97c1e7 tempest-VolumesGetTest-41238149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:27:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7c331d2f-166f-4859-b497-a6cb0b97c1e7 tempest-VolumesGetTest-41238149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-7c331d2f-166f-4859-b497-a6cb0b97c1e7 tempest-VolumesGetTest-41238149 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:27:20 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-7c331d2f-166f-4859-b497-a6cb0b97c1e7 tempest-VolumesGetTest-41238149 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:27:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7c331d2f-166f-4859-b497-a6cb0b97c1e7 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a8949a5a-0c4c-4cd5-9de9-2fa5c8651c47 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-71e34e3c-94d4-4456-9fc0-125d474fd426 tempest-VolumesServicesTestJSON-1020493186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25e04502-a568-4cb7-9cb8-30ef59eaebf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a263146-2e32-4e14-bd86-49e5eb99becb', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:20 devstack sudo[97818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a8949a5a-0c4c-4cd5-9de9-2fa5c8651c47 1073741824 Jun 02 03:27:20 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-71e34e3c-94d4-4456-9fc0-125d474fd426 tempest-VolumesServicesTestJSON-1020493186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37546b2c-d8cc-4d13-bb2d-ddd519b56ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:20 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-71e34e3c-94d4-4456-9fc0-125d474fd426 tempest-VolumesServicesTestJSON-1020493186 None] Volume volume-5a263146-2e32-4e14-bd86-49e5eb99becb (5a263146-2e32-4e14-bd86-49e5eb99becb): created successfully Jun 02 03:27:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-71e34e3c-94d4-4456-9fc0-125d474fd426 tempest-VolumesServicesTestJSON-1020493186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37546b2c-d8cc-4d13-bb2d-ddd519b56ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-71e34e3c-94d4-4456-9fc0-125d474fd426 tempest-VolumesServicesTestJSON-1020493186 None] Flow 'volume_create_manager' (5b1a3e81-727c-4579-b6ac-151457ad765c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:27:20 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-71e34e3c-94d4-4456-9fc0-125d474fd426 tempest-VolumesServicesTestJSON-1020493186 None] Created volume successfully. Jun 02 03:27:21 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7c331d2f-166f-4859-b497-a6cb0b97c1e7 tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a8949a5a-0c4c-4cd5-9de9-2fa5c8651c47 1073741824" returned: 0 in 0.851s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7c331d2f-166f-4859-b497-a6cb0b97c1e7 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a8949a5a-0c4c-4cd5-9de9-2fa5c8651c47 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:21 devstack sudo[97859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a8949a5a-0c4c-4cd5-9de9-2fa5c8651c47 Jun 02 03:27:21 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:21 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ecd52fa3-a763-4294-bc16-cbf890115d05 tempest-VolumesServicesTestJSON-1020493186 None] Acquiring lock "cinder-5a263146-2e32-4e14-bd86-49e5eb99becb-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:27:21 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ecd52fa3-a763-4294-bc16-cbf890115d05 tempest-VolumesServicesTestJSON-1020493186 None] Lock "cinder-5a263146-2e32-4e14-bd86-49e5eb99becb-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:27:21 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ecd52fa3-a763-4294-bc16-cbf890115d05 tempest-VolumesServicesTestJSON-1020493186 None] Acquiring lock "cinder-quobyte-5a263146-2e32-4e14-bd86-49e5eb99becb" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:27:21 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ecd52fa3-a763-4294-bc16-cbf890115d05 tempest-VolumesServicesTestJSON-1020493186 None] Lock "cinder-quobyte-5a263146-2e32-4e14-bd86-49e5eb99becb" acquired by "delete_volume" :: waited 0.017s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:27:21 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfef8bb-a92e-42ad-bcf5-eec8a566d8cf]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:27:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ecd52fa3-a763-4294-bc16-cbf890115d05 tempest-VolumesServicesTestJSON-1020493186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5a263146-2e32-4e14-bd86-49e5eb99becb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:21 devstack sudo[97863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5a263146-2e32-4e14-bd86-49e5eb99becb Jun 02 03:27:21 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:21 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7c331d2f-166f-4859-b497-a6cb0b97c1e7 tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a8949a5a-0c4c-4cd5-9de9-2fa5c8651c47" returned: 0 in 0.656s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:21 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-7c331d2f-166f-4859-b497-a6cb0b97c1e7 tempest-VolumesGetTest-41238149 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:27:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7c331d2f-166f-4859-b497-a6cb0b97c1e7 tempest-VolumesGetTest-41238149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-63389f66-a6ea-4700-9700-d2e6922c45ff tempest-VolumesDeleteCascade-451749405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.702s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:21 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-63389f66-a6ea-4700-9700-d2e6922c45ff tempest-VolumesDeleteCascade-451749405 None] Creating offline snapshot 875584b0-038a-430e-bba8-6124a99c3556 of volume a71e977c-ba4b-4011-99ea-7da7688fdac0 {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:27:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7c331d2f-166f-4859-b497-a6cb0b97c1e7 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096d934b-2288-4821-9859-636389ee1b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8949a5a-0c4c-4cd5-9de9-2fa5c8651c47', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7c331d2f-166f-4859-b497-a6cb0b97c1e7 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7598d55-ff1f-4ada-acef-54d83b3b03c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:21 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ea167d-d3f6-471d-8805-1e4093c1b036]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:27:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63389f66-a6ea-4700-9700-d2e6922c45ff tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.073c6eca-a9f7-4cdb-9fba-34ba4fae6f68 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:21 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-7c331d2f-166f-4859-b497-a6cb0b97c1e7 tempest-VolumesGetTest-41238149 None] Volume volume-a8949a5a-0c4c-4cd5-9de9-2fa5c8651c47 (a8949a5a-0c4c-4cd5-9de9-2fa5c8651c47): created successfully Jun 02 03:27:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7c331d2f-166f-4859-b497-a6cb0b97c1e7 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7598d55-ff1f-4ada-acef-54d83b3b03c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7c331d2f-166f-4859-b497-a6cb0b97c1e7 tempest-VolumesGetTest-41238149 None] Flow 'volume_create_manager' (174d221b-ba80-4355-8ac1-bc344988193c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:27:21 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-7c331d2f-166f-4859-b497-a6cb0b97c1e7 tempest-VolumesGetTest-41238149 None] Created volume successfully. Jun 02 03:27:22 devstack sudo[97866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.073c6eca-a9f7-4cdb-9fba-34ba4fae6f68 Jun 02 03:27:22 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:22 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ecd52fa3-a763-4294-bc16-cbf890115d05 tempest-VolumesServicesTestJSON-1020493186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5a263146-2e32-4e14-bd86-49e5eb99becb" returned: 0 in 0.788s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ecd52fa3-a763-4294-bc16-cbf890115d05 tempest-VolumesServicesTestJSON-1020493186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5a263146-2e32-4e14-bd86-49e5eb99becb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:22 devstack sudo[97873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5a263146-2e32-4e14-bd86-49e5eb99becb Jun 02 03:27:22 devstack sudo[97873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:22 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0544fa48-77d8-4147-8400-5761ed016192 tempest-VolumesGetTest-41238149 None] Acquiring lock "cinder-a8949a5a-0c4c-4cd5-9de9-2fa5c8651c47-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:27:22 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0544fa48-77d8-4147-8400-5761ed016192 tempest-VolumesGetTest-41238149 None] Lock "cinder-a8949a5a-0c4c-4cd5-9de9-2fa5c8651c47-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:27:22 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0544fa48-77d8-4147-8400-5761ed016192 tempest-VolumesGetTest-41238149 None] Acquiring lock "cinder-quobyte-a8949a5a-0c4c-4cd5-9de9-2fa5c8651c47" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:27:22 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0544fa48-77d8-4147-8400-5761ed016192 tempest-VolumesGetTest-41238149 None] Lock "cinder-quobyte-a8949a5a-0c4c-4cd5-9de9-2fa5c8651c47" acquired by "delete_volume" :: waited 0.027s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:27:22 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63389f66-a6ea-4700-9700-d2e6922c45ff tempest-VolumesDeleteCascade-451749405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.073c6eca-a9f7-4cdb-9fba-34ba4fae6f68" returned: 0 in 0.827s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:22 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-63389f66-a6ea-4700-9700-d2e6922c45ff tempest-VolumesDeleteCascade-451749405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a71e977c-ba4b-4011-99ea-7da7688fdac0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:27:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63389f66-a6ea-4700-9700-d2e6922c45ff tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.073c6eca-a9f7-4cdb-9fba-34ba4fae6f68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.875584b0-038a-430e-bba8-6124a99c3556 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:22 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d54dfb-e911-45de-9de8-b7384a388f61]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:27:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0544fa48-77d8-4147-8400-5761ed016192 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a8949a5a-0c4c-4cd5-9de9-2fa5c8651c47 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:22 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.073c6eca-a9f7-4cdb-9fba-34ba4fae6f68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.875584b0-038a-430e-bba8-6124a99c3556 1G Jun 02 03:27:22 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:22 devstack sudo[97879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a8949a5a-0c4c-4cd5-9de9-2fa5c8651c47 Jun 02 03:27:22 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:23 devstack sudo[97873]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ecd52fa3-a763-4294-bc16-cbf890115d05 tempest-VolumesServicesTestJSON-1020493186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5a263146-2e32-4e14-bd86-49e5eb99becb" returned: 0 in 0.868s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:23 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ecd52fa3-a763-4294-bc16-cbf890115d05 tempest-VolumesServicesTestJSON-1020493186 None] Lock "cinder-quobyte-5a263146-2e32-4e14-bd86-49e5eb99becb" released by "delete_volume" :: held 1.717s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:27:23 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-ecd52fa3-a763-4294-bc16-cbf890115d05 tempest-VolumesServicesTestJSON-1020493186 None] Created reservations ['d10eac6a-125b-48bd-be3e-c61239a52cfb', '2c8a456c-c4f1-41ef-ad0d-d5e492effa88', '2891e859-b371-4092-a32a-982af49f5d3b', '5c270d2e-d10f-49e5-a5fe-115326e28516'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:27:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ecd52fa3-a763-4294-bc16-cbf890115d05 tempest-VolumesServicesTestJSON-1020493186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ecd52fa3-a763-4294-bc16-cbf890115d05 tempest-VolumesServicesTestJSON-1020493186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:23 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ecd52fa3-a763-4294-bc16-cbf890115d05 tempest-VolumesServicesTestJSON-1020493186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:27:23 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ecd52fa3-a763-4294-bc16-cbf890115d05 tempest-VolumesServicesTestJSON-1020493186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:27:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ecd52fa3-a763-4294-bc16-cbf890115d05 tempest-VolumesServicesTestJSON-1020493186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ecd52fa3-a763-4294-bc16-cbf890115d05 tempest-VolumesServicesTestJSON-1020493186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:23 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:27:23 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:23 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0544fa48-77d8-4147-8400-5761ed016192 tempest-VolumesGetTest-41238149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a8949a5a-0c4c-4cd5-9de9-2fa5c8651c47" returned: 0 in 1.095s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0544fa48-77d8-4147-8400-5761ed016192 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a8949a5a-0c4c-4cd5-9de9-2fa5c8651c47 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:23 devstack sudo[97892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a8949a5a-0c4c-4cd5-9de9-2fa5c8651c47 Jun 02 03:27:23 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:23 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63389f66-a6ea-4700-9700-d2e6922c45ff tempest-VolumesDeleteCascade-451749405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.073c6eca-a9f7-4cdb-9fba-34ba4fae6f68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.875584b0-038a-430e-bba8-6124a99c3556 1G" returned: 0 in 1.219s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63389f66-a6ea-4700-9700-d2e6922c45ff tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.073c6eca-a9f7-4cdb-9fba-34ba4fae6f68 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.875584b0-038a-430e-bba8-6124a99c3556 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:24 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.073c6eca-a9f7-4cdb-9fba-34ba4fae6f68 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.875584b0-038a-430e-bba8-6124a99c3556 Jun 02 03:27:24 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:24 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ecd52fa3-a763-4294-bc16-cbf890115d05 tempest-VolumesServicesTestJSON-1020493186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 1.203s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:24 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-ecd52fa3-a763-4294-bc16-cbf890115d05 tempest-VolumesServicesTestJSON-1020493186 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:27:24 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-ecd52fa3-a763-4294-bc16-cbf890115d05 tempest-VolumesServicesTestJSON-1020493186 None] Deleted volume successfully. Jun 02 03:27:24 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ecd52fa3-a763-4294-bc16-cbf890115d05 tempest-VolumesServicesTestJSON-1020493186 None] Lock "cinder-5a263146-2e32-4e14-bd86-49e5eb99becb-delete_volume" released by "delete_volume" :: held 3.234s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:27:25 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0544fa48-77d8-4147-8400-5761ed016192 tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a8949a5a-0c4c-4cd5-9de9-2fa5c8651c47" returned: 0 in 1.252s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:25 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63389f66-a6ea-4700-9700-d2e6922c45ff tempest-VolumesDeleteCascade-451749405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.073c6eca-a9f7-4cdb-9fba-34ba4fae6f68 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.875584b0-038a-430e-bba8-6124a99c3556" returned: 0 in 1.164s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:25 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-63389f66-a6ea-4700-9700-d2e6922c45ff tempest-VolumesDeleteCascade-451749405 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.875584b0-038a-430e-bba8-6124a99c3556 is being set with open permissions: ugo+rw Jun 02 03:27:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63389f66-a6ea-4700-9700-d2e6922c45ff tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.875584b0-038a-430e-bba8-6124a99c3556 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:25 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0544fa48-77d8-4147-8400-5761ed016192 tempest-VolumesGetTest-41238149 None] Lock "cinder-quobyte-a8949a5a-0c4c-4cd5-9de9-2fa5c8651c47" released by "delete_volume" :: held 2.438s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:27:25 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.875584b0-038a-430e-bba8-6124a99c3556 Jun 02 03:27:25 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:25 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-0544fa48-77d8-4147-8400-5761ed016192 tempest-VolumesGetTest-41238149 None] Created reservations ['b555668c-070b-4214-beee-07a1357a342f', 'c95da9bc-ff68-4c61-8688-68a734fbcb20', 'da4c0a13-aa4f-4629-8cbe-3f230af84fc9', '739e61ea-bc17-47da-8e9e-e633c6eb2769'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:27:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0544fa48-77d8-4147-8400-5761ed016192 tempest-VolumesGetTest-41238149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0544fa48-77d8-4147-8400-5761ed016192 tempest-VolumesGetTest-41238149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:25 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0544fa48-77d8-4147-8400-5761ed016192 tempest-VolumesGetTest-41238149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:27:25 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0544fa48-77d8-4147-8400-5761ed016192 tempest-VolumesGetTest-41238149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:27:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0544fa48-77d8-4147-8400-5761ed016192 tempest-VolumesGetTest-41238149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0544fa48-77d8-4147-8400-5761ed016192 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:25 devstack sudo[97904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:27:25 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:26 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63389f66-a6ea-4700-9700-d2e6922c45ff tempest-VolumesDeleteCascade-451749405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.875584b0-038a-430e-bba8-6124a99c3556" returned: 0 in 0.902s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-63389f66-a6ea-4700-9700-d2e6922c45ff tempest-VolumesDeleteCascade-451749405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.255s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:26 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-63389f66-a6ea-4700-9700-d2e6922c45ff tempest-VolumesDeleteCascade-451749405 None] Create snapshot completed successfully Jun 02 03:27:26 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5b0030b9-9a8c-4d1a-b099-41b1f77b7c82 tempest-VolumesGetTest-41238149 None] Acquiring lock "cinder-d26de39c-7e2f-4c99-a7b5-8d602dc41e56-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:27:26 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5b0030b9-9a8c-4d1a-b099-41b1f77b7c82 tempest-VolumesGetTest-41238149 None] Lock "cinder-d26de39c-7e2f-4c99-a7b5-8d602dc41e56-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:27:26 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0544fa48-77d8-4147-8400-5761ed016192 tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.890s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:26 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-0544fa48-77d8-4147-8400-5761ed016192 tempest-VolumesGetTest-41238149 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:27:26 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-0544fa48-77d8-4147-8400-5761ed016192 tempest-VolumesGetTest-41238149 None] Deleted volume successfully. Jun 02 03:27:26 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0544fa48-77d8-4147-8400-5761ed016192 tempest-VolumesGetTest-41238149 None] Lock "cinder-a8949a5a-0c4c-4cd5-9de9-2fa5c8651c47-delete_volume" released by "delete_volume" :: held 3.661s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:27:26 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5b0030b9-9a8c-4d1a-b099-41b1f77b7c82 tempest-VolumesGetTest-41238149 None] Acquiring lock "cinder-quobyte-d26de39c-7e2f-4c99-a7b5-8d602dc41e56" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:27:26 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5b0030b9-9a8c-4d1a-b099-41b1f77b7c82 tempest-VolumesGetTest-41238149 None] Lock "cinder-quobyte-d26de39c-7e2f-4c99-a7b5-8d602dc41e56" acquired by "delete_volume" :: waited 0.022s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:27:26 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0706397-83c9-4d9b-90b4-41d8e6d498ca]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:27:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5b0030b9-9a8c-4d1a-b099-41b1f77b7c82 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d26de39c-7e2f-4c99-a7b5-8d602dc41e56 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:26 devstack sudo[97909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d26de39c-7e2f-4c99-a7b5-8d602dc41e56 Jun 02 03:27:26 devstack sudo[97909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:26 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Acquiring lock "cinder-a71e977c-ba4b-4011-99ea-7da7688fdac0-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:27:26 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Lock "cinder-a71e977c-ba4b-4011-99ea-7da7688fdac0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:27:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Performing cascade delete. {{(pid=86431) delete_volume /opt/stack/cinder/cinder/volume/manager.py:996}} Jun 02 03:27:26 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Acquiring lock "cinder-073c6eca-a9f7-4cdb-9fba-34ba4fae6f68-delete_snapshot" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:27:26 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Lock "cinder-073c6eca-a9f7-4cdb-9fba-34ba4fae6f68-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:27:26 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Acquiring lock "cinder-quobyte-a71e977c-ba4b-4011-99ea-7da7688fdac0" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:27:26 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Lock "cinder-quobyte-a71e977c-ba4b-4011-99ea-7da7688fdac0" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:27:26 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Acquiring lock "cinder-quobyte-073c6eca-a9f7-4cdb-9fba-34ba4fae6f68" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:27:26 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Lock "cinder-quobyte-073c6eca-a9f7-4cdb-9fba-34ba4fae6f68" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:27:26 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Deleting offline snapshot 073c6eca-a9f7-4cdb-9fba-34ba4fae6f68 of volume a71e977c-ba4b-4011-99ea-7da7688fdac0 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:27:26 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] snapshot_file for this snap is: volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.073c6eca-a9f7-4cdb-9fba-34ba4fae6f68 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:27:26 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[162a98d7-cddd-4f27-acb9-c7bef531f07d]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:27:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.073c6eca-a9f7-4cdb-9fba-34ba4fae6f68 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:27 devstack sudo[97911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.073c6eca-a9f7-4cdb-9fba-34ba4fae6f68 Jun 02 03:27:27 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:27 devstack sudo[97909]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5b0030b9-9a8c-4d1a-b099-41b1f77b7c82 tempest-VolumesGetTest-41238149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d26de39c-7e2f-4c99-a7b5-8d602dc41e56" returned: 0 in 0.916s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5b0030b9-9a8c-4d1a-b099-41b1f77b7c82 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d26de39c-7e2f-4c99-a7b5-8d602dc41e56 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:27 devstack sudo[97916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d26de39c-7e2f-4c99-a7b5-8d602dc41e56 Jun 02 03:27:27 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:27 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.073c6eca-a9f7-4cdb-9fba-34ba4fae6f68" returned: 0 in 1.125s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:27 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a71e977c-ba4b-4011-99ea-7da7688fdac0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:27:28 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e6e1ba-9680-4ff9-b383-7de4bae93eea]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:27:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:28 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0 Jun 02 03:27:28 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:28 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5b0030b9-9a8c-4d1a-b099-41b1f77b7c82 tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d26de39c-7e2f-4c99-a7b5-8d602dc41e56" returned: 0 in 1.007s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:28 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5b0030b9-9a8c-4d1a-b099-41b1f77b7c82 tempest-VolumesGetTest-41238149 None] Lock "cinder-quobyte-d26de39c-7e2f-4c99-a7b5-8d602dc41e56" released by "delete_volume" :: held 1.989s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:27:28 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=111,cinder:UPDATE=153,cinder:DELETE=15,cinder:INSERT=43 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:27:28 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=126,cinder:UPDATE=153,cinder:INSERT=32,cinder:DELETE=13 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:27:28 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-5b0030b9-9a8c-4d1a-b099-41b1f77b7c82 tempest-VolumesGetTest-41238149 None] Created reservations ['220b3c2a-3e33-48a7-9b01-7684a1dce96b', 'd3693720-c5e6-4741-bca3-74fbfa84e25d', 'eaecd7cb-0c43-4e6f-8675-3c0edb422460', '4fba294c-5d99-4174-bf0e-ca95190c40b2'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:27:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5b0030b9-9a8c-4d1a-b099-41b1f77b7c82 tempest-VolumesGetTest-41238149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5b0030b9-9a8c-4d1a-b099-41b1f77b7c82 tempest-VolumesGetTest-41238149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:28 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-5b0030b9-9a8c-4d1a-b099-41b1f77b7c82 tempest-VolumesGetTest-41238149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:27:28 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-5b0030b9-9a8c-4d1a-b099-41b1f77b7c82 tempest-VolumesGetTest-41238149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:27:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5b0030b9-9a8c-4d1a-b099-41b1f77b7c82 tempest-VolumesGetTest-41238149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5b0030b9-9a8c-4d1a-b099-41b1f77b7c82 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:28 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:27:28 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:28 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e8a25ba8-f39d-4120-beb9-7ab89ce58f1e tempest-VolumesGetTest-41238149 None] Acquiring lock "cinder-d55dcc37-9b4e-4621-b961-348d0b1cc7b9-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:27:28 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e8a25ba8-f39d-4120-beb9-7ab89ce58f1e tempest-VolumesGetTest-41238149 None] Lock "cinder-d55dcc37-9b4e-4621-b961-348d0b1cc7b9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:27:28 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e8a25ba8-f39d-4120-beb9-7ab89ce58f1e tempest-VolumesGetTest-41238149 None] Acquiring lock "cinder-quobyte-d55dcc37-9b4e-4621-b961-348d0b1cc7b9" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:27:28 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e8a25ba8-f39d-4120-beb9-7ab89ce58f1e tempest-VolumesGetTest-41238149 None] Lock "cinder-quobyte-d55dcc37-9b4e-4621-b961-348d0b1cc7b9" acquired by "delete_volume" :: waited 0.041s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:27:28 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc54be71-2730-4412-bc32-7bb066385267]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:27:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8a25ba8-f39d-4120-beb9-7ab89ce58f1e tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:29 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9 Jun 02 03:27:29 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:29 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0" returned: 0 in 1.164s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:29 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[16439e80-5698-4c39-8176-5066d92075b5]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:27:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.875584b0-038a-430e-bba8-6124a99c3556 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:29 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.875584b0-038a-430e-bba8-6124a99c3556 Jun 02 03:27:29 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:29 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5b0030b9-9a8c-4d1a-b099-41b1f77b7c82 tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 1.029s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:29 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-5b0030b9-9a8c-4d1a-b099-41b1f77b7c82 tempest-VolumesGetTest-41238149 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:27:29 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-5b0030b9-9a8c-4d1a-b099-41b1f77b7c82 tempest-VolumesGetTest-41238149 None] Deleted volume successfully. Jun 02 03:27:29 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5b0030b9-9a8c-4d1a-b099-41b1f77b7c82 tempest-VolumesGetTest-41238149 None] Lock "cinder-d26de39c-7e2f-4c99-a7b5-8d602dc41e56-delete_volume" released by "delete_volume" :: held 3.370s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:27:30 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8a25ba8-f39d-4120-beb9-7ab89ce58f1e tempest-VolumesGetTest-41238149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9" returned: 0 in 1.126s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8a25ba8-f39d-4120-beb9-7ab89ce58f1e tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:30 devstack sudo[97947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9 Jun 02 03:27:30 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:30 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.875584b0-038a-430e-bba8-6124a99c3556" returned: 0 in 0.974s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:30 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a71e977c-ba4b-4011-99ea-7da7688fdac0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:27:30 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f0e45e-1f56-497f-bd8c-2ccf67a04212]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:27:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.073c6eca-a9f7-4cdb-9fba-34ba4fae6f68 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:30 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.073c6eca-a9f7-4cdb-9fba-34ba4fae6f68 Jun 02 03:27:30 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:30 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8a25ba8-f39d-4120-beb9-7ab89ce58f1e tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-d55dcc37-9b4e-4621-b961-348d0b1cc7b9" returned: 0 in 0.776s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:30 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e8a25ba8-f39d-4120-beb9-7ab89ce58f1e tempest-VolumesGetTest-41238149 None] Lock "cinder-quobyte-d55dcc37-9b4e-4621-b961-348d0b1cc7b9" released by "delete_volume" :: held 2.010s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:27:30 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-e8a25ba8-f39d-4120-beb9-7ab89ce58f1e tempest-VolumesGetTest-41238149 None] Created reservations ['6e778b60-6976-45f8-90b9-13db80864a5c', '29743899-9515-4d17-a58d-40cde0acc8c8', 'db089138-e188-425e-aadb-399d4a59de05', 'ce49ad50-02fe-4172-a466-706dd39be3b3'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:27:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e8a25ba8-f39d-4120-beb9-7ab89ce58f1e tempest-VolumesGetTest-41238149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e8a25ba8-f39d-4120-beb9-7ab89ce58f1e tempest-VolumesGetTest-41238149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:30 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e8a25ba8-f39d-4120-beb9-7ab89ce58f1e tempest-VolumesGetTest-41238149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:27:30 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e8a25ba8-f39d-4120-beb9-7ab89ce58f1e tempest-VolumesGetTest-41238149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:27:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e8a25ba8-f39d-4120-beb9-7ab89ce58f1e tempest-VolumesGetTest-41238149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8a25ba8-f39d-4120-beb9-7ab89ce58f1e tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:31 devstack sudo[97959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:27:31 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:31 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.073c6eca-a9f7-4cdb-9fba-34ba4fae6f68" returned: 0 in 0.835s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:31 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a71e977c-ba4b-4011-99ea-7da7688fdac0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:27:31 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[db00a94e-e66f-4276-931c-17912e00cb8d]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:27:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:31 devstack sudo[97961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0 Jun 02 03:27:31 devstack sudo[97961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:31 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8a25ba8-f39d-4120-beb9-7ab89ce58f1e tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.769s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:31 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-e8a25ba8-f39d-4120-beb9-7ab89ce58f1e tempest-VolumesGetTest-41238149 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:27:31 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-e8a25ba8-f39d-4120-beb9-7ab89ce58f1e tempest-VolumesGetTest-41238149 None] Deleted volume successfully. Jun 02 03:27:31 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e8a25ba8-f39d-4120-beb9-7ab89ce58f1e tempest-VolumesGetTest-41238149 None] Lock "cinder-d55dcc37-9b4e-4621-b961-348d0b1cc7b9-delete_volume" released by "delete_volume" :: held 3.099s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:27:31 devstack sudo[97961]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0" returned: 0 in 0.871s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.073c6eca-a9f7-4cdb-9fba-34ba4fae6f68 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:32 devstack sudo[97967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.073c6eca-a9f7-4cdb-9fba-34ba4fae6f68 Jun 02 03:27:32 devstack sudo[97967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:32 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:27:32 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Flow 'volume_create_manager' (a34c079d-9e6a-461c-8bb9-b6eecf08f6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:27:32 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce2e0e8-526c-48b8-a84a-548091a6b982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:32 devstack sudo[97967]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.073c6eca-a9f7-4cdb-9fba-34ba4fae6f68" returned: 0 in 0.961s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.073c6eca-a9f7-4cdb-9fba-34ba4fae6f68 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:32 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce2e0e8-526c-48b8-a84a-548091a6b982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-274185933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfbce9cc-7c30-4077-9740-632141d09505,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='82ecbcb594f540ed9eb6bbd6f6eda02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:27:33Z,use_quota=True,user_id='3b07719d39b2468bb6daaeeeb8feb831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:32 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8768b13f-399b-459f-84af-284a4c29c76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:32 devstack sudo[97973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.073c6eca-a9f7-4cdb-9fba-34ba4fae6f68 Jun 02 03:27:32 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:32 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8768b13f-399b-459f-84af-284a4c29c76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:32 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3948c394-c381-4c5f-af84-76b7386156c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:32 devstack cinder-volume[86431]: DEBUG cinder.image.glance [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Creating Keystone auth plugin from conf {{(pid=86431) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 02 03:27:33 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3948c394-c381-4c5f-af84-76b7386156c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dfbce9cc-7c30-4077-9740-632141d09505', 'volume_name': 'volume-dfbce9cc-7c30-4077-9740-632141d09505', 'volume_size': 1, 'image_id': '54f2c102-8f54-4d66-966a-3fc746680841', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54f2c102-8f54-4d66-966a-3fc746680841', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48b06555345b4428a30a6f37e96ddabe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '54f2c102-8f54-4d66-966a-3fc746680841', 'created_at': datetime.datetime(2026, 6, 2, 1, 9, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 1, 9, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54f2c102-8f54-4d66-966a-3fc746680841/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:33 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddeb6aa1-6723-4557-8eb7-8c2b28e6813b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:33 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddeb6aa1-6723-4557-8eb7-8c2b28e6813b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:33 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6265799-4262-408c-86f0-e8c9c8a986c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:33 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Volume dfbce9cc-7c30-4077-9740-632141d09505: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dfbce9cc-7c30-4077-9740-632141d09505', 'volume_size': 1, 'image_id': '54f2c102-8f54-4d66-966a-3fc746680841', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54f2c102-8f54-4d66-966a-3fc746680841', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48b06555345b4428a30a6f37e96ddabe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '54f2c102-8f54-4d66-966a-3fc746680841', 'created_at': datetime.datetime(2026, 6, 2, 1, 9, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 1, 9, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54f2c102-8f54-4d66-966a-3fc746680841/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 02 03:27:33 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Trying to clone dfbce9cc-7c30-4077-9740-632141d09505 from image 54f2c102-8f54-4d66-966a-3fc746680841 at location (None, [{'url': 'file:///opt/stack/data/glance/images/54f2c102-8f54-4d66-966a-3fc746680841', 'metadata': {}}]). {{(pid=86431) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 02 03:27:33 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.073c6eca-a9f7-4cdb-9fba-34ba4fae6f68" returned: 0 in 0.697s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a71e977c-ba4b-4011-99ea-7da7688fdac0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.875584b0-038a-430e-bba8-6124a99c3556 -F qcow2 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:33 devstack sudo[97976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a71e977c-ba4b-4011-99ea-7da7688fdac0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.875584b0-038a-430e-bba8-6124a99c3556 -F qcow2 Jun 02 03:27:33 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:34 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_r80s2_hddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86431) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 02 03:27:34 devstack cinder-volume[86431]: INFO cinder.image.image_utils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Image download 20.69 MB at 20.69 MB/s Jun 02 03:27:34 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3d2834-d0a0-46a8-981e-ffde766c913b]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:27:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_r80s2_hddevstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:34 devstack sudo[97979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_r80s2_hddevstack@QuobyteHD Jun 02 03:27:34 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:34 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a71e977c-ba4b-4011-99ea-7da7688fdac0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.875584b0-038a-430e-bba8-6124a99c3556 -F qcow2" returned: 0 in 0.993s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Lock "cinder-quobyte-073c6eca-a9f7-4cdb-9fba-34ba4fae6f68" released by "_delete_snapshot" :: held 7.897s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:27:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Lock "cinder-quobyte-a71e977c-ba4b-4011-99ea-7da7688fdac0" released by "delete_snapshot" :: held 7.924s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:27:34 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Created reservations ['79799726-73a3-4e81-b0ab-d35cc1b0985d', '79b3bcf4-00a0-47a3-81fd-1d54afced462', '9e59bcec-2328-4e3d-b278-416c3070bc7f', 'a4525e8f-2484-4100-937b-a033404ca191'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:27:34 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Delete snapshot completed successfully. Jun 02 03:27:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Lock "cinder-073c6eca-a9f7-4cdb-9fba-34ba4fae6f68-delete_snapshot" released by "delete_snapshot" :: held 8.136s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:27:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Acquiring lock "cinder-875584b0-038a-430e-bba8-6124a99c3556-delete_snapshot" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:27:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Lock "cinder-875584b0-038a-430e-bba8-6124a99c3556-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:27:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Acquiring lock "cinder-quobyte-a71e977c-ba4b-4011-99ea-7da7688fdac0" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:27:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Lock "cinder-quobyte-a71e977c-ba4b-4011-99ea-7da7688fdac0" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:27:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Acquiring lock "cinder-quobyte-875584b0-038a-430e-bba8-6124a99c3556" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:27:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Lock "cinder-quobyte-875584b0-038a-430e-bba8-6124a99c3556" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:27:34 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Deleting offline snapshot 875584b0-038a-430e-bba8-6124a99c3556 of volume a71e977c-ba4b-4011-99ea-7da7688fdac0 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:27:34 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:35 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] snapshot_file for this snap is: volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.875584b0-038a-430e-bba8-6124a99c3556 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:27:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_r80s2_hddevstack@QuobyteHD" returned: 0 in 0.931s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:35 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Temporary image 54f2c102-8f54-4d66-966a-3fc746680841 is fetched for user 3b07719d39b2468bb6daaeeeb8feb831. {{(pid=86431) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 02 03:27:35 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae7d824-45ff-4b7f-b5a0-a596764d03e6]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:27:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.875584b0-038a-430e-bba8-6124a99c3556 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:35 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[402658e1-b11f-4739-8bc6-1e2609c5dd81]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:27:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_r80s2_hddevstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:35 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.875584b0-038a-430e-bba8-6124a99c3556 Jun 02 03:27:35 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:35 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_r80s2_hddevstack@QuobyteHD Jun 02 03:27:35 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:36 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_r80s2_hddevstack@QuobyteHD" returned: 0 in 0.939s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:36 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-274185933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfbce9cc-7c30-4077-9740-632141d09505,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='82ecbcb594f540ed9eb6bbd6f6eda02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:27:33Z,use_quota=True,user_id='3b07719d39b2468bb6daaeeeb8feb831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:27:36 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Creating volume dfbce9cc-7c30-4077-9740-632141d09505 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:27:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:36 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:27:36 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:27:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:36 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:27:36 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:27:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-dfbce9cc-7c30-4077-9740-632141d09505 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:36 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.875584b0-038a-430e-bba8-6124a99c3556" returned: 0 in 1.100s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:36 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a71e977c-ba4b-4011-99ea-7da7688fdac0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:27:36 devstack sudo[97998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-dfbce9cc-7c30-4077-9740-632141d09505 1073741824 Jun 02 03:27:36 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:36 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e79226-4578-475b-8096-7ff95e561f07]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:27:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:36 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-39d83b92-9858-4abc-b41c-e44aa35224a5 tempest-VolumesTransfersV357Test-1248625779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:27:36 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-39d83b92-9858-4abc-b41c-e44aa35224a5 tempest-VolumesTransfersV357Test-1248625779 None] Flow 'volume_create_manager' (a075baac-9530-40da-ba3a-90320c83ae8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:27:36 devstack sudo[98000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0 Jun 02 03:27:36 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-39d83b92-9858-4abc-b41c-e44aa35224a5 tempest-VolumesTransfersV357Test-1248625779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d21d88b6-58ea-432a-8a73-91beb88a1c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:36 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:36 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-39d83b92-9858-4abc-b41c-e44aa35224a5 tempest-VolumesTransfersV357Test-1248625779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d21d88b6-58ea-432a-8a73-91beb88a1c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-959791436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66c52c42-52c9-4ae4-8698-997bb1298344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d85c4252f4741ccb11c969a9f600c73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:27:36Z,use_quota=True,user_id='64615fe13df545599abbf1f9a424bb94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:36 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-39d83b92-9858-4abc-b41c-e44aa35224a5 tempest-VolumesTransfersV357Test-1248625779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71aaf721-3843-4842-a7f0-e2f0165fe839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:36 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-39d83b92-9858-4abc-b41c-e44aa35224a5 tempest-VolumesTransfersV357Test-1248625779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71aaf721-3843-4842-a7f0-e2f0165fe839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:36 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-39d83b92-9858-4abc-b41c-e44aa35224a5 tempest-VolumesTransfersV357Test-1248625779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (881ce78a-2a2c-4572-8e84-550eef198c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:36 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-39d83b92-9858-4abc-b41c-e44aa35224a5 tempest-VolumesTransfersV357Test-1248625779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (881ce78a-2a2c-4572-8e84-550eef198c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66c52c42-52c9-4ae4-8698-997bb1298344', 'volume_name': 'volume-66c52c42-52c9-4ae4-8698-997bb1298344', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:36 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-39d83b92-9858-4abc-b41c-e44aa35224a5 tempest-VolumesTransfersV357Test-1248625779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (874c78b5-c7a1-464e-9fdf-ef306d5ee638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:36 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-39d83b92-9858-4abc-b41c-e44aa35224a5 tempest-VolumesTransfersV357Test-1248625779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (874c78b5-c7a1-464e-9fdf-ef306d5ee638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:36 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-39d83b92-9858-4abc-b41c-e44aa35224a5 tempest-VolumesTransfersV357Test-1248625779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eecd2ae0-8442-4ca5-b298-ef115b8e7c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:36 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-39d83b92-9858-4abc-b41c-e44aa35224a5 tempest-VolumesTransfersV357Test-1248625779 None] Volume 66c52c42-52c9-4ae4-8698-997bb1298344: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66c52c42-52c9-4ae4-8698-997bb1298344', 'volume_size': 1} Jun 02 03:27:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-39d83b92-9858-4abc-b41c-e44aa35224a5 tempest-VolumesTransfersV357Test-1248625779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:37 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0" returned: 0 in 0.913s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.875584b0-038a-430e-bba8-6124a99c3556 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:37 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-dfbce9cc-7c30-4077-9740-632141d09505 1073741824" returned: 0 in 1.052s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:37 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.875584b0-038a-430e-bba8-6124a99c3556 Jun 02 03:27:37 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-dfbce9cc-7c30-4077-9740-632141d09505 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:37 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-dfbce9cc-7c30-4077-9740-632141d09505 Jun 02 03:27:37 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:37 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-dfbce9cc-7c30-4077-9740-632141d09505" returned: 0 in 0.772s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:37 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] <== create_volume: return (1919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:27:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.923s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-39d83b92-9858-4abc-b41c-e44aa35224a5 tempest-VolumesTransfersV357Test-1248625779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.595s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:38 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-39d83b92-9858-4abc-b41c-e44aa35224a5 tempest-VolumesTransfersV357Test-1248625779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-959791436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66c52c42-52c9-4ae4-8698-997bb1298344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d85c4252f4741ccb11c969a9f600c73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:27:36Z,use_quota=True,user_id='64615fe13df545599abbf1f9a424bb94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:27:38 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-39d83b92-9858-4abc-b41c-e44aa35224a5 tempest-VolumesTransfersV357Test-1248625779 None] Creating volume 66c52c42-52c9-4ae4-8698-997bb1298344 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:27:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-39d83b92-9858-4abc-b41c-e44aa35224a5 tempest-VolumesTransfersV357Test-1248625779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-39d83b92-9858-4abc-b41c-e44aa35224a5 tempest-VolumesTransfersV357Test-1248625779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:38 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-39d83b92-9858-4abc-b41c-e44aa35224a5 tempest-VolumesTransfersV357Test-1248625779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:27:38 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-39d83b92-9858-4abc-b41c-e44aa35224a5 tempest-VolumesTransfersV357Test-1248625779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:27:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-39d83b92-9858-4abc-b41c-e44aa35224a5 tempest-VolumesTransfersV357Test-1248625779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:38 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-39d83b92-9858-4abc-b41c-e44aa35224a5 tempest-VolumesTransfersV357Test-1248625779 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:27:38 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-39d83b92-9858-4abc-b41c-e44aa35224a5 tempest-VolumesTransfersV357Test-1248625779 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:27:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-39d83b92-9858-4abc-b41c-e44aa35224a5 tempest-VolumesTransfersV357Test-1248625779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-66c52c42-52c9-4ae4-8698-997bb1298344 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:38 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:38 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-66c52c42-52c9-4ae4-8698-997bb1298344 1073741824 Jun 02 03:27:38 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.875584b0-038a-430e-bba8-6124a99c3556" returned: 0 in 0.940s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.875584b0-038a-430e-bba8-6124a99c3556 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:38 devstack cinder-volume[86431]: DEBUG cinder.volume.volume_utils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Attempting download of 54f2c102-8f54-4d66-966a-3fc746680841 ((None, [{'url': 'file:///opt/stack/data/glance/images/54f2c102-8f54-4d66-966a-3fc746680841', 'metadata': {}}])) to volume dfbce9cc-7c30-4077-9740-632141d09505. {{(pid=86431) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 02 03:27:38 devstack sudo[98019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.875584b0-038a-430e-bba8-6124a99c3556 Jun 02 03:27:38 devstack sudo[98019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:38 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cf567b-dcf5-4a80-9d5d-327280665bf0]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:27:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54f2c102-8f54-4d66-966a-3fc746680841_42y827p7 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:38 devstack sudo[98021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54f2c102-8f54-4d66-966a-3fc746680841_42y827p7 Jun 02 03:27:38 devstack sudo[98021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:38 devstack sudo[98019]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0.875584b0-038a-430e-bba8-6124a99c3556" returned: 0 in 0.757s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:38 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Lock "cinder-quobyte-875584b0-038a-430e-bba8-6124a99c3556" released by "_delete_snapshot" :: held 3.873s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:27:38 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Lock "cinder-quobyte-a71e977c-ba4b-4011-99ea-7da7688fdac0" released by "delete_snapshot" :: held 3.909s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:27:38 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Created reservations ['d2b43792-38d7-4a63-83ce-5a0f33ef2b2e', '2313c76e-082a-4e01-9ce7-0a02586d9244', '24eb1270-72f6-43f2-ac61-503936c3a1f1', '3ca745d9-f0c1-493b-b397-924ca7440c96'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:27:38 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Delete snapshot completed successfully. Jun 02 03:27:38 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Lock "cinder-875584b0-038a-430e-bba8-6124a99c3556-delete_snapshot" released by "delete_snapshot" :: held 4.098s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:27:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Snapshots deleted, issuing volume delete {{(pid=86431) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1011}} Jun 02 03:27:39 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Acquiring lock "cinder-quobyte-a71e977c-ba4b-4011-99ea-7da7688fdac0" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:27:39 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Lock "cinder-quobyte-a71e977c-ba4b-4011-99ea-7da7688fdac0" acquired by "delete_volume" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:27:39 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a24942-8ca1-4a90-b07c-3c6845d24d2a]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:27:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:39 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-39d83b92-9858-4abc-b41c-e44aa35224a5 tempest-VolumesTransfersV357Test-1248625779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-66c52c42-52c9-4ae4-8698-997bb1298344 1073741824" returned: 0 in 1.075s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-39d83b92-9858-4abc-b41c-e44aa35224a5 tempest-VolumesTransfersV357Test-1248625779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-66c52c42-52c9-4ae4-8698-997bb1298344 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:39 devstack sudo[98021]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54f2c102-8f54-4d66-966a-3fc746680841_42y827p7" returned: 0 in 1.038s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54f2c102-8f54-4d66-966a-3fc746680841_42y827p7 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:39 devstack sudo[98031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-66c52c42-52c9-4ae4-8698-997bb1298344 Jun 02 03:27:39 devstack sudo[98031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:39 devstack sudo[98030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0 Jun 02 03:27:39 devstack sudo[98030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:39 devstack sudo[98033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54f2c102-8f54-4d66-966a-3fc746680841_42y827p7 Jun 02 03:27:39 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:39 devstack sudo[98031]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-39d83b92-9858-4abc-b41c-e44aa35224a5 tempest-VolumesTransfersV357Test-1248625779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-66c52c42-52c9-4ae4-8698-997bb1298344" returned: 0 in 0.811s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:39 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-39d83b92-9858-4abc-b41c-e44aa35224a5 tempest-VolumesTransfersV357Test-1248625779 None] <== create_volume: return (1948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:27:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-39d83b92-9858-4abc-b41c-e44aa35224a5 tempest-VolumesTransfersV357Test-1248625779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.956s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-39d83b92-9858-4abc-b41c-e44aa35224a5 tempest-VolumesTransfersV357Test-1248625779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eecd2ae0-8442-4ca5-b298-ef115b8e7c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66c52c42-52c9-4ae4-8698-997bb1298344', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:40 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-39d83b92-9858-4abc-b41c-e44aa35224a5 tempest-VolumesTransfersV357Test-1248625779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7ec8d20-0a4a-408f-b7cd-f9d6f08c24c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:40 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-39d83b92-9858-4abc-b41c-e44aa35224a5 tempest-VolumesTransfersV357Test-1248625779 None] Volume volume-66c52c42-52c9-4ae4-8698-997bb1298344 (66c52c42-52c9-4ae4-8698-997bb1298344): created successfully Jun 02 03:27:40 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-39d83b92-9858-4abc-b41c-e44aa35224a5 tempest-VolumesTransfersV357Test-1248625779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7ec8d20-0a4a-408f-b7cd-f9d6f08c24c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:40 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-39d83b92-9858-4abc-b41c-e44aa35224a5 tempest-VolumesTransfersV357Test-1248625779 None] Flow 'volume_create_manager' (a075baac-9530-40da-ba3a-90320c83ae8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:27:40 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-39d83b92-9858-4abc-b41c-e44aa35224a5 tempest-VolumesTransfersV357Test-1248625779 None] Created volume successfully. Jun 02 03:27:40 devstack sudo[98030]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0" returned: 0 in 1.048s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:40 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0 Jun 02 03:27:40 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:40 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54f2c102-8f54-4d66-966a-3fc746680841_42y827p7" returned: 1 in 0.989s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54f2c102-8f54-4d66-966a-3fc746680841_42y827p7' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:27:40 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa00b20-e0dc-435a-9d6b-7c3d5d7762d8]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:27:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_r80s2_hddevstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:40 devstack sudo[98044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_r80s2_hddevstack@QuobyteHD Jun 02 03:27:40 devstack sudo[98044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:40 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a71e977c-ba4b-4011-99ea-7da7688fdac0" returned: 0 in 0.623s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Lock "cinder-quobyte-a71e977c-ba4b-4011-99ea-7da7688fdac0" released by "delete_volume" :: held 1.757s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:27:40 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Created reservations ['cb00ea6d-3211-45c8-98c5-4ebe9aa97f7c', '0823c33d-710a-4747-b8e7-7124b997ad3b', 'd7eefe0c-e662-4ade-b129-7b8c66474fd2', '82a5cb9e-3bd4-4d75-be90-3dbfbbf772ee'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:27:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:40 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:27:40 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:27:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:40 devstack sudo[98044]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_r80s2_hddevstack@QuobyteHD" returned: 0 in 0.749s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:40 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] 54f2c102-8f54-4d66-966a-3fc746680841 was qcow2, converting to raw {{(pid=86431) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 02 03:27:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_r80s2_hddevstack@QuobyteHD /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-dfbce9cc-7c30-4077-9740-632141d09505 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:40 devstack sudo[98051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:27:40 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:40 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_r80s2_hddevstack@QuobyteHD /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-dfbce9cc-7c30-4077-9740-632141d09505 Jun 02 03:27:40 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-1697f1ed-e58c-4dd0-b6e5-6743af99104b tempest-TestServerVolumeAttachmentScenario-1432150825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1697f1ed-e58c-4dd0-b6e5-6743af99104b tempest-TestServerVolumeAttachmentScenario-1432150825 None] Flow 'volume_create_manager' (5460dea2-96c8-49e2-8fce-b27db96a1ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1697f1ed-e58c-4dd0-b6e5-6743af99104b tempest-TestServerVolumeAttachmentScenario-1432150825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1557707b-5417-45b5-b889-6e587242fc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1697f1ed-e58c-4dd0-b6e5-6743af99104b tempest-TestServerVolumeAttachmentScenario-1432150825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1557707b-5417-45b5-b889-6e587242fc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1786045978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5b3727e-fda2-46a1-b763-98a74d870fed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7926ed4bedc34a25b6732ca262b84c06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:27:41Z,use_quota=True,user_id='6f57ed3f739b48359a3ebe87e2b58305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1697f1ed-e58c-4dd0-b6e5-6743af99104b tempest-TestServerVolumeAttachmentScenario-1432150825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b25e229d-f72a-4920-9491-76442057b460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1697f1ed-e58c-4dd0-b6e5-6743af99104b tempest-TestServerVolumeAttachmentScenario-1432150825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b25e229d-f72a-4920-9491-76442057b460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1697f1ed-e58c-4dd0-b6e5-6743af99104b tempest-TestServerVolumeAttachmentScenario-1432150825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d04dbb49-01f7-414c-bcdc-ca0696bc059d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1697f1ed-e58c-4dd0-b6e5-6743af99104b tempest-TestServerVolumeAttachmentScenario-1432150825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d04dbb49-01f7-414c-bcdc-ca0696bc059d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5b3727e-fda2-46a1-b763-98a74d870fed', 'volume_name': 'volume-e5b3727e-fda2-46a1-b763-98a74d870fed', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1697f1ed-e58c-4dd0-b6e5-6743af99104b tempest-TestServerVolumeAttachmentScenario-1432150825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2edc8491-d05d-4b27-a420-fae9bb29d200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1697f1ed-e58c-4dd0-b6e5-6743af99104b tempest-TestServerVolumeAttachmentScenario-1432150825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2edc8491-d05d-4b27-a420-fae9bb29d200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1697f1ed-e58c-4dd0-b6e5-6743af99104b tempest-TestServerVolumeAttachmentScenario-1432150825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0716981e-fa66-4d10-83e8-153c6dbae05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:41 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-1697f1ed-e58c-4dd0-b6e5-6743af99104b tempest-TestServerVolumeAttachmentScenario-1432150825 None] Volume e5b3727e-fda2-46a1-b763-98a74d870fed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5b3727e-fda2-46a1-b763-98a74d870fed', 'volume_size': 1} Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1697f1ed-e58c-4dd0-b6e5-6743af99104b tempest-TestServerVolumeAttachmentScenario-1432150825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1697f1ed-e58c-4dd0-b6e5-6743af99104b tempest-TestServerVolumeAttachmentScenario-1432150825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-1697f1ed-e58c-4dd0-b6e5-6743af99104b tempest-TestServerVolumeAttachmentScenario-1432150825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1786045978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5b3727e-fda2-46a1-b763-98a74d870fed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7926ed4bedc34a25b6732ca262b84c06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:27:41Z,use_quota=True,user_id='6f57ed3f739b48359a3ebe87e2b58305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-1697f1ed-e58c-4dd0-b6e5-6743af99104b tempest-TestServerVolumeAttachmentScenario-1432150825 None] Creating volume e5b3727e-fda2-46a1-b763-98a74d870fed {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1697f1ed-e58c-4dd0-b6e5-6743af99104b tempest-TestServerVolumeAttachmentScenario-1432150825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1697f1ed-e58c-4dd0-b6e5-6743af99104b tempest-TestServerVolumeAttachmentScenario-1432150825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-1697f1ed-e58c-4dd0-b6e5-6743af99104b tempest-TestServerVolumeAttachmentScenario-1432150825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-1697f1ed-e58c-4dd0-b6e5-6743af99104b tempest-TestServerVolumeAttachmentScenario-1432150825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1697f1ed-e58c-4dd0-b6e5-6743af99104b tempest-TestServerVolumeAttachmentScenario-1432150825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-1697f1ed-e58c-4dd0-b6e5-6743af99104b tempest-TestServerVolumeAttachmentScenario-1432150825 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:27:41 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-1697f1ed-e58c-4dd0-b6e5-6743af99104b tempest-TestServerVolumeAttachmentScenario-1432150825 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1697f1ed-e58c-4dd0-b6e5-6743af99104b tempest-TestServerVolumeAttachmentScenario-1432150825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e5b3727e-fda2-46a1-b763-98a74d870fed 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:41 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e5b3727e-fda2-46a1-b763-98a74d870fed 1073741824 Jun 02 03:27:41 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:41 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-58f8e75b-bf4b-4085-bf88-302de9b68b90 tempest-VolumesTransfersV357Test-923306838 None] Transfer volume completed successfully. Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-5594e002-946a-40f2-a64f-c7c45dc1f634 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-5594e002-946a-40f2-a64f-c7c45dc1f634 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Flow 'volume_create_manager' (fe00c98f-2382-4a82-a0bb-73d61123dd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-5594e002-946a-40f2-a64f-c7c45dc1f634 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaf71c16-0e52-495b-a5bc-0ac7c46eda25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:41 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.982s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-5594e002-946a-40f2-a64f-c7c45dc1f634 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaf71c16-0e52-495b-a5bc-0ac7c46eda25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1799037644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58912baa-273a-4f1a-8a54-504417438ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7926ed4bedc34a25b6732ca262b84c06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:27:42Z,use_quota=True,user_id='6f57ed3f739b48359a3ebe87e2b58305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-5594e002-946a-40f2-a64f-c7c45dc1f634 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a55b8fd2-d46f-4c20-919a-fcd8e6316fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-5594e002-946a-40f2-a64f-c7c45dc1f634 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a55b8fd2-d46f-4c20-919a-fcd8e6316fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-5594e002-946a-40f2-a64f-c7c45dc1f634 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d67521c9-a25d-40a6-ad6d-252e914e3bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-5594e002-946a-40f2-a64f-c7c45dc1f634 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d67521c9-a25d-40a6-ad6d-252e914e3bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58912baa-273a-4f1a-8a54-504417438ec5', 'volume_name': 'volume-58912baa-273a-4f1a-8a54-504417438ec5', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-5594e002-946a-40f2-a64f-c7c45dc1f634 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6d4e38c-efb2-4f99-98d7-2a059d131924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-5594e002-946a-40f2-a64f-c7c45dc1f634 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6d4e38c-efb2-4f99-98d7-2a059d131924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-5594e002-946a-40f2-a64f-c7c45dc1f634 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03aa1aca-17d5-4095-8eb3-ec4453e00713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:41 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-5594e002-946a-40f2-a64f-c7c45dc1f634 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Volume 58912baa-273a-4f1a-8a54-504417438ec5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58912baa-273a-4f1a-8a54-504417438ec5', 'volume_size': 1} Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5594e002-946a-40f2-a64f-c7c45dc1f634 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:41 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Deleted volume successfully. Jun 02 03:27:41 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ddf2be6b-51c9-4baf-88fc-04b9cf2b7626 tempest-VolumesDeleteCascade-451749405 None] Lock "cinder-a71e977c-ba4b-4011-99ea-7da7688fdac0-delete_volume" released by "delete_volume" :: held 15.348s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:27:42 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dead2b2-2a31-4884-ab30-a7554bd67f86 tempest-VolumesDeleteCascade-451749405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:27:42 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7dead2b2-2a31-4884-ab30-a7554bd67f86 tempest-VolumesDeleteCascade-451749405 None] Flow 'volume_create_manager' (cee58803-fe38-4616-ba67-93ba52611015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:27:42 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7dead2b2-2a31-4884-ab30-a7554bd67f86 tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (751e0668-ffc0-44fd-bb8c-2624f001f8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:42 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-a9819923-f71f-4667-a4f7-bbd362368aa4 tempest-VolumesTransfersV357Test-1254692367 None] Acquiring lock "cinder-66c52c42-52c9-4ae4-8698-997bb1298344-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:27:42 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:42 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7dead2b2-2a31-4884-ab30-a7554bd67f86 tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (751e0668-ffc0-44fd-bb8c-2624f001f8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-714124166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1abe29c-558e-46a0-b349-37f07f89f5bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff2e68c2b8a44d478abefd101c9ba76d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:27:43Z,use_quota=True,user_id='57230c43bfc04a86a8d4f033f6831d1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:42 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7dead2b2-2a31-4884-ab30-a7554bd67f86 tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f2cb576-ca7e-411e-8fd1-d75f05458672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:42 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7dead2b2-2a31-4884-ab30-a7554bd67f86 tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f2cb576-ca7e-411e-8fd1-d75f05458672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:42 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7dead2b2-2a31-4884-ab30-a7554bd67f86 tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cbd602a-4a43-4933-822e-adacc6fe8dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:42 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7dead2b2-2a31-4884-ab30-a7554bd67f86 tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cbd602a-4a43-4933-822e-adacc6fe8dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1abe29c-558e-46a0-b349-37f07f89f5bd', 'volume_name': 'volume-b1abe29c-558e-46a0-b349-37f07f89f5bd', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:42 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7dead2b2-2a31-4884-ab30-a7554bd67f86 tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46449646-eb89-4ada-a9aa-fd931afa7c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:42 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7dead2b2-2a31-4884-ab30-a7554bd67f86 tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46449646-eb89-4ada-a9aa-fd931afa7c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:42 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7dead2b2-2a31-4884-ab30-a7554bd67f86 tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05a66c11-c01d-4f5a-8282-40c2e76807b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:42 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-7dead2b2-2a31-4884-ab30-a7554bd67f86 tempest-VolumesDeleteCascade-451749405 None] Volume b1abe29c-558e-46a0-b349-37f07f89f5bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1abe29c-558e-46a0-b349-37f07f89f5bd', 'volume_size': 1} Jun 02 03:27:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7dead2b2-2a31-4884-ab30-a7554bd67f86 tempest-VolumesDeleteCascade-451749405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:42 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-a9819923-f71f-4667-a4f7-bbd362368aa4 tempest-VolumesTransfersV357Test-1254692367 None] Lock "cinder-66c52c42-52c9-4ae4-8698-997bb1298344-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:27:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1697f1ed-e58c-4dd0-b6e5-6743af99104b tempest-TestServerVolumeAttachmentScenario-1432150825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e5b3727e-fda2-46a1-b763-98a74d870fed 1073741824" returned: 0 in 1.425s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1697f1ed-e58c-4dd0-b6e5-6743af99104b tempest-TestServerVolumeAttachmentScenario-1432150825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e5b3727e-fda2-46a1-b763-98a74d870fed {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:42 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-a9819923-f71f-4667-a4f7-bbd362368aa4 tempest-VolumesTransfersV357Test-1254692367 None] Acquiring lock "cinder-quobyte-66c52c42-52c9-4ae4-8698-997bb1298344" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:27:42 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e5b3727e-fda2-46a1-b763-98a74d870fed Jun 02 03:27:42 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:42 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-a9819923-f71f-4667-a4f7-bbd362368aa4 tempest-VolumesTransfersV357Test-1254692367 None] Lock "cinder-quobyte-66c52c42-52c9-4ae4-8698-997bb1298344" acquired by "delete_volume" :: waited 0.029s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:27:42 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b7d9d5-d5fa-453e-ab8b-e96d493178e1]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:27:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a9819923-f71f-4667-a4f7-bbd362368aa4 tempest-VolumesTransfersV357Test-1254692367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-66c52c42-52c9-4ae4-8698-997bb1298344 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:43 devstack sudo[98071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-66c52c42-52c9-4ae4-8698-997bb1298344 Jun 02 03:27:43 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:43 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_r80s2_hddevstack@QuobyteHD /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-dfbce9cc-7c30-4077-9740-632141d09505" returned: 0 in 2.656s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:43 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_r80s2_hddevstack@QuobyteHD, size 112.00 MB, duration 2.66 sec, destination /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-dfbce9cc-7c30-4077-9740-632141d09505 {{(pid=86431) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 02 03:27:43 devstack cinder-volume[86431]: INFO cinder.image.image_utils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Converted 112.00 MB image at 42.14 MB/s Jun 02 03:27:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-dfbce9cc-7c30-4077-9740-632141d09505 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:43 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1697f1ed-e58c-4dd0-b6e5-6743af99104b tempest-TestServerVolumeAttachmentScenario-1432150825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e5b3727e-fda2-46a1-b763-98a74d870fed" returned: 0 in 0.799s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:43 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-1697f1ed-e58c-4dd0-b6e5-6743af99104b tempest-TestServerVolumeAttachmentScenario-1432150825 None] <== create_volume: return (2278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:27:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1697f1ed-e58c-4dd0-b6e5-6743af99104b tempest-TestServerVolumeAttachmentScenario-1432150825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.289s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:43 devstack sudo[98074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-dfbce9cc-7c30-4077-9740-632141d09505 1G Jun 02 03:27:43 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5594e002-946a-40f2-a64f-c7c45dc1f634 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.697s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:43 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-5594e002-946a-40f2-a64f-c7c45dc1f634 tempest-TestServerVolumeAttachmentScenario-1432150825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1799037644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58912baa-273a-4f1a-8a54-504417438ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7926ed4bedc34a25b6732ca262b84c06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:27:42Z,use_quota=True,user_id='6f57ed3f739b48359a3ebe87e2b58305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:27:43 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-5594e002-946a-40f2-a64f-c7c45dc1f634 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Creating volume 58912baa-273a-4f1a-8a54-504417438ec5 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:27:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5594e002-946a-40f2-a64f-c7c45dc1f634 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5594e002-946a-40f2-a64f-c7c45dc1f634 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:43 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-5594e002-946a-40f2-a64f-c7c45dc1f634 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:27:43 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-5594e002-946a-40f2-a64f-c7c45dc1f634 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:27:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5594e002-946a-40f2-a64f-c7c45dc1f634 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:43 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-5594e002-946a-40f2-a64f-c7c45dc1f634 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:27:43 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-5594e002-946a-40f2-a64f-c7c45dc1f634 tempest-TestServerVolumeAttachmentScenario-1432150825 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:27:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5594e002-946a-40f2-a64f-c7c45dc1f634 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-58912baa-273a-4f1a-8a54-504417438ec5 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1697f1ed-e58c-4dd0-b6e5-6743af99104b tempest-TestServerVolumeAttachmentScenario-1432150825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0716981e-fa66-4d10-83e8-153c6dbae05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5b3727e-fda2-46a1-b763-98a74d870fed', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1697f1ed-e58c-4dd0-b6e5-6743af99104b tempest-TestServerVolumeAttachmentScenario-1432150825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15af3aba-a785-48bc-a405-755b3b25a8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:43 devstack sudo[98076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-58912baa-273a-4f1a-8a54-504417438ec5 1073741824 Jun 02 03:27:43 devstack sudo[98076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:43 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-1697f1ed-e58c-4dd0-b6e5-6743af99104b tempest-TestServerVolumeAttachmentScenario-1432150825 None] Volume volume-e5b3727e-fda2-46a1-b763-98a74d870fed (e5b3727e-fda2-46a1-b763-98a74d870fed): created successfully Jun 02 03:27:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1697f1ed-e58c-4dd0-b6e5-6743af99104b tempest-TestServerVolumeAttachmentScenario-1432150825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15af3aba-a785-48bc-a405-755b3b25a8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1697f1ed-e58c-4dd0-b6e5-6743af99104b tempest-TestServerVolumeAttachmentScenario-1432150825 None] Flow 'volume_create_manager' (5460dea2-96c8-49e2-8fce-b27db96a1ec3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:27:43 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-1697f1ed-e58c-4dd0-b6e5-6743af99104b tempest-TestServerVolumeAttachmentScenario-1432150825 None] Created volume successfully. Jun 02 03:27:43 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a9819923-f71f-4667-a4f7-bbd362368aa4 tempest-VolumesTransfersV357Test-1254692367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-66c52c42-52c9-4ae4-8698-997bb1298344" returned: 0 in 1.022s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a9819923-f71f-4667-a4f7-bbd362368aa4 tempest-VolumesTransfersV357Test-1254692367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-66c52c42-52c9-4ae4-8698-997bb1298344 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:43 devstack sudo[98081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-66c52c42-52c9-4ae4-8698-997bb1298344 Jun 02 03:27:43 devstack sudo[98081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:44 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-dfbce9cc-7c30-4077-9740-632141d09505 1G" returned: 0 in 0.807s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:44 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6414bc-e85f-4684-8aea-68c23f4ed5d4]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:27:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-dfbce9cc-7c30-4077-9740-632141d09505 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:44 devstack sudo[98076]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5594e002-946a-40f2-a64f-c7c45dc1f634 tempest-TestServerVolumeAttachmentScenario-1432150825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-58912baa-273a-4f1a-8a54-504417438ec5 1073741824" returned: 0 in 0.882s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:44 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-dfbce9cc-7c30-4077-9740-632141d09505 Jun 02 03:27:44 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5594e002-946a-40f2-a64f-c7c45dc1f634 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-58912baa-273a-4f1a-8a54-504417438ec5 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:44 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-58912baa-273a-4f1a-8a54-504417438ec5 Jun 02 03:27:44 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:44 devstack sudo[98081]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a9819923-f71f-4667-a4f7-bbd362368aa4 tempest-VolumesTransfersV357Test-1254692367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-66c52c42-52c9-4ae4-8698-997bb1298344" returned: 0 in 0.743s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:44 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-a9819923-f71f-4667-a4f7-bbd362368aa4 tempest-VolumesTransfersV357Test-1254692367 None] Lock "cinder-quobyte-66c52c42-52c9-4ae4-8698-997bb1298344" released by "delete_volume" :: held 1.827s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:27:44 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-a9819923-f71f-4667-a4f7-bbd362368aa4 tempest-VolumesTransfersV357Test-1254692367 None] Created reservations ['bd8f30fa-7d63-4b80-b087-1db52f1aa001', '5e524b2e-0072-40c5-a51d-62f3cdf130d4', '3f7ce269-2112-43a7-82b4-194e3dd01369', '20c9a5c2-a093-4049-93d2-13171ff443e1'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:27:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a9819923-f71f-4667-a4f7-bbd362368aa4 tempest-VolumesTransfersV357Test-1254692367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a9819923-f71f-4667-a4f7-bbd362368aa4 tempest-VolumesTransfersV357Test-1254692367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:44 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a9819923-f71f-4667-a4f7-bbd362368aa4 tempest-VolumesTransfersV357Test-1254692367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:27:44 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a9819923-f71f-4667-a4f7-bbd362368aa4 tempest-VolumesTransfersV357Test-1254692367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:27:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a9819923-f71f-4667-a4f7-bbd362368aa4 tempest-VolumesTransfersV357Test-1254692367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a9819923-f71f-4667-a4f7-bbd362368aa4 tempest-VolumesTransfersV357Test-1254692367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:44 devstack sudo[98095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:27:44 devstack sudo[98095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:45 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-dfbce9cc-7c30-4077-9740-632141d09505" returned: 0 in 0.804s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-dfbce9cc-7c30-4077-9740-632141d09505 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:45 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5594e002-946a-40f2-a64f-c7c45dc1f634 tempest-TestServerVolumeAttachmentScenario-1432150825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-58912baa-273a-4f1a-8a54-504417438ec5" returned: 0 in 0.869s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:45 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-5594e002-946a-40f2-a64f-c7c45dc1f634 tempest-TestServerVolumeAttachmentScenario-1432150825 None] <== create_volume: return (1803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:27:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5594e002-946a-40f2-a64f-c7c45dc1f634 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.811s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:45 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-dfbce9cc-7c30-4077-9740-632141d09505 Jun 02 03:27:45 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7dead2b2-2a31-4884-ab30-a7554bd67f86 tempest-VolumesDeleteCascade-451749405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.700s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:45 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-7dead2b2-2a31-4884-ab30-a7554bd67f86 tempest-VolumesDeleteCascade-451749405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-714124166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1abe29c-558e-46a0-b349-37f07f89f5bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff2e68c2b8a44d478abefd101c9ba76d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:27:43Z,use_quota=True,user_id='57230c43bfc04a86a8d4f033f6831d1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:27:45 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-7dead2b2-2a31-4884-ab30-a7554bd67f86 tempest-VolumesDeleteCascade-451749405 None] Creating volume b1abe29c-558e-46a0-b349-37f07f89f5bd {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:27:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7dead2b2-2a31-4884-ab30-a7554bd67f86 tempest-VolumesDeleteCascade-451749405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7dead2b2-2a31-4884-ab30-a7554bd67f86 tempest-VolumesDeleteCascade-451749405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:45 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-7dead2b2-2a31-4884-ab30-a7554bd67f86 tempest-VolumesDeleteCascade-451749405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:27:45 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-7dead2b2-2a31-4884-ab30-a7554bd67f86 tempest-VolumesDeleteCascade-451749405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:27:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7dead2b2-2a31-4884-ab30-a7554bd67f86 tempest-VolumesDeleteCascade-451749405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:45 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-7dead2b2-2a31-4884-ab30-a7554bd67f86 tempest-VolumesDeleteCascade-451749405 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:27:45 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-7dead2b2-2a31-4884-ab30-a7554bd67f86 tempest-VolumesDeleteCascade-451749405 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:27:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7dead2b2-2a31-4884-ab30-a7554bd67f86 tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:45 devstack sudo[98103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd 1073741824 Jun 02 03:27:45 devstack sudo[98103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-5594e002-946a-40f2-a64f-c7c45dc1f634 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03aa1aca-17d5-4095-8eb3-ec4453e00713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58912baa-273a-4f1a-8a54-504417438ec5', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-5594e002-946a-40f2-a64f-c7c45dc1f634 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62f8b0af-0371-45d6-9027-b9cb2e9c446d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:45 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-5594e002-946a-40f2-a64f-c7c45dc1f634 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Volume volume-58912baa-273a-4f1a-8a54-504417438ec5 (58912baa-273a-4f1a-8a54-504417438ec5): created successfully Jun 02 03:27:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-5594e002-946a-40f2-a64f-c7c45dc1f634 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62f8b0af-0371-45d6-9027-b9cb2e9c446d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-5594e002-946a-40f2-a64f-c7c45dc1f634 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Flow 'volume_create_manager' (fe00c98f-2382-4a82-a0bb-73d61123dd98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:27:45 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-5594e002-946a-40f2-a64f-c7c45dc1f634 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Created volume successfully. Jun 02 03:27:45 devstack sudo[98095]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a9819923-f71f-4667-a4f7-bbd362368aa4 tempest-VolumesTransfersV357Test-1254692367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.799s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:45 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-a9819923-f71f-4667-a4f7-bbd362368aa4 tempest-VolumesTransfersV357Test-1254692367 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:27:45 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-a9819923-f71f-4667-a4f7-bbd362368aa4 tempest-VolumesTransfersV357Test-1254692367 None] Deleted volume successfully. Jun 02 03:27:45 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-a9819923-f71f-4667-a4f7-bbd362368aa4 tempest-VolumesTransfersV357Test-1254692367 None] Lock "cinder-66c52c42-52c9-4ae4-8698-997bb1298344-delete_volume" released by "delete_volume" :: held 2.934s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:27:45 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4d35f1f-8590-4084-a02a-a8db8ea98c92 tempest-VolumesTransfersV357Test-1248625779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:27:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b4d35f1f-8590-4084-a02a-a8db8ea98c92 tempest-VolumesTransfersV357Test-1248625779 None] Flow 'volume_create_manager' (db91f620-3434-49f7-b065-6de2bd21f425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:27:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b4d35f1f-8590-4084-a02a-a8db8ea98c92 tempest-VolumesTransfersV357Test-1248625779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (143de5b6-684a-4051-8b3f-9c7d89093ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b4d35f1f-8590-4084-a02a-a8db8ea98c92 tempest-VolumesTransfersV357Test-1248625779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (143de5b6-684a-4051-8b3f-9c7d89093ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-38184171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe46ec20-43f6-40ac-bca9-132f81eaf669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d85c4252f4741ccb11c969a9f600c73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:27:46Z,use_quota=True,user_id='64615fe13df545599abbf1f9a424bb94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b4d35f1f-8590-4084-a02a-a8db8ea98c92 tempest-VolumesTransfersV357Test-1248625779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (848eb8cc-9196-401b-92de-f51df56de5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b4d35f1f-8590-4084-a02a-a8db8ea98c92 tempest-VolumesTransfersV357Test-1248625779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (848eb8cc-9196-401b-92de-f51df56de5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b4d35f1f-8590-4084-a02a-a8db8ea98c92 tempest-VolumesTransfersV357Test-1248625779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e0ed4f3-f60d-496c-a98f-ba935049da28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b4d35f1f-8590-4084-a02a-a8db8ea98c92 tempest-VolumesTransfersV357Test-1248625779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e0ed4f3-f60d-496c-a98f-ba935049da28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe46ec20-43f6-40ac-bca9-132f81eaf669', 'volume_name': 'volume-fe46ec20-43f6-40ac-bca9-132f81eaf669', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b4d35f1f-8590-4084-a02a-a8db8ea98c92 tempest-VolumesTransfersV357Test-1248625779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c951b5-efc5-4d04-a8f5-1b1e69a9a0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b4d35f1f-8590-4084-a02a-a8db8ea98c92 tempest-VolumesTransfersV357Test-1248625779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c951b5-efc5-4d04-a8f5-1b1e69a9a0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b4d35f1f-8590-4084-a02a-a8db8ea98c92 tempest-VolumesTransfersV357Test-1248625779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edfa7973-476e-4c03-8d2d-61df29b86f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:45 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-b4d35f1f-8590-4084-a02a-a8db8ea98c92 tempest-VolumesTransfersV357Test-1248625779 None] Volume fe46ec20-43f6-40ac-bca9-132f81eaf669: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe46ec20-43f6-40ac-bca9-132f81eaf669', 'volume_size': 1} Jun 02 03:27:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b4d35f1f-8590-4084-a02a-a8db8ea98c92 tempest-VolumesTransfersV357Test-1248625779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:46 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-dfbce9cc-7c30-4077-9740-632141d09505" returned: 1 in 0.999s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-dfbce9cc-7c30-4077-9740-632141d09505' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:27:46 devstack cinder-volume[86431]: DEBUG cinder.volume.volume_utils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Downloaded image 54f2c102-8f54-4d66-966a-3fc746680841 ((None, [{'url': 'file:///opt/stack/data/glance/images/54f2c102-8f54-4d66-966a-3fc746680841', 'metadata': {}}])) to volume dfbce9cc-7c30-4077-9740-632141d09505 successfully. {{(pid=86431) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 02 03:27:46 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Temporary image 54f2c102-8f54-4d66-966a-3fc746680841 for user 3b07719d39b2468bb6daaeeeb8feb831 is deleted. {{(pid=86431) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 02 03:27:46 devstack cinder-volume[86431]: DEBUG cinder.volume.volume_utils [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Marking volume dfbce9cc-7c30-4077-9740-632141d09505 as bootable. {{(pid=86431) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 02 03:27:46 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Copying metadata from image 54f2c102-8f54-4d66-966a-3fc746680841 to dfbce9cc-7c30-4077-9740-632141d09505. {{(pid=86431) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 02 03:27:46 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Creating volume glance metadata for volume dfbce9cc-7c30-4077-9740-632141d09505 backed by image 54f2c102-8f54-4d66-966a-3fc746680841 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '54f2c102-8f54-4d66-966a-3fc746680841', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86431) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 02 03:27:46 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6265799-4262-408c-86f0-e8c9c8a986c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfbce9cc-7c30-4077-9740-632141d09505', 'volume_size': 1, 'image_id': '54f2c102-8f54-4d66-966a-3fc746680841', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54f2c102-8f54-4d66-966a-3fc746680841', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48b06555345b4428a30a6f37e96ddabe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '54f2c102-8f54-4d66-966a-3fc746680841', 'created_at': datetime.datetime(2026, 6, 2, 1, 9, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 1, 9, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54f2c102-8f54-4d66-966a-3fc746680841/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:46 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4105772-046c-466b-bae9-4cc92670b916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:46 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Volume volume-dfbce9cc-7c30-4077-9740-632141d09505 (dfbce9cc-7c30-4077-9740-632141d09505): created successfully Jun 02 03:27:46 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4105772-046c-466b-bae9-4cc92670b916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:46 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Flow 'volume_create_manager' (a34c079d-9e6a-461c-8bb9-b6eecf08f6b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:27:46 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-ad9e5a3a-ddd3-4cb5-af31-357b20d545bd tempest-VolumesGetTest-41238149 None] Created volume successfully. Jun 02 03:27:46 devstack sudo[98103]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7dead2b2-2a31-4884-ab30-a7554bd67f86 tempest-VolumesDeleteCascade-451749405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd 1073741824" returned: 0 in 1.032s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7dead2b2-2a31-4884-ab30-a7554bd67f86 tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:46 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd Jun 02 03:27:46 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:47 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7dead2b2-2a31-4884-ab30-a7554bd67f86 tempest-VolumesDeleteCascade-451749405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd" returned: 0 in 0.618s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-7dead2b2-2a31-4884-ab30-a7554bd67f86 tempest-VolumesDeleteCascade-451749405 None] <== create_volume: return (1697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:27:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7dead2b2-2a31-4884-ab30-a7554bd67f86 tempest-VolumesDeleteCascade-451749405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b4d35f1f-8590-4084-a02a-a8db8ea98c92 tempest-VolumesTransfersV357Test-1248625779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.277s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b4d35f1f-8590-4084-a02a-a8db8ea98c92 tempest-VolumesTransfersV357Test-1248625779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-38184171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe46ec20-43f6-40ac-bca9-132f81eaf669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d85c4252f4741ccb11c969a9f600c73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:27:46Z,use_quota=True,user_id='64615fe13df545599abbf1f9a424bb94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:27:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-b4d35f1f-8590-4084-a02a-a8db8ea98c92 tempest-VolumesTransfersV357Test-1248625779 None] Creating volume fe46ec20-43f6-40ac-bca9-132f81eaf669 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:27:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b4d35f1f-8590-4084-a02a-a8db8ea98c92 tempest-VolumesTransfersV357Test-1248625779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b4d35f1f-8590-4084-a02a-a8db8ea98c92 tempest-VolumesTransfersV357Test-1248625779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b4d35f1f-8590-4084-a02a-a8db8ea98c92 tempest-VolumesTransfersV357Test-1248625779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:27:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b4d35f1f-8590-4084-a02a-a8db8ea98c92 tempest-VolumesTransfersV357Test-1248625779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:27:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b4d35f1f-8590-4084-a02a-a8db8ea98c92 tempest-VolumesTransfersV357Test-1248625779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b4d35f1f-8590-4084-a02a-a8db8ea98c92 tempest-VolumesTransfersV357Test-1248625779 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:27:47 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-b4d35f1f-8590-4084-a02a-a8db8ea98c92 tempest-VolumesTransfersV357Test-1248625779 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:27:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b4d35f1f-8590-4084-a02a-a8db8ea98c92 tempest-VolumesTransfersV357Test-1248625779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fe46ec20-43f6-40ac-bca9-132f81eaf669 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7dead2b2-2a31-4884-ab30-a7554bd67f86 tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05a66c11-c01d-4f5a-8282-40c2e76807b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1abe29c-558e-46a0-b349-37f07f89f5bd', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7dead2b2-2a31-4884-ab30-a7554bd67f86 tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4168e060-f441-4a81-82d8-3f3a9166f569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:47 devstack sudo[98117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fe46ec20-43f6-40ac-bca9-132f81eaf669 1073741824 Jun 02 03:27:47 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:47 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-7dead2b2-2a31-4884-ab30-a7554bd67f86 tempest-VolumesDeleteCascade-451749405 None] Volume volume-b1abe29c-558e-46a0-b349-37f07f89f5bd (b1abe29c-558e-46a0-b349-37f07f89f5bd): created successfully Jun 02 03:27:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7dead2b2-2a31-4884-ab30-a7554bd67f86 tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4168e060-f441-4a81-82d8-3f3a9166f569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-7dead2b2-2a31-4884-ab30-a7554bd67f86 tempest-VolumesDeleteCascade-451749405 None] Flow 'volume_create_manager' (cee58803-fe38-4616-ba67-93ba52611015) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:27:47 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-7dead2b2-2a31-4884-ab30-a7554bd67f86 tempest-VolumesDeleteCascade-451749405 None] Created volume successfully. Jun 02 03:27:47 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6d205fb-fef4-465a-8528-16dbbae56b33 tempest-VolumesGetTest-41238149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:27:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a6d205fb-fef4-465a-8528-16dbbae56b33 tempest-VolumesGetTest-41238149 None] Flow 'volume_create_manager' (276fc794-5dba-411d-aa78-a47e50754668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:27:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a6d205fb-fef4-465a-8528-16dbbae56b33 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c609a7-1a27-4baf-9b18-e2e5649da1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a6d205fb-fef4-465a-8528-16dbbae56b33 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c609a7-1a27-4baf-9b18-e2e5649da1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:27:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-398152432',display_name='tempest-VolumesGetTest-Volume-322776572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc24e0fa-e2a9-40b0-bfc8-e0c82008c530,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ecbcb594f540ed9eb6bbd6f6eda02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:27:48Z,use_quota=True,user_id='3b07719d39b2468bb6daaeeeb8feb831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a6d205fb-fef4-465a-8528-16dbbae56b33 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cafe7a78-4e18-4fed-bfbb-21192fffddbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a6d205fb-fef4-465a-8528-16dbbae56b33 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cafe7a78-4e18-4fed-bfbb-21192fffddbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a6d205fb-fef4-465a-8528-16dbbae56b33 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6fb955f-c818-4a85-9ae4-1cf1f6cf1ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a6d205fb-fef4-465a-8528-16dbbae56b33 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6fb955f-c818-4a85-9ae4-1cf1f6cf1ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc24e0fa-e2a9-40b0-bfc8-e0c82008c530', 'volume_name': 'volume-bc24e0fa-e2a9-40b0-bfc8-e0c82008c530', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a6d205fb-fef4-465a-8528-16dbbae56b33 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93810881-2717-4871-9430-010238bf36c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a6d205fb-fef4-465a-8528-16dbbae56b33 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93810881-2717-4871-9430-010238bf36c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a6d205fb-fef4-465a-8528-16dbbae56b33 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e452a24-de78-493c-8c87-8d254c0acd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:47 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-a6d205fb-fef4-465a-8528-16dbbae56b33 tempest-VolumesGetTest-41238149 None] Volume bc24e0fa-e2a9-40b0-bfc8-e0c82008c530: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc24e0fa-e2a9-40b0-bfc8-e0c82008c530', 'volume_size': 1} Jun 02 03:27:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a6d205fb-fef4-465a-8528-16dbbae56b33 tempest-VolumesGetTest-41238149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:48 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b4d35f1f-8590-4084-a02a-a8db8ea98c92 tempest-VolumesTransfersV357Test-1248625779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fe46ec20-43f6-40ac-bca9-132f81eaf669 1073741824" returned: 0 in 0.868s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b4d35f1f-8590-4084-a02a-a8db8ea98c92 tempest-VolumesTransfersV357Test-1248625779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fe46ec20-43f6-40ac-bca9-132f81eaf669 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:48 devstack sudo[98123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fe46ec20-43f6-40ac-bca9-132f81eaf669 Jun 02 03:27:48 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-f6cdc748-00e6-4875-af73-5370ee7900ac tempest-VolumesDeleteCascade-451749405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:48 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b4d35f1f-8590-4084-a02a-a8db8ea98c92 tempest-VolumesTransfersV357Test-1248625779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fe46ec20-43f6-40ac-bca9-132f81eaf669" returned: 0 in 0.614s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:48 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b4d35f1f-8590-4084-a02a-a8db8ea98c92 tempest-VolumesTransfersV357Test-1248625779 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:27:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b4d35f1f-8590-4084-a02a-a8db8ea98c92 tempest-VolumesTransfersV357Test-1248625779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a6d205fb-fef4-465a-8528-16dbbae56b33 tempest-VolumesGetTest-41238149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.762s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:48 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a6d205fb-fef4-465a-8528-16dbbae56b33 tempest-VolumesGetTest-41238149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:27:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-398152432',display_name='tempest-VolumesGetTest-Volume-322776572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc24e0fa-e2a9-40b0-bfc8-e0c82008c530,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ecbcb594f540ed9eb6bbd6f6eda02f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:27:48Z,use_quota=True,user_id='3b07719d39b2468bb6daaeeeb8feb831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:27:48 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-a6d205fb-fef4-465a-8528-16dbbae56b33 tempest-VolumesGetTest-41238149 None] Creating volume bc24e0fa-e2a9-40b0-bfc8-e0c82008c530 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:27:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a6d205fb-fef4-465a-8528-16dbbae56b33 tempest-VolumesGetTest-41238149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a6d205fb-fef4-465a-8528-16dbbae56b33 tempest-VolumesGetTest-41238149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:48 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a6d205fb-fef4-465a-8528-16dbbae56b33 tempest-VolumesGetTest-41238149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:27:48 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a6d205fb-fef4-465a-8528-16dbbae56b33 tempest-VolumesGetTest-41238149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:27:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a6d205fb-fef4-465a-8528-16dbbae56b33 tempest-VolumesGetTest-41238149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:48 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a6d205fb-fef4-465a-8528-16dbbae56b33 tempest-VolumesGetTest-41238149 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:27:48 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-a6d205fb-fef4-465a-8528-16dbbae56b33 tempest-VolumesGetTest-41238149 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:27:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a6d205fb-fef4-465a-8528-16dbbae56b33 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bc24e0fa-e2a9-40b0-bfc8-e0c82008c530 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:48 devstack sudo[98126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bc24e0fa-e2a9-40b0-bfc8-e0c82008c530 1073741824 Jun 02 03:27:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b4d35f1f-8590-4084-a02a-a8db8ea98c92 tempest-VolumesTransfersV357Test-1248625779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edfa7973-476e-4c03-8d2d-61df29b86f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe46ec20-43f6-40ac-bca9-132f81eaf669', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:48 devstack sudo[98126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b4d35f1f-8590-4084-a02a-a8db8ea98c92 tempest-VolumesTransfersV357Test-1248625779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (943cd3c4-27f3-4e20-8e6b-4d5b332e522c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:48 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-b4d35f1f-8590-4084-a02a-a8db8ea98c92 tempest-VolumesTransfersV357Test-1248625779 None] Volume volume-fe46ec20-43f6-40ac-bca9-132f81eaf669 (fe46ec20-43f6-40ac-bca9-132f81eaf669): created successfully Jun 02 03:27:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b4d35f1f-8590-4084-a02a-a8db8ea98c92 tempest-VolumesTransfersV357Test-1248625779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (943cd3c4-27f3-4e20-8e6b-4d5b332e522c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b4d35f1f-8590-4084-a02a-a8db8ea98c92 tempest-VolumesTransfersV357Test-1248625779 None] Flow 'volume_create_manager' (db91f620-3434-49f7-b065-6de2bd21f425) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:27:48 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-b4d35f1f-8590-4084-a02a-a8db8ea98c92 tempest-VolumesTransfersV357Test-1248625779 None] Created volume successfully. Jun 02 03:27:49 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-cecdf527-09cc-4d84-ad18-fc1a6d577f27 tempest-VolumesTransfersV357Test-1254692367 None] Acquiring lock "cinder-fe46ec20-43f6-40ac-bca9-132f81eaf669-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:27:49 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-cecdf527-09cc-4d84-ad18-fc1a6d577f27 tempest-VolumesTransfersV357Test-1254692367 None] Lock "cinder-fe46ec20-43f6-40ac-bca9-132f81eaf669-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:27:49 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-cecdf527-09cc-4d84-ad18-fc1a6d577f27 tempest-VolumesTransfersV357Test-1254692367 None] Acquiring lock "cinder-quobyte-fe46ec20-43f6-40ac-bca9-132f81eaf669" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:27:49 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-cecdf527-09cc-4d84-ad18-fc1a6d577f27 tempest-VolumesTransfersV357Test-1254692367 None] Lock "cinder-quobyte-fe46ec20-43f6-40ac-bca9-132f81eaf669" acquired by "delete_volume" :: waited 0.016s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:27:49 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d9f5f1-abce-4ed6-a2c7-cc0fe8ee6eec]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:27:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cecdf527-09cc-4d84-ad18-fc1a6d577f27 tempest-VolumesTransfersV357Test-1254692367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fe46ec20-43f6-40ac-bca9-132f81eaf669 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:49 devstack sudo[98131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fe46ec20-43f6-40ac-bca9-132f81eaf669 Jun 02 03:27:49 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:49 devstack sudo[98126]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a6d205fb-fef4-465a-8528-16dbbae56b33 tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bc24e0fa-e2a9-40b0-bfc8-e0c82008c530 1073741824" returned: 0 in 0.860s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a6d205fb-fef4-465a-8528-16dbbae56b33 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bc24e0fa-e2a9-40b0-bfc8-e0c82008c530 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:49 devstack sudo[98134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bc24e0fa-e2a9-40b0-bfc8-e0c82008c530 Jun 02 03:27:49 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:50 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cecdf527-09cc-4d84-ad18-fc1a6d577f27 tempest-VolumesTransfersV357Test-1254692367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fe46ec20-43f6-40ac-bca9-132f81eaf669" returned: 0 in 0.742s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cecdf527-09cc-4d84-ad18-fc1a6d577f27 tempest-VolumesTransfersV357Test-1254692367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fe46ec20-43f6-40ac-bca9-132f81eaf669 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:50 devstack sudo[98139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fe46ec20-43f6-40ac-bca9-132f81eaf669 Jun 02 03:27:50 devstack sudo[98139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:50 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a6d205fb-fef4-465a-8528-16dbbae56b33 tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bc24e0fa-e2a9-40b0-bfc8-e0c82008c530" returned: 0 in 0.572s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:50 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a6d205fb-fef4-465a-8528-16dbbae56b33 tempest-VolumesGetTest-41238149 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:27:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a6d205fb-fef4-465a-8528-16dbbae56b33 tempest-VolumesGetTest-41238149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-f6cdc748-00e6-4875-af73-5370ee7900ac tempest-VolumesDeleteCascade-451749405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.031s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:50 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a6d205fb-fef4-465a-8528-16dbbae56b33 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e452a24-de78-493c-8c87-8d254c0acd37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc24e0fa-e2a9-40b0-bfc8-e0c82008c530', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:50 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a6d205fb-fef4-465a-8528-16dbbae56b33 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9a8896f-d6ee-469b-9524-8eefffd8e225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:50 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-f6cdc748-00e6-4875-af73-5370ee7900ac tempest-VolumesDeleteCascade-451749405 None] Creating offline snapshot bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb of volume b1abe29c-558e-46a0-b349-37f07f89f5bd {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:27:50 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-a6d205fb-fef4-465a-8528-16dbbae56b33 tempest-VolumesGetTest-41238149 None] Volume volume-bc24e0fa-e2a9-40b0-bfc8-e0c82008c530 (bc24e0fa-e2a9-40b0-bfc8-e0c82008c530): created successfully Jun 02 03:27:50 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a6d205fb-fef4-465a-8528-16dbbae56b33 tempest-VolumesGetTest-41238149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9a8896f-d6ee-469b-9524-8eefffd8e225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:50 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a6d205fb-fef4-465a-8528-16dbbae56b33 tempest-VolumesGetTest-41238149 None] Flow 'volume_create_manager' (276fc794-5dba-411d-aa78-a47e50754668) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:27:50 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4ac3cb-81f6-483f-9dae-6ed3cdb1236c]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:27:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f6cdc748-00e6-4875-af73-5370ee7900ac tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:50 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-a6d205fb-fef4-465a-8528-16dbbae56b33 tempest-VolumesGetTest-41238149 None] Created volume successfully. Jun 02 03:27:50 devstack sudo[98142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd Jun 02 03:27:50 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:50 devstack sudo[98139]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cecdf527-09cc-4d84-ad18-fc1a6d577f27 tempest-VolumesTransfersV357Test-1254692367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fe46ec20-43f6-40ac-bca9-132f81eaf669" returned: 0 in 0.664s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:50 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-cecdf527-09cc-4d84-ad18-fc1a6d577f27 tempest-VolumesTransfersV357Test-1254692367 None] Lock "cinder-quobyte-fe46ec20-43f6-40ac-bca9-132f81eaf669" released by "delete_volume" :: held 1.451s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:27:50 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-cecdf527-09cc-4d84-ad18-fc1a6d577f27 tempest-VolumesTransfersV357Test-1254692367 None] Created reservations ['73dbfe59-3696-4fee-bc42-0ebf5db9b778', 'fb4341ad-6e09-451f-aa23-61e1c8c08ad2', '254921fe-b668-409c-b3ee-490908ad00ee', 'fe8c5119-fcb8-4877-949a-a7f4ef0a1d6f'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:27:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-cecdf527-09cc-4d84-ad18-fc1a6d577f27 tempest-VolumesTransfersV357Test-1254692367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-cecdf527-09cc-4d84-ad18-fc1a6d577f27 tempest-VolumesTransfersV357Test-1254692367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:50 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-cecdf527-09cc-4d84-ad18-fc1a6d577f27 tempest-VolumesTransfersV357Test-1254692367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:27:50 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-cecdf527-09cc-4d84-ad18-fc1a6d577f27 tempest-VolumesTransfersV357Test-1254692367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:27:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-cecdf527-09cc-4d84-ad18-fc1a6d577f27 tempest-VolumesTransfersV357Test-1254692367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cecdf527-09cc-4d84-ad18-fc1a6d577f27 tempest-VolumesTransfersV357Test-1254692367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:50 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:27:50 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:51 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f6cdc748-00e6-4875-af73-5370ee7900ac tempest-VolumesDeleteCascade-451749405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd" returned: 0 in 0.776s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f6cdc748-00e6-4875-af73-5370ee7900ac tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd.bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:51 devstack sudo[98150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd.bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb 1G Jun 02 03:27:51 devstack sudo[98150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:51 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0513ea03-9534-4408-b676-9085b509e749 tempest-VolumesGetTest-41238149 None] Acquiring lock "cinder-bc24e0fa-e2a9-40b0-bfc8-e0c82008c530-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:27:51 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0513ea03-9534-4408-b676-9085b509e749 tempest-VolumesGetTest-41238149 None] Lock "cinder-bc24e0fa-e2a9-40b0-bfc8-e0c82008c530-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:27:51 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0513ea03-9534-4408-b676-9085b509e749 tempest-VolumesGetTest-41238149 None] Acquiring lock "cinder-quobyte-bc24e0fa-e2a9-40b0-bfc8-e0c82008c530" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:27:51 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0513ea03-9534-4408-b676-9085b509e749 tempest-VolumesGetTest-41238149 None] Lock "cinder-quobyte-bc24e0fa-e2a9-40b0-bfc8-e0c82008c530" acquired by "delete_volume" :: waited 0.026s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:27:51 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d202fb-5dec-4907-ace3-1780909383b3]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:27:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0513ea03-9534-4408-b676-9085b509e749 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bc24e0fa-e2a9-40b0-bfc8-e0c82008c530 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:51 devstack sudo[98152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bc24e0fa-e2a9-40b0-bfc8-e0c82008c530 Jun 02 03:27:51 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:51 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cecdf527-09cc-4d84-ad18-fc1a6d577f27 tempest-VolumesTransfersV357Test-1254692367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.934s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:51 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-cecdf527-09cc-4d84-ad18-fc1a6d577f27 tempest-VolumesTransfersV357Test-1254692367 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:27:51 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-cecdf527-09cc-4d84-ad18-fc1a6d577f27 tempest-VolumesTransfersV357Test-1254692367 None] Deleted volume successfully. Jun 02 03:27:51 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-cecdf527-09cc-4d84-ad18-fc1a6d577f27 tempest-VolumesTransfersV357Test-1254692367 None] Lock "cinder-fe46ec20-43f6-40ac-bca9-132f81eaf669-delete_volume" released by "delete_volume" :: held 2.626s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:27:52 devstack sudo[98150]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f6cdc748-00e6-4875-af73-5370ee7900ac tempest-VolumesDeleteCascade-451749405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd.bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb 1G" returned: 0 in 1.265s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f6cdc748-00e6-4875-af73-5370ee7900ac tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1abe29c-558e-46a0-b349-37f07f89f5bd -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd.bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:52 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1abe29c-558e-46a0-b349-37f07f89f5bd -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd.bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb Jun 02 03:27:52 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:52 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0513ea03-9534-4408-b676-9085b509e749 tempest-VolumesGetTest-41238149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bc24e0fa-e2a9-40b0-bfc8-e0c82008c530" returned: 0 in 1.136s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0513ea03-9534-4408-b676-9085b509e749 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bc24e0fa-e2a9-40b0-bfc8-e0c82008c530 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:52 devstack sudo[98163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bc24e0fa-e2a9-40b0-bfc8-e0c82008c530 Jun 02 03:27:52 devstack sudo[98163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:53 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f6cdc748-00e6-4875-af73-5370ee7900ac tempest-VolumesDeleteCascade-451749405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1abe29c-558e-46a0-b349-37f07f89f5bd -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd.bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb" returned: 0 in 0.877s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:53 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-f6cdc748-00e6-4875-af73-5370ee7900ac tempest-VolumesDeleteCascade-451749405 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd.bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb is being set with open permissions: ugo+rw Jun 02 03:27:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f6cdc748-00e6-4875-af73-5370ee7900ac tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd.bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:53 devstack sudo[98174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd.bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb Jun 02 03:27:53 devstack sudo[98174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:53 devstack sudo[98163]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0513ea03-9534-4408-b676-9085b509e749 tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bc24e0fa-e2a9-40b0-bfc8-e0c82008c530" returned: 0 in 0.741s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:53 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0513ea03-9534-4408-b676-9085b509e749 tempest-VolumesGetTest-41238149 None] Lock "cinder-quobyte-bc24e0fa-e2a9-40b0-bfc8-e0c82008c530" released by "delete_volume" :: held 1.957s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:27:53 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-0513ea03-9534-4408-b676-9085b509e749 tempest-VolumesGetTest-41238149 None] Created reservations ['9f786014-720a-49b3-b97b-a3595f7bccd2', '64764d69-bcec-4e3f-a481-1b6561c4bf06', '593c3a47-67be-4665-b753-3cd9af7ca863', 'e267e04c-5e0a-4b65-8dca-a08e53413e0a'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:27:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0513ea03-9534-4408-b676-9085b509e749 tempest-VolumesGetTest-41238149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0513ea03-9534-4408-b676-9085b509e749 tempest-VolumesGetTest-41238149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:53 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0513ea03-9534-4408-b676-9085b509e749 tempest-VolumesGetTest-41238149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:27:53 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0513ea03-9534-4408-b676-9085b509e749 tempest-VolumesGetTest-41238149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:27:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0513ea03-9534-4408-b676-9085b509e749 tempest-VolumesGetTest-41238149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0513ea03-9534-4408-b676-9085b509e749 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:53 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:27:53 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:53 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5ffc2eef-38a6-4dd3-b9b2-55f715e737e7 tempest-VolumesGetTest-41238149 None] Acquiring lock "cinder-dfbce9cc-7c30-4077-9740-632141d09505-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:27:53 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5ffc2eef-38a6-4dd3-b9b2-55f715e737e7 tempest-VolumesGetTest-41238149 None] Lock "cinder-dfbce9cc-7c30-4077-9740-632141d09505-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:27:53 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5ffc2eef-38a6-4dd3-b9b2-55f715e737e7 tempest-VolumesGetTest-41238149 None] Acquiring lock "cinder-quobyte-dfbce9cc-7c30-4077-9740-632141d09505" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:27:53 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5ffc2eef-38a6-4dd3-b9b2-55f715e737e7 tempest-VolumesGetTest-41238149 None] Lock "cinder-quobyte-dfbce9cc-7c30-4077-9740-632141d09505" acquired by "delete_volume" :: waited 0.026s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:27:53 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[864bab98-5f2f-4a43-ba03-64bfc3aa45a8]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:27:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5ffc2eef-38a6-4dd3-b9b2-55f715e737e7 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-dfbce9cc-7c30-4077-9740-632141d09505 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:54 devstack sudo[98190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-dfbce9cc-7c30-4077-9740-632141d09505 Jun 02 03:27:54 devstack sudo[98190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:54 devstack sudo[98174]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f6cdc748-00e6-4875-af73-5370ee7900ac tempest-VolumesDeleteCascade-451749405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd.bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb" returned: 0 in 1.207s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f6cdc748-00e6-4875-af73-5370ee7900ac tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:54 devstack sudo[98194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd.info Jun 02 03:27:54 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:54 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0513ea03-9534-4408-b676-9085b509e749 tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.945s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:54 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-0513ea03-9534-4408-b676-9085b509e749 tempest-VolumesGetTest-41238149 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:27:54 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-0513ea03-9534-4408-b676-9085b509e749 tempest-VolumesGetTest-41238149 None] Deleted volume successfully. Jun 02 03:27:54 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0513ea03-9534-4408-b676-9085b509e749 tempest-VolumesGetTest-41238149 None] Lock "cinder-bc24e0fa-e2a9-40b0-bfc8-e0c82008c530-delete_volume" released by "delete_volume" :: held 3.248s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:27:54 devstack sudo[98190]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5ffc2eef-38a6-4dd3-b9b2-55f715e737e7 tempest-VolumesGetTest-41238149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-dfbce9cc-7c30-4077-9740-632141d09505" returned: 0 in 1.033s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5ffc2eef-38a6-4dd3-b9b2-55f715e737e7 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-dfbce9cc-7c30-4077-9740-632141d09505 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:55 devstack sudo[98198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-dfbce9cc-7c30-4077-9740-632141d09505 Jun 02 03:27:55 devstack sudo[98198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:55 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f6cdc748-00e6-4875-af73-5370ee7900ac tempest-VolumesDeleteCascade-451749405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd.info" returned: 0 in 0.687s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:55 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-f6cdc748-00e6-4875-af73-5370ee7900ac tempest-VolumesDeleteCascade-451749405 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd.info is being set with open permissions: ugo+rw Jun 02 03:27:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f6cdc748-00e6-4875-af73-5370ee7900ac tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:55 devstack sudo[98201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd.info Jun 02 03:27:55 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:55 devstack sudo[98198]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5ffc2eef-38a6-4dd3-b9b2-55f715e737e7 tempest-VolumesGetTest-41238149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-dfbce9cc-7c30-4077-9740-632141d09505" returned: 1 in 0.878s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5ffc2eef-38a6-4dd3-b9b2-55f715e737e7 tempest-VolumesGetTest-41238149 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-dfbce9cc-7c30-4077-9740-632141d09505' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:27:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5ffc2eef-38a6-4dd3-b9b2-55f715e737e7 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-dfbce9cc-7c30-4077-9740-632141d09505 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:55 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f6cdc748-00e6-4875-af73-5370ee7900ac tempest-VolumesDeleteCascade-451749405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd.info" returned: 0 in 0.731s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:55 devstack sudo[98207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-dfbce9cc-7c30-4077-9740-632141d09505 Jun 02 03:27:55 devstack sudo[98207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-f6cdc748-00e6-4875-af73-5370ee7900ac tempest-VolumesDeleteCascade-451749405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.693s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:55 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-f6cdc748-00e6-4875-af73-5370ee7900ac tempest-VolumesDeleteCascade-451749405 None] Create snapshot completed successfully Jun 02 03:27:56 devstack sudo[98207]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5ffc2eef-38a6-4dd3-b9b2-55f715e737e7 tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-dfbce9cc-7c30-4077-9740-632141d09505" returned: 0 in 0.661s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:56 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5ffc2eef-38a6-4dd3-b9b2-55f715e737e7 tempest-VolumesGetTest-41238149 None] Lock "cinder-quobyte-dfbce9cc-7c30-4077-9740-632141d09505" released by "delete_volume" :: held 2.678s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:27:56 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-5ffc2eef-38a6-4dd3-b9b2-55f715e737e7 tempest-VolumesGetTest-41238149 None] Created reservations ['188ce3e0-99d8-4419-9d1c-b196771a04d5', 'e41089d0-1dd1-424b-bafe-c7f045350def', '5e9f9e6e-bf5c-4bdf-ac09-fdbf96f4859b', '2cd6a18b-fa98-4be4-a773-97cb3592fcba'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:27:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5ffc2eef-38a6-4dd3-b9b2-55f715e737e7 tempest-VolumesGetTest-41238149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5ffc2eef-38a6-4dd3-b9b2-55f715e737e7 tempest-VolumesGetTest-41238149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:56 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-5ffc2eef-38a6-4dd3-b9b2-55f715e737e7 tempest-VolumesGetTest-41238149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:27:56 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-5ffc2eef-38a6-4dd3-b9b2-55f715e737e7 tempest-VolumesGetTest-41238149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:27:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5ffc2eef-38a6-4dd3-b9b2-55f715e737e7 tempest-VolumesGetTest-41238149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5ffc2eef-38a6-4dd3-b9b2-55f715e737e7 tempest-VolumesGetTest-41238149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:56 devstack sudo[98210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:27:56 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:57 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:27:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Flow 'volume_create_manager' (81f9baa8-2da9-47d9-a41e-2d54c5737909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:27:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a49d3f-d857-4199-bbc5-84850d072960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a49d3f-d857-4199-bbc5-84850d072960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-512030164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2884c8e6-e7c9-4b99-bfac-97f7270f41a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff2e68c2b8a44d478abefd101c9ba76d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:27:57Z,use_quota=True,user_id='57230c43bfc04a86a8d4f033f6831d1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee46c18-7418-4fde-bcaa-5dee1593ee5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee46c18-7418-4fde-bcaa-5dee1593ee5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe55e2f2-93fc-462b-9e34-e8871ff10f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe55e2f2-93fc-462b-9e34-e8871ff10f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2884c8e6-e7c9-4b99-bfac-97f7270f41a9', 'volume_name': 'volume-2884c8e6-e7c9-4b99-bfac-97f7270f41a9', 'volume_size': 1, 'snapshot_id': 'bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb'}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14aa071e-1e16-4f96-b571-c651b200fcc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14aa071e-1e16-4f96-b571-c651b200fcc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:27:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae95722b-62ce-45c5-810d-4882d2f786e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:27:57 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Volume 2884c8e6-e7c9-4b99-bfac-97f7270f41a9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2884c8e6-e7c9-4b99-bfac-97f7270f41a9', 'volume_size': 1, 'snapshot_id': 'bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb'} Jun 02 03:27:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:57 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Acquiring lock "cinder-quobyte-bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb-2884c8e6-e7c9-4b99-bfac-97f7270f41a9" by "_create_volume_from_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:27:57 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Lock "cinder-quobyte-bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb-2884c8e6-e7c9-4b99-bfac-97f7270f41a9" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:27:57 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Creating volume 2884c8e6-e7c9-4b99-bfac-97f7270f41a9 from snapshot bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb {{(pid=86431) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 02 03:27:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:57 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:27:57 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:27:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:57 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:27:57 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Acquiring lock "cinder-quobyte-2884c8e6-e7c9-4b99-bfac-97f7270f41a9" by "_copy_volume_from_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:27:57 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Lock "cinder-quobyte-2884c8e6-e7c9-4b99-bfac-97f7270f41a9" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:27:57 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] snapshot: bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb, volume: 2884c8e6-e7c9-4b99-bfac-97f7270f41a9, {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 03:27:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:27:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:27:57 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:27:57 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:27:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:27:57 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaabdd75-647a-47f1-9ee7-cc0c67a3f16f]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:27:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd.bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:57 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5ffc2eef-38a6-4dd3-b9b2-55f715e737e7 tempest-VolumesGetTest-41238149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.893s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:57 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-5ffc2eef-38a6-4dd3-b9b2-55f715e737e7 tempest-VolumesGetTest-41238149 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:27:57 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-5ffc2eef-38a6-4dd3-b9b2-55f715e737e7 tempest-VolumesGetTest-41238149 None] Deleted volume successfully. Jun 02 03:27:57 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5ffc2eef-38a6-4dd3-b9b2-55f715e737e7 tempest-VolumesGetTest-41238149 None] Lock "cinder-dfbce9cc-7c30-4077-9740-632141d09505-delete_volume" released by "delete_volume" :: held 3.858s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:27:57 devstack sudo[98213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd.bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb Jun 02 03:27:57 devstack sudo[98213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:58 devstack sudo[98213]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd.bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb" returned: 0 in 0.888s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:58 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1abe29c-558e-46a0-b349-37f07f89f5bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:27:58 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 03:27:58 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Creating direct copy from snapshot {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 03:27:58 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec7c482-8982-4c00-a018-843c1e2c136f]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:27:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:58 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd Jun 02 03:27:58 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:27:59 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Jun 02 03:27:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd" returned: 0 in 0.824s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:27:59 devstack cinder-volume[86431]: DEBUG cinder.utils [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Path /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2884c8e6-e7c9-4b99-bfac-97f7270f41a9 not found in is_blk_device check {{(pid=86431) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 02 03:27:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2884c8e6-e7c9-4b99-bfac-97f7270f41a9 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:27:59 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2884c8e6-e7c9-4b99-bfac-97f7270f41a9 Jun 02 03:27:59 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:07 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=67,cinder:INSERT=32,cinder:UPDATE=91,cinder:DELETE=5 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:28:07 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:UPDATE=90,cinder:SELECT=71,cinder:DELETE=10,cinder:INSERT=25 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:28:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2884c8e6-e7c9-4b99-bfac-97f7270f41a9" returned: 0 in 8.979s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:08 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f20034b-7f1b-4a7e-9075-c8ce207ee812]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:28:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:08 devstack sudo[98308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd Jun 02 03:28:08 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:09 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:28:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:28:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:28:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:28:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:28:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:28:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:09 devstack sudo[98315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:28:09 devstack sudo[98315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:10 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-83313d71-6844-4ee3-b106-6e27214ac4f7 tempest-VolumesSnapshotListTestJSON-148761306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:28:10 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-83313d71-6844-4ee3-b106-6e27214ac4f7 tempest-VolumesSnapshotListTestJSON-148761306 None] Flow 'volume_create_manager' (ad824190-0f2e-47a7-acbe-588a5e5b7ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:28:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-83313d71-6844-4ee3-b106-6e27214ac4f7 tempest-VolumesSnapshotListTestJSON-148761306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e8f13cb-6bc2-4536-9af6-f338218e0c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:28:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd" returned: 0 in 2.089s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:10 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Image conversion details: src /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd, size 1024.00 MB, duration 8.98 sec, destination /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2884c8e6-e7c9-4b99-bfac-97f7270f41a9 {{(pid=86431) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 02 03:28:10 devstack cinder-volume[86431]: INFO cinder.image.image_utils [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Converted 1024.00 MB image at 114.03 MB/s Jun 02 03:28:10 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2884c8e6-e7c9-4b99-bfac-97f7270f41a9 is being set with open permissions: ugo+rw Jun 02 03:28:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2884c8e6-e7c9-4b99-bfac-97f7270f41a9 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:10 devstack sudo[98315]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.933s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:10 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:28:10 devstack sudo[98321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2884c8e6-e7c9-4b99-bfac-97f7270f41a9 Jun 02 03:28:10 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-83313d71-6844-4ee3-b106-6e27214ac4f7 tempest-VolumesSnapshotListTestJSON-148761306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e8f13cb-6bc2-4536-9af6-f338218e0c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-314943358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd19c8a9-9420-4a66-bbab-a4de69e16602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2473eaa7d694a8e9b17b2797a67c623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:28:10Z,use_quota=True,user_id='360d8b84d5a34685a143b0a49633f519',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:28:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-83313d71-6844-4ee3-b106-6e27214ac4f7 tempest-VolumesSnapshotListTestJSON-148761306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3950151d-dd10-4c12-9509-0e2c43471788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:28:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-83313d71-6844-4ee3-b106-6e27214ac4f7 tempest-VolumesSnapshotListTestJSON-148761306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3950151d-dd10-4c12-9509-0e2c43471788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:28:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-83313d71-6844-4ee3-b106-6e27214ac4f7 tempest-VolumesSnapshotListTestJSON-148761306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0ab4592-7c67-473d-a7a0-2c05ef61a284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:28:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-83313d71-6844-4ee3-b106-6e27214ac4f7 tempest-VolumesSnapshotListTestJSON-148761306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0ab4592-7c67-473d-a7a0-2c05ef61a284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd19c8a9-9420-4a66-bbab-a4de69e16602', 'volume_name': 'volume-fd19c8a9-9420-4a66-bbab-a4de69e16602', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:28:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-83313d71-6844-4ee3-b106-6e27214ac4f7 tempest-VolumesSnapshotListTestJSON-148761306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (041be771-669f-4cdb-83e7-72bfdd61af29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:28:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-83313d71-6844-4ee3-b106-6e27214ac4f7 tempest-VolumesSnapshotListTestJSON-148761306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (041be771-669f-4cdb-83e7-72bfdd61af29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:28:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-83313d71-6844-4ee3-b106-6e27214ac4f7 tempest-VolumesSnapshotListTestJSON-148761306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22027169-3d62-41fe-bd31-b7851df3512c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:28:10 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-83313d71-6844-4ee3-b106-6e27214ac4f7 tempest-VolumesSnapshotListTestJSON-148761306 None] Volume fd19c8a9-9420-4a66-bbab-a4de69e16602: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd19c8a9-9420-4a66-bbab-a4de69e16602', 'volume_size': 1} Jun 02 03:28:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-83313d71-6844-4ee3-b106-6e27214ac4f7 tempest-VolumesSnapshotListTestJSON-148761306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:28:10 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager._thread_info {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:28:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread count: 28 {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 02 03:28:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread info: [<_MainThread(MainThread, started 138618128814208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 02 03:28:11 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2884c8e6-e7c9-4b99-bfac-97f7270f41a9" returned: 0 in 0.772s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:11 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Lock "cinder-quobyte-2884c8e6-e7c9-4b99-bfac-97f7270f41a9" released by "_copy_volume_from_snapshot" :: held 13.706s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:28:11 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Lock "cinder-quobyte-bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb-2884c8e6-e7c9-4b99-bfac-97f7270f41a9" released by "_create_volume_from_snapshot" :: held 13.749s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:28:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.769s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:28:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-83313d71-6844-4ee3-b106-6e27214ac4f7 tempest-VolumesSnapshotListTestJSON-148761306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.658s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:28:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-83313d71-6844-4ee3-b106-6e27214ac4f7 tempest-VolumesSnapshotListTestJSON-148761306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-314943358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd19c8a9-9420-4a66-bbab-a4de69e16602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2473eaa7d694a8e9b17b2797a67c623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:28:10Z,use_quota=True,user_id='360d8b84d5a34685a143b0a49633f519',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:28:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-83313d71-6844-4ee3-b106-6e27214ac4f7 tempest-VolumesSnapshotListTestJSON-148761306 None] Creating volume fd19c8a9-9420-4a66-bbab-a4de69e16602 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:28:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-83313d71-6844-4ee3-b106-6e27214ac4f7 tempest-VolumesSnapshotListTestJSON-148761306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:28:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-83313d71-6844-4ee3-b106-6e27214ac4f7 tempest-VolumesSnapshotListTestJSON-148761306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:28:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-83313d71-6844-4ee3-b106-6e27214ac4f7 tempest-VolumesSnapshotListTestJSON-148761306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:28:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-83313d71-6844-4ee3-b106-6e27214ac4f7 tempest-VolumesSnapshotListTestJSON-148761306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:28:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-83313d71-6844-4ee3-b106-6e27214ac4f7 tempest-VolumesSnapshotListTestJSON-148761306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:28:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-83313d71-6844-4ee3-b106-6e27214ac4f7 tempest-VolumesSnapshotListTestJSON-148761306 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:28:11 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-83313d71-6844-4ee3-b106-6e27214ac4f7 tempest-VolumesSnapshotListTestJSON-148761306 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:28:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-83313d71-6844-4ee3-b106-6e27214ac4f7 tempest-VolumesSnapshotListTestJSON-148761306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:11 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602 1073741824 Jun 02 03:28:11 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae95722b-62ce-45c5-810d-4882d2f786e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2884c8e6-e7c9-4b99-bfac-97f7270f41a9', 'volume_size': 1, 'snapshot_id': 'bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb'}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:28:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ecc638c-3163-4ea9-a44c-03e865b40a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:28:11 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Volume volume-2884c8e6-e7c9-4b99-bfac-97f7270f41a9 (2884c8e6-e7c9-4b99-bfac-97f7270f41a9): created successfully Jun 02 03:28:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ecc638c-3163-4ea9-a44c-03e865b40a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:28:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Flow 'volume_create_manager' (81f9baa8-2da9-47d9-a41e-2d54c5737909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:28:11 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-09114dd6-8ee1-4ab9-9e2a-a760f410d187 tempest-VolumesDeleteCascade-451749405 None] Created volume successfully. Jun 02 03:28:12 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-83313d71-6844-4ee3-b106-6e27214ac4f7 tempest-VolumesSnapshotListTestJSON-148761306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602 1073741824" returned: 0 in 1.186s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-83313d71-6844-4ee3-b106-6e27214ac4f7 tempest-VolumesSnapshotListTestJSON-148761306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:12 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Acquiring lock "cinder-b1abe29c-558e-46a0-b349-37f07f89f5bd-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:28:12 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Lock "cinder-b1abe29c-558e-46a0-b349-37f07f89f5bd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:28:12 devstack sudo[98331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602 Jun 02 03:28:12 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:12 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Performing cascade delete. {{(pid=86431) delete_volume /opt/stack/cinder/cinder/volume/manager.py:996}} Jun 02 03:28:12 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Acquiring lock "cinder-bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb-delete_snapshot" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:28:12 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Lock "cinder-bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:28:12 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Acquiring lock "cinder-quobyte-b1abe29c-558e-46a0-b349-37f07f89f5bd" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:28:12 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Lock "cinder-quobyte-b1abe29c-558e-46a0-b349-37f07f89f5bd" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:28:12 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Acquiring lock "cinder-quobyte-bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:28:12 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Lock "cinder-quobyte-bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:28:12 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Deleting offline snapshot bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb of volume b1abe29c-558e-46a0-b349-37f07f89f5bd {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:28:12 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] snapshot_file for this snap is: volume-b1abe29c-558e-46a0-b349-37f07f89f5bd.bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:28:12 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca51db0-a811-4b3f-ad77-ea10a0bb9907]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:28:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd.bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:12 devstack sudo[98334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd.bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb Jun 02 03:28:12 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:13 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-83313d71-6844-4ee3-b106-6e27214ac4f7 tempest-VolumesSnapshotListTestJSON-148761306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602" returned: 0 in 0.818s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:13 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-83313d71-6844-4ee3-b106-6e27214ac4f7 tempest-VolumesSnapshotListTestJSON-148761306 None] <== create_volume: return (2091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:28:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-83313d71-6844-4ee3-b106-6e27214ac4f7 tempest-VolumesSnapshotListTestJSON-148761306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.094s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:28:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-83313d71-6844-4ee3-b106-6e27214ac4f7 tempest-VolumesSnapshotListTestJSON-148761306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22027169-3d62-41fe-bd31-b7851df3512c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd19c8a9-9420-4a66-bbab-a4de69e16602', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:28:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-83313d71-6844-4ee3-b106-6e27214ac4f7 tempest-VolumesSnapshotListTestJSON-148761306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (313f76be-9f85-4d52-98cb-97b48c586079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:28:13 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-83313d71-6844-4ee3-b106-6e27214ac4f7 tempest-VolumesSnapshotListTestJSON-148761306 None] Volume volume-fd19c8a9-9420-4a66-bbab-a4de69e16602 (fd19c8a9-9420-4a66-bbab-a4de69e16602): created successfully Jun 02 03:28:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-83313d71-6844-4ee3-b106-6e27214ac4f7 tempest-VolumesSnapshotListTestJSON-148761306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (313f76be-9f85-4d52-98cb-97b48c586079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:28:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-83313d71-6844-4ee3-b106-6e27214ac4f7 tempest-VolumesSnapshotListTestJSON-148761306 None] Flow 'volume_create_manager' (ad824190-0f2e-47a7-acbe-588a5e5b7ebe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:28:13 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-83313d71-6844-4ee3-b106-6e27214ac4f7 tempest-VolumesSnapshotListTestJSON-148761306 None] Created volume successfully. Jun 02 03:28:13 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd.bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb" returned: 0 in 1.090s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:13 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1abe29c-558e-46a0-b349-37f07f89f5bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:28:13 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[181ba390-2df6-4afc-952d-bf7dc8a733a5]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:28:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1bae61de-222a-4bd2-b9db-abfe6d8d1de3 tempest-VolumesSnapshotListTestJSON-148761306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:28:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1bae61de-222a-4bd2-b9db-abfe6d8d1de3 tempest-VolumesSnapshotListTestJSON-148761306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:28:14 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-1bae61de-222a-4bd2-b9db-abfe6d8d1de3 tempest-VolumesSnapshotListTestJSON-148761306 None] Creating offline snapshot bee4363a-bdda-48c2-928f-452c0c7a1b53 of volume fd19c8a9-9420-4a66-bbab-a4de69e16602 {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:28:14 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[7158b3e5-637d-470a-9165-8c99da1ea103]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:28:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1bae61de-222a-4bd2-b9db-abfe6d8d1de3 tempest-VolumesSnapshotListTestJSON-148761306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:14 devstack sudo[98366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd Jun 02 03:28:14 devstack sudo[98366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:14 devstack sudo[98367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602 Jun 02 03:28:14 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:14 devstack sudo[98366]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd" returned: 0 in 0.824s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd.bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:14 devstack sudo[98377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd.bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb Jun 02 03:28:14 devstack sudo[98377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:14 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1bae61de-222a-4bd2-b9db-abfe6d8d1de3 tempest-VolumesSnapshotListTestJSON-148761306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602" returned: 0 in 0.753s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1bae61de-222a-4bd2-b9db-abfe6d8d1de3 tempest-VolumesSnapshotListTestJSON-148761306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.bee4363a-bdda-48c2-928f-452c0c7a1b53 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:14 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.bee4363a-bdda-48c2-928f-452c0c7a1b53 1G Jun 02 03:28:14 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:15 devstack sudo[98377]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd.bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb" returned: 0 in 0.810s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd.bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:15 devstack sudo[98390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd.bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb Jun 02 03:28:15 devstack sudo[98390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:15 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1bae61de-222a-4bd2-b9db-abfe6d8d1de3 tempest-VolumesSnapshotListTestJSON-148761306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.bee4363a-bdda-48c2-928f-452c0c7a1b53 1G" returned: 0 in 0.827s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1bae61de-222a-4bd2-b9db-abfe6d8d1de3 tempest-VolumesSnapshotListTestJSON-148761306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd19c8a9-9420-4a66-bbab-a4de69e16602 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.bee4363a-bdda-48c2-928f-452c0c7a1b53 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:15 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd19c8a9-9420-4a66-bbab-a4de69e16602 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.bee4363a-bdda-48c2-928f-452c0c7a1b53 Jun 02 03:28:15 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:16 devstack sudo[98390]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd.bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb" returned: 0 in 0.646s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:16 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Lock "cinder-quobyte-bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb" released by "_delete_snapshot" :: held 3.514s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:28:16 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Lock "cinder-quobyte-b1abe29c-558e-46a0-b349-37f07f89f5bd" released by "delete_snapshot" :: held 3.544s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:28:16 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Created reservations ['685a774a-cb2a-40f2-bf87-5712ed2e428d', '2e5b5475-9ecb-4694-9812-e6ef6e3abeb0', 'e92806c1-5e9d-497a-b5ae-eb83f7b1566f', '02ca34c8-4347-48bd-9185-777b0cfc195c'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:28:16 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1bae61de-222a-4bd2-b9db-abfe6d8d1de3 tempest-VolumesSnapshotListTestJSON-148761306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd19c8a9-9420-4a66-bbab-a4de69e16602 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.bee4363a-bdda-48c2-928f-452c0c7a1b53" returned: 0 in 0.707s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:16 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-1bae61de-222a-4bd2-b9db-abfe6d8d1de3 tempest-VolumesSnapshotListTestJSON-148761306 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.bee4363a-bdda-48c2-928f-452c0c7a1b53 is being set with open permissions: ugo+rw Jun 02 03:28:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1bae61de-222a-4bd2-b9db-abfe6d8d1de3 tempest-VolumesSnapshotListTestJSON-148761306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.bee4363a-bdda-48c2-928f-452c0c7a1b53 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:16 devstack sudo[98398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.bee4363a-bdda-48c2-928f-452c0c7a1b53 Jun 02 03:28:16 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:16 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Delete snapshot completed successfully. Jun 02 03:28:16 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Lock "cinder-bdfbe5f9-a9bb-40a0-8eb3-eb6c66ed75fb-delete_snapshot" released by "delete_snapshot" :: held 3.753s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:28:16 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Snapshots deleted, issuing volume delete {{(pid=86431) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1011}} Jun 02 03:28:16 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Acquiring lock "cinder-quobyte-b1abe29c-558e-46a0-b349-37f07f89f5bd" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:28:16 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Lock "cinder-quobyte-b1abe29c-558e-46a0-b349-37f07f89f5bd" acquired by "delete_volume" :: waited 0.021s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:28:16 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f0b2d7-d203-45d2-8634-d7099210acb4]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:28:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:16 devstack sudo[98400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd Jun 02 03:28:16 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:16 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1bae61de-222a-4bd2-b9db-abfe6d8d1de3 tempest-VolumesSnapshotListTestJSON-148761306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.bee4363a-bdda-48c2-928f-452c0c7a1b53" returned: 0 in 0.597s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1bae61de-222a-4bd2-b9db-abfe6d8d1de3 tempest-VolumesSnapshotListTestJSON-148761306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:17 devstack sudo[98403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.info Jun 02 03:28:17 devstack sudo[98403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:17 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd" returned: 0 in 0.820s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:17 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd Jun 02 03:28:17 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:17 devstack sudo[98403]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1bae61de-222a-4bd2-b9db-abfe6d8d1de3 tempest-VolumesSnapshotListTestJSON-148761306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.info" returned: 0 in 0.722s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:17 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-1bae61de-222a-4bd2-b9db-abfe6d8d1de3 tempest-VolumesSnapshotListTestJSON-148761306 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.info is being set with open permissions: ugo+rw Jun 02 03:28:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1bae61de-222a-4bd2-b9db-abfe6d8d1de3 tempest-VolumesSnapshotListTestJSON-148761306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:17 devstack sudo[98411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.info Jun 02 03:28:17 devstack sudo[98411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:17 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b1abe29c-558e-46a0-b349-37f07f89f5bd" returned: 0 in 0.690s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:18 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Lock "cinder-quobyte-b1abe29c-558e-46a0-b349-37f07f89f5bd" released by "delete_volume" :: held 1.573s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:28:18 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Created reservations ['b2b896a2-e095-4d2d-b3c2-4f3818f2827f', '9e7c148d-ac8e-4637-9f6a-dd0375639880', '209bffec-3142-4125-9aca-6b4a0ce43b17', '694f4336-f01c-4053-acf7-d42bea527df4'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:28:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:28:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:28:18 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:28:18 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:28:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:28:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:18 devstack sudo[98414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:28:18 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:18 devstack sudo[98411]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1bae61de-222a-4bd2-b9db-abfe6d8d1de3 tempest-VolumesSnapshotListTestJSON-148761306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.info" returned: 0 in 0.701s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1bae61de-222a-4bd2-b9db-abfe6d8d1de3 tempest-VolumesSnapshotListTestJSON-148761306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.466s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:28:18 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-1bae61de-222a-4bd2-b9db-abfe6d8d1de3 tempest-VolumesSnapshotListTestJSON-148761306 None] Create snapshot completed successfully Jun 02 03:28:18 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.624s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:18 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:28:18 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Deleted volume successfully. Jun 02 03:28:18 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5205844d-7e04-43f8-a9bc-73f8679ae136 tempest-VolumesDeleteCascade-451749405 None] Lock "cinder-b1abe29c-558e-46a0-b349-37f07f89f5bd-delete_volume" released by "delete_volume" :: held 6.256s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:28:19 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0e136224-4d0f-4c1a-91cf-204cdf3bc4ad tempest-VolumesDeleteCascade-451749405 None] Acquiring lock "cinder-2884c8e6-e7c9-4b99-bfac-97f7270f41a9-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:28:19 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0e136224-4d0f-4c1a-91cf-204cdf3bc4ad tempest-VolumesDeleteCascade-451749405 None] Lock "cinder-2884c8e6-e7c9-4b99-bfac-97f7270f41a9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:28:19 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0e136224-4d0f-4c1a-91cf-204cdf3bc4ad tempest-VolumesDeleteCascade-451749405 None] Acquiring lock "cinder-quobyte-2884c8e6-e7c9-4b99-bfac-97f7270f41a9" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:28:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4850573e-3073-48f0-8ae0-e74e7b77593d tempest-VolumesSnapshotListTestJSON-148761306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:28:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4850573e-3073-48f0-8ae0-e74e7b77593d tempest-VolumesSnapshotListTestJSON-148761306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:28:19 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0e136224-4d0f-4c1a-91cf-204cdf3bc4ad tempest-VolumesDeleteCascade-451749405 None] Lock "cinder-quobyte-2884c8e6-e7c9-4b99-bfac-97f7270f41a9" acquired by "delete_volume" :: waited 0.030s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:28:19 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-4850573e-3073-48f0-8ae0-e74e7b77593d tempest-VolumesSnapshotListTestJSON-148761306 None] Creating offline snapshot 5038f158-b164-4d46-9493-cb9f94eb2e20 of volume fd19c8a9-9420-4a66-bbab-a4de69e16602 {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:28:19 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e54348-a40b-4e71-bc55-abdc4ce943c3]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:28:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0e136224-4d0f-4c1a-91cf-204cdf3bc4ad tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2884c8e6-e7c9-4b99-bfac-97f7270f41a9 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:19 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bb56fe-417e-4bff-819d-bf900b6c7563]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:28:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4850573e-3073-48f0-8ae0-e74e7b77593d tempest-VolumesSnapshotListTestJSON-148761306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.bee4363a-bdda-48c2-928f-452c0c7a1b53 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:19 devstack sudo[98418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2884c8e6-e7c9-4b99-bfac-97f7270f41a9 Jun 02 03:28:19 devstack sudo[98418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:19 devstack sudo[98419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.bee4363a-bdda-48c2-928f-452c0c7a1b53 Jun 02 03:28:19 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:20 devstack sudo[98418]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0e136224-4d0f-4c1a-91cf-204cdf3bc4ad tempest-VolumesDeleteCascade-451749405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2884c8e6-e7c9-4b99-bfac-97f7270f41a9" returned: 0 in 0.780s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0e136224-4d0f-4c1a-91cf-204cdf3bc4ad tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2884c8e6-e7c9-4b99-bfac-97f7270f41a9 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:20 devstack sudo[98430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2884c8e6-e7c9-4b99-bfac-97f7270f41a9 Jun 02 03:28:20 devstack sudo[98430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:20 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4850573e-3073-48f0-8ae0-e74e7b77593d tempest-VolumesSnapshotListTestJSON-148761306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.bee4363a-bdda-48c2-928f-452c0c7a1b53" returned: 0 in 0.809s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-4850573e-3073-48f0-8ae0-e74e7b77593d tempest-VolumesSnapshotListTestJSON-148761306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd19c8a9-9420-4a66-bbab-a4de69e16602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:28:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4850573e-3073-48f0-8ae0-e74e7b77593d tempest-VolumesSnapshotListTestJSON-148761306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.bee4363a-bdda-48c2-928f-452c0c7a1b53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5038f158-b164-4d46-9493-cb9f94eb2e20 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:20 devstack sudo[98432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.bee4363a-bdda-48c2-928f-452c0c7a1b53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5038f158-b164-4d46-9493-cb9f94eb2e20 1G Jun 02 03:28:20 devstack sudo[98432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:21 devstack sudo[98430]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0e136224-4d0f-4c1a-91cf-204cdf3bc4ad tempest-VolumesDeleteCascade-451749405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2884c8e6-e7c9-4b99-bfac-97f7270f41a9" returned: 0 in 0.735s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:21 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0e136224-4d0f-4c1a-91cf-204cdf3bc4ad tempest-VolumesDeleteCascade-451749405 None] Lock "cinder-quobyte-2884c8e6-e7c9-4b99-bfac-97f7270f41a9" released by "delete_volume" :: held 1.624s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:28:21 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-0e136224-4d0f-4c1a-91cf-204cdf3bc4ad tempest-VolumesDeleteCascade-451749405 None] Created reservations ['989e2bad-565a-4873-9a35-71cc435af4f5', '8375148b-d881-46ee-829d-74bf5f62913d', '653bc8d5-1f07-4ba5-a141-c424f12dd0d8', 'd4494996-47d0-4f08-8967-e31fcf1abbc6'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:28:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0e136224-4d0f-4c1a-91cf-204cdf3bc4ad tempest-VolumesDeleteCascade-451749405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:28:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0e136224-4d0f-4c1a-91cf-204cdf3bc4ad tempest-VolumesDeleteCascade-451749405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:28:21 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0e136224-4d0f-4c1a-91cf-204cdf3bc4ad tempest-VolumesDeleteCascade-451749405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:28:21 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0e136224-4d0f-4c1a-91cf-204cdf3bc4ad tempest-VolumesDeleteCascade-451749405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:28:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0e136224-4d0f-4c1a-91cf-204cdf3bc4ad tempest-VolumesDeleteCascade-451749405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:28:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0e136224-4d0f-4c1a-91cf-204cdf3bc4ad tempest-VolumesDeleteCascade-451749405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:21 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:28:21 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:21 devstack sudo[98432]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4850573e-3073-48f0-8ae0-e74e7b77593d tempest-VolumesSnapshotListTestJSON-148761306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.bee4363a-bdda-48c2-928f-452c0c7a1b53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5038f158-b164-4d46-9493-cb9f94eb2e20 1G" returned: 0 in 1.009s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4850573e-3073-48f0-8ae0-e74e7b77593d tempest-VolumesSnapshotListTestJSON-148761306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.bee4363a-bdda-48c2-928f-452c0c7a1b53 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5038f158-b164-4d46-9493-cb9f94eb2e20 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:21 devstack sudo[98441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.bee4363a-bdda-48c2-928f-452c0c7a1b53 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5038f158-b164-4d46-9493-cb9f94eb2e20 Jun 02 03:28:21 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:22 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0e136224-4d0f-4c1a-91cf-204cdf3bc4ad tempest-VolumesDeleteCascade-451749405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.952s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:22 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-0e136224-4d0f-4c1a-91cf-204cdf3bc4ad tempest-VolumesDeleteCascade-451749405 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:28:22 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-0e136224-4d0f-4c1a-91cf-204cdf3bc4ad tempest-VolumesDeleteCascade-451749405 None] Deleted volume successfully. Jun 02 03:28:22 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0e136224-4d0f-4c1a-91cf-204cdf3bc4ad tempest-VolumesDeleteCascade-451749405 None] Lock "cinder-2884c8e6-e7c9-4b99-bfac-97f7270f41a9-delete_volume" released by "delete_volume" :: held 2.878s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:28:22 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4850573e-3073-48f0-8ae0-e74e7b77593d tempest-VolumesSnapshotListTestJSON-148761306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.bee4363a-bdda-48c2-928f-452c0c7a1b53 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5038f158-b164-4d46-9493-cb9f94eb2e20" returned: 0 in 1.109s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:22 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-4850573e-3073-48f0-8ae0-e74e7b77593d tempest-VolumesSnapshotListTestJSON-148761306 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5038f158-b164-4d46-9493-cb9f94eb2e20 is being set with open permissions: ugo+rw Jun 02 03:28:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4850573e-3073-48f0-8ae0-e74e7b77593d tempest-VolumesSnapshotListTestJSON-148761306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5038f158-b164-4d46-9493-cb9f94eb2e20 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:22 devstack sudo[98481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5038f158-b164-4d46-9493-cb9f94eb2e20 Jun 02 03:28:22 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:23 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4850573e-3073-48f0-8ae0-e74e7b77593d tempest-VolumesSnapshotListTestJSON-148761306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5038f158-b164-4d46-9493-cb9f94eb2e20" returned: 0 in 0.887s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4850573e-3073-48f0-8ae0-e74e7b77593d tempest-VolumesSnapshotListTestJSON-148761306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.969s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:28:23 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-4850573e-3073-48f0-8ae0-e74e7b77593d tempest-VolumesSnapshotListTestJSON-148761306 None] Create snapshot completed successfully Jun 02 03:28:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ec9f8a78-f3d4-432e-9f50-c16e7e440fc2 tempest-VolumesSnapshotListTestJSON-148761306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:28:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ec9f8a78-f3d4-432e-9f50-c16e7e440fc2 tempest-VolumesSnapshotListTestJSON-148761306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:28:23 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-ec9f8a78-f3d4-432e-9f50-c16e7e440fc2 tempest-VolumesSnapshotListTestJSON-148761306 None] Creating offline snapshot 5e18405b-d681-49bb-9c89-ec80089914b6 of volume fd19c8a9-9420-4a66-bbab-a4de69e16602 {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:28:23 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7d456e-c755-4a09-9c3d-ef732b274ad9]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:28:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ec9f8a78-f3d4-432e-9f50-c16e7e440fc2 tempest-VolumesSnapshotListTestJSON-148761306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5038f158-b164-4d46-9493-cb9f94eb2e20 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:23 devstack sudo[98489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5038f158-b164-4d46-9493-cb9f94eb2e20 Jun 02 03:28:23 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:24 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ec9f8a78-f3d4-432e-9f50-c16e7e440fc2 tempest-VolumesSnapshotListTestJSON-148761306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5038f158-b164-4d46-9493-cb9f94eb2e20" returned: 0 in 0.905s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:24 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-ec9f8a78-f3d4-432e-9f50-c16e7e440fc2 tempest-VolumesSnapshotListTestJSON-148761306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd19c8a9-9420-4a66-bbab-a4de69e16602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:28:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ec9f8a78-f3d4-432e-9f50-c16e7e440fc2 tempest-VolumesSnapshotListTestJSON-148761306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5038f158-b164-4d46-9493-cb9f94eb2e20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5e18405b-d681-49bb-9c89-ec80089914b6 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:24 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5038f158-b164-4d46-9493-cb9f94eb2e20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5e18405b-d681-49bb-9c89-ec80089914b6 1G Jun 02 03:28:24 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:25 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ec9f8a78-f3d4-432e-9f50-c16e7e440fc2 tempest-VolumesSnapshotListTestJSON-148761306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5038f158-b164-4d46-9493-cb9f94eb2e20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5e18405b-d681-49bb-9c89-ec80089914b6 1G" returned: 0 in 0.908s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ec9f8a78-f3d4-432e-9f50-c16e7e440fc2 tempest-VolumesSnapshotListTestJSON-148761306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5038f158-b164-4d46-9493-cb9f94eb2e20 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5e18405b-d681-49bb-9c89-ec80089914b6 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:25 devstack sudo[98500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5038f158-b164-4d46-9493-cb9f94eb2e20 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5e18405b-d681-49bb-9c89-ec80089914b6 Jun 02 03:28:25 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:26 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ec9f8a78-f3d4-432e-9f50-c16e7e440fc2 tempest-VolumesSnapshotListTestJSON-148761306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5038f158-b164-4d46-9493-cb9f94eb2e20 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5e18405b-d681-49bb-9c89-ec80089914b6" returned: 0 in 0.709s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:26 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-ec9f8a78-f3d4-432e-9f50-c16e7e440fc2 tempest-VolumesSnapshotListTestJSON-148761306 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5e18405b-d681-49bb-9c89-ec80089914b6 is being set with open permissions: ugo+rw Jun 02 03:28:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ec9f8a78-f3d4-432e-9f50-c16e7e440fc2 tempest-VolumesSnapshotListTestJSON-148761306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5e18405b-d681-49bb-9c89-ec80089914b6 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:26 devstack sudo[98507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5e18405b-d681-49bb-9c89-ec80089914b6 Jun 02 03:28:26 devstack sudo[98507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:27 devstack sudo[98507]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ec9f8a78-f3d4-432e-9f50-c16e7e440fc2 tempest-VolumesSnapshotListTestJSON-148761306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5e18405b-d681-49bb-9c89-ec80089914b6" returned: 0 in 0.675s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ec9f8a78-f3d4-432e-9f50-c16e7e440fc2 tempest-VolumesSnapshotListTestJSON-148761306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.318s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:28:27 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-21973c6e-42fc-4d4a-93c9-bb49dbe31dc4 tempest-VolumesTransfersTest-217255725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:28:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-21973c6e-42fc-4d4a-93c9-bb49dbe31dc4 tempest-VolumesTransfersTest-217255725 None] Flow 'volume_create_manager' (5e86ca0f-5c6b-40af-aac7-1abfb86fe870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:28:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-21973c6e-42fc-4d4a-93c9-bb49dbe31dc4 tempest-VolumesTransfersTest-217255725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee8c48c-9495-46b3-ae4d-5dd5b62c4a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:28:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-21973c6e-42fc-4d4a-93c9-bb49dbe31dc4 tempest-VolumesTransfersTest-217255725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee8c48c-9495-46b3-ae4d-5dd5b62c4a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-759977958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a9eda43-0e69-4722-8371-3afab92d9bc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44cd830afcfe40928c1f47ea509ca470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:28:27Z,use_quota=True,user_id='8963d9d0119a4366a6e016b4bacbbb41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:28:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-21973c6e-42fc-4d4a-93c9-bb49dbe31dc4 tempest-VolumesTransfersTest-217255725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f64950e3-6e1d-4517-a8b0-8b7513d5e65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:28:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-21973c6e-42fc-4d4a-93c9-bb49dbe31dc4 tempest-VolumesTransfersTest-217255725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f64950e3-6e1d-4517-a8b0-8b7513d5e65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:28:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-21973c6e-42fc-4d4a-93c9-bb49dbe31dc4 tempest-VolumesTransfersTest-217255725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dafa1804-b256-4d85-be8f-efec102bae1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:28:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-21973c6e-42fc-4d4a-93c9-bb49dbe31dc4 tempest-VolumesTransfersTest-217255725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dafa1804-b256-4d85-be8f-efec102bae1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a9eda43-0e69-4722-8371-3afab92d9bc3', 'volume_name': 'volume-4a9eda43-0e69-4722-8371-3afab92d9bc3', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:28:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-21973c6e-42fc-4d4a-93c9-bb49dbe31dc4 tempest-VolumesTransfersTest-217255725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b60746-6755-43f8-9375-ffc43a2cc174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:28:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-21973c6e-42fc-4d4a-93c9-bb49dbe31dc4 tempest-VolumesTransfersTest-217255725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b60746-6755-43f8-9375-ffc43a2cc174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:28:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-21973c6e-42fc-4d4a-93c9-bb49dbe31dc4 tempest-VolumesTransfersTest-217255725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edab1937-eaae-451b-8775-2d40ce3fed0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:28:27 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-21973c6e-42fc-4d4a-93c9-bb49dbe31dc4 tempest-VolumesTransfersTest-217255725 None] Volume 4a9eda43-0e69-4722-8371-3afab92d9bc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a9eda43-0e69-4722-8371-3afab92d9bc3', 'volume_size': 1} Jun 02 03:28:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-21973c6e-42fc-4d4a-93c9-bb49dbe31dc4 tempest-VolumesTransfersTest-217255725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:28:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-21973c6e-42fc-4d4a-93c9-bb49dbe31dc4 tempest-VolumesTransfersTest-217255725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:28:27 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-21973c6e-42fc-4d4a-93c9-bb49dbe31dc4 tempest-VolumesTransfersTest-217255725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-759977958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a9eda43-0e69-4722-8371-3afab92d9bc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44cd830afcfe40928c1f47ea509ca470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:28:27Z,use_quota=True,user_id='8963d9d0119a4366a6e016b4bacbbb41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:28:27 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-21973c6e-42fc-4d4a-93c9-bb49dbe31dc4 tempest-VolumesTransfersTest-217255725 None] Creating volume 4a9eda43-0e69-4722-8371-3afab92d9bc3 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:28:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-21973c6e-42fc-4d4a-93c9-bb49dbe31dc4 tempest-VolumesTransfersTest-217255725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:28:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-21973c6e-42fc-4d4a-93c9-bb49dbe31dc4 tempest-VolumesTransfersTest-217255725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:28:27 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-21973c6e-42fc-4d4a-93c9-bb49dbe31dc4 tempest-VolumesTransfersTest-217255725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:28:27 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-21973c6e-42fc-4d4a-93c9-bb49dbe31dc4 tempest-VolumesTransfersTest-217255725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:28:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-21973c6e-42fc-4d4a-93c9-bb49dbe31dc4 tempest-VolumesTransfersTest-217255725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:28:27 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-21973c6e-42fc-4d4a-93c9-bb49dbe31dc4 tempest-VolumesTransfersTest-217255725 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:28:27 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-21973c6e-42fc-4d4a-93c9-bb49dbe31dc4 tempest-VolumesTransfersTest-217255725 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:28:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-21973c6e-42fc-4d4a-93c9-bb49dbe31dc4 tempest-VolumesTransfersTest-217255725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-4a9eda43-0e69-4722-8371-3afab92d9bc3 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:27 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-ec9f8a78-f3d4-432e-9f50-c16e7e440fc2 tempest-VolumesSnapshotListTestJSON-148761306 None] Create snapshot completed successfully Jun 02 03:28:27 devstack sudo[98510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-4a9eda43-0e69-4722-8371-3afab92d9bc3 1073741824 Jun 02 03:28:27 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:28 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-21973c6e-42fc-4d4a-93c9-bb49dbe31dc4 tempest-VolumesTransfersTest-217255725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-4a9eda43-0e69-4722-8371-3afab92d9bc3 1073741824" returned: 0 in 0.843s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-21973c6e-42fc-4d4a-93c9-bb49dbe31dc4 tempest-VolumesTransfersTest-217255725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-4a9eda43-0e69-4722-8371-3afab92d9bc3 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:28 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-4a9eda43-0e69-4722-8371-3afab92d9bc3 Jun 02 03:28:28 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:28 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-21973c6e-42fc-4d4a-93c9-bb49dbe31dc4 tempest-VolumesTransfersTest-217255725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-4a9eda43-0e69-4722-8371-3afab92d9bc3" returned: 0 in 0.703s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:28 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-21973c6e-42fc-4d4a-93c9-bb49dbe31dc4 tempest-VolumesTransfersTest-217255725 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:28:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-21973c6e-42fc-4d4a-93c9-bb49dbe31dc4 tempest-VolumesTransfersTest-217255725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:28:28 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-21973c6e-42fc-4d4a-93c9-bb49dbe31dc4 tempest-VolumesTransfersTest-217255725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edab1937-eaae-451b-8775-2d40ce3fed0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a9eda43-0e69-4722-8371-3afab92d9bc3', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:28:28 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-21973c6e-42fc-4d4a-93c9-bb49dbe31dc4 tempest-VolumesTransfersTest-217255725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9de376ae-c99c-4641-a754-014aca1ee94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:28:28 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-21973c6e-42fc-4d4a-93c9-bb49dbe31dc4 tempest-VolumesTransfersTest-217255725 None] Volume volume-4a9eda43-0e69-4722-8371-3afab92d9bc3 (4a9eda43-0e69-4722-8371-3afab92d9bc3): created successfully Jun 02 03:28:28 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-21973c6e-42fc-4d4a-93c9-bb49dbe31dc4 tempest-VolumesTransfersTest-217255725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9de376ae-c99c-4641-a754-014aca1ee94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:28:28 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-21973c6e-42fc-4d4a-93c9-bb49dbe31dc4 tempest-VolumesTransfersTest-217255725 None] Flow 'volume_create_manager' (5e86ca0f-5c6b-40af-aac7-1abfb86fe870) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:28:28 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f62a3fc2-cb14-4c37-8dc3-9d842afa86f1 tempest-VolumesSnapshotListTestJSON-148761306 None] Acquiring lock "cinder-5e18405b-d681-49bb-9c89-ec80089914b6-delete_snapshot" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:28:28 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-21973c6e-42fc-4d4a-93c9-bb49dbe31dc4 tempest-VolumesTransfersTest-217255725 None] Created volume successfully. Jun 02 03:28:28 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f62a3fc2-cb14-4c37-8dc3-9d842afa86f1 tempest-VolumesSnapshotListTestJSON-148761306 None] Lock "cinder-5e18405b-d681-49bb-9c89-ec80089914b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:28:28 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f62a3fc2-cb14-4c37-8dc3-9d842afa86f1 tempest-VolumesSnapshotListTestJSON-148761306 None] Acquiring lock "cinder-quobyte-fd19c8a9-9420-4a66-bbab-a4de69e16602" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:28:28 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f62a3fc2-cb14-4c37-8dc3-9d842afa86f1 tempest-VolumesSnapshotListTestJSON-148761306 None] Lock "cinder-quobyte-fd19c8a9-9420-4a66-bbab-a4de69e16602" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:28:28 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f62a3fc2-cb14-4c37-8dc3-9d842afa86f1 tempest-VolumesSnapshotListTestJSON-148761306 None] Acquiring lock "cinder-quobyte-5e18405b-d681-49bb-9c89-ec80089914b6" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:28:28 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f62a3fc2-cb14-4c37-8dc3-9d842afa86f1 tempest-VolumesSnapshotListTestJSON-148761306 None] Lock "cinder-quobyte-5e18405b-d681-49bb-9c89-ec80089914b6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:28:28 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-f62a3fc2-cb14-4c37-8dc3-9d842afa86f1 tempest-VolumesSnapshotListTestJSON-148761306 None] Deleting offline snapshot 5e18405b-d681-49bb-9c89-ec80089914b6 of volume fd19c8a9-9420-4a66-bbab-a4de69e16602 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:28:28 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-f62a3fc2-cb14-4c37-8dc3-9d842afa86f1 tempest-VolumesSnapshotListTestJSON-148761306 None] snapshot_file for this snap is: volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5e18405b-d681-49bb-9c89-ec80089914b6 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:28:29 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[240f2184-101b-4528-b853-e9e7bd36323b]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:28:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f62a3fc2-cb14-4c37-8dc3-9d842afa86f1 tempest-VolumesSnapshotListTestJSON-148761306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5e18405b-d681-49bb-9c89-ec80089914b6 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:29 devstack sudo[98527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5e18405b-d681-49bb-9c89-ec80089914b6 Jun 02 03:28:29 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:29 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f62a3fc2-cb14-4c37-8dc3-9d842afa86f1 tempest-VolumesSnapshotListTestJSON-148761306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5e18405b-d681-49bb-9c89-ec80089914b6" returned: 0 in 0.892s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:29 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-f62a3fc2-cb14-4c37-8dc3-9d842afa86f1 tempest-VolumesSnapshotListTestJSON-148761306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd19c8a9-9420-4a66-bbab-a4de69e16602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:28:29 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc5bf7c-60bc-4d61-9117-4a450cd093b1]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:28:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f62a3fc2-cb14-4c37-8dc3-9d842afa86f1 tempest-VolumesSnapshotListTestJSON-148761306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5038f158-b164-4d46-9493-cb9f94eb2e20 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:30 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-17b4b6ea-0d48-48cd-bc49-0e9e724b0b37 tempest-VolumesTransfersTest-122320038 None] Transfer volume completed successfully. Jun 02 03:28:30 devstack sudo[98534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5038f158-b164-4d46-9493-cb9f94eb2e20 Jun 02 03:28:30 devstack sudo[98534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:30 devstack sudo[98534]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f62a3fc2-cb14-4c37-8dc3-9d842afa86f1 tempest-VolumesSnapshotListTestJSON-148761306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5038f158-b164-4d46-9493-cb9f94eb2e20" returned: 0 in 0.779s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:30 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-f62a3fc2-cb14-4c37-8dc3-9d842afa86f1 tempest-VolumesSnapshotListTestJSON-148761306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd19c8a9-9420-4a66-bbab-a4de69e16602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:28:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f62a3fc2-cb14-4c37-8dc3-9d842afa86f1 tempest-VolumesSnapshotListTestJSON-148761306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5e18405b-d681-49bb-9c89-ec80089914b6 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:30 devstack sudo[98539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5e18405b-d681-49bb-9c89-ec80089914b6 Jun 02 03:28:30 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:31 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e79583db-683c-4fc3-a026-c03650cee55d tempest-VolumesTransfersTest-1337534811 None] Acquiring lock "cinder-4a9eda43-0e69-4722-8371-3afab92d9bc3-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:28:31 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e79583db-683c-4fc3-a026-c03650cee55d tempest-VolumesTransfersTest-1337534811 None] Lock "cinder-4a9eda43-0e69-4722-8371-3afab92d9bc3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:28:31 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e79583db-683c-4fc3-a026-c03650cee55d tempest-VolumesTransfersTest-1337534811 None] Acquiring lock "cinder-quobyte-4a9eda43-0e69-4722-8371-3afab92d9bc3" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:28:31 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e79583db-683c-4fc3-a026-c03650cee55d tempest-VolumesTransfersTest-1337534811 None] Lock "cinder-quobyte-4a9eda43-0e69-4722-8371-3afab92d9bc3" acquired by "delete_volume" :: waited 0.019s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:28:31 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9a939f-3d3c-48c4-a5a2-563942a7facd]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:28:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e79583db-683c-4fc3-a026-c03650cee55d tempest-VolumesTransfersTest-1337534811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-4a9eda43-0e69-4722-8371-3afab92d9bc3 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:31 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-4a9eda43-0e69-4722-8371-3afab92d9bc3 Jun 02 03:28:31 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:31 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f62a3fc2-cb14-4c37-8dc3-9d842afa86f1 tempest-VolumesSnapshotListTestJSON-148761306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5e18405b-d681-49bb-9c89-ec80089914b6" returned: 0 in 0.831s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f62a3fc2-cb14-4c37-8dc3-9d842afa86f1 tempest-VolumesSnapshotListTestJSON-148761306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5e18405b-d681-49bb-9c89-ec80089914b6 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:31 devstack sudo[98547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5e18405b-d681-49bb-9c89-ec80089914b6 Jun 02 03:28:31 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:32 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e79583db-683c-4fc3-a026-c03650cee55d tempest-VolumesTransfersTest-1337534811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-4a9eda43-0e69-4722-8371-3afab92d9bc3" returned: 0 in 0.799s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e79583db-683c-4fc3-a026-c03650cee55d tempest-VolumesTransfersTest-1337534811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-4a9eda43-0e69-4722-8371-3afab92d9bc3 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:32 devstack sudo[98553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-4a9eda43-0e69-4722-8371-3afab92d9bc3 Jun 02 03:28:32 devstack sudo[98553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:32 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f62a3fc2-cb14-4c37-8dc3-9d842afa86f1 tempest-VolumesSnapshotListTestJSON-148761306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5e18405b-d681-49bb-9c89-ec80089914b6" returned: 0 in 0.618s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:32 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f62a3fc2-cb14-4c37-8dc3-9d842afa86f1 tempest-VolumesSnapshotListTestJSON-148761306 None] Lock "cinder-quobyte-5e18405b-d681-49bb-9c89-ec80089914b6" released by "_delete_snapshot" :: held 3.289s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:28:32 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f62a3fc2-cb14-4c37-8dc3-9d842afa86f1 tempest-VolumesSnapshotListTestJSON-148761306 None] Lock "cinder-quobyte-fd19c8a9-9420-4a66-bbab-a4de69e16602" released by "delete_snapshot" :: held 3.316s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:28:32 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-f62a3fc2-cb14-4c37-8dc3-9d842afa86f1 tempest-VolumesSnapshotListTestJSON-148761306 None] Created reservations ['a636ca1a-dbb0-4503-ba4f-d59a842edd2c', 'b378c32e-cbfe-442e-a46f-8832253fb6d0', 'b6b0fdda-01c1-4dd4-bb76-69d540855986', '86eef925-1828-4756-8989-8d5b2ebe789f'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:28:32 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-f62a3fc2-cb14-4c37-8dc3-9d842afa86f1 tempest-VolumesSnapshotListTestJSON-148761306 None] Delete snapshot completed successfully. Jun 02 03:28:32 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f62a3fc2-cb14-4c37-8dc3-9d842afa86f1 tempest-VolumesSnapshotListTestJSON-148761306 None] Lock "cinder-5e18405b-d681-49bb-9c89-ec80089914b6-delete_snapshot" released by "delete_snapshot" :: held 3.531s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:28:32 devstack sudo[98553]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e79583db-683c-4fc3-a026-c03650cee55d tempest-VolumesTransfersTest-1337534811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-4a9eda43-0e69-4722-8371-3afab92d9bc3" returned: 0 in 0.697s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:32 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e79583db-683c-4fc3-a026-c03650cee55d tempest-VolumesTransfersTest-1337534811 None] Lock "cinder-quobyte-4a9eda43-0e69-4722-8371-3afab92d9bc3" released by "delete_volume" :: held 1.551s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:28:32 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-e79583db-683c-4fc3-a026-c03650cee55d tempest-VolumesTransfersTest-1337534811 None] Created reservations ['e16ac587-fabc-4b3b-b309-d3594ba66477', 'dbe2fc13-8ed2-406b-b6e6-173e7e4e7157', '32e2d0a8-c712-4d00-9437-d9fd7439e50b', '0cf3c0af-fc98-4819-ad2b-5cb8a1ec6366'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:28:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e79583db-683c-4fc3-a026-c03650cee55d tempest-VolumesTransfersTest-1337534811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:28:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e79583db-683c-4fc3-a026-c03650cee55d tempest-VolumesTransfersTest-1337534811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:28:32 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e79583db-683c-4fc3-a026-c03650cee55d tempest-VolumesTransfersTest-1337534811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:28:32 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e79583db-683c-4fc3-a026-c03650cee55d tempest-VolumesTransfersTest-1337534811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:28:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e79583db-683c-4fc3-a026-c03650cee55d tempest-VolumesTransfersTest-1337534811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:28:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e79583db-683c-4fc3-a026-c03650cee55d tempest-VolumesTransfersTest-1337534811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:32 devstack sudo[98558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:28:32 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:33 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1624730a-a124-4431-8b26-be3eb58539c2 tempest-VolumesSnapshotListTestJSON-148761306 None] Acquiring lock "cinder-5038f158-b164-4d46-9493-cb9f94eb2e20-delete_snapshot" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:28:33 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1624730a-a124-4431-8b26-be3eb58539c2 tempest-VolumesSnapshotListTestJSON-148761306 None] Lock "cinder-5038f158-b164-4d46-9493-cb9f94eb2e20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:28:33 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1624730a-a124-4431-8b26-be3eb58539c2 tempest-VolumesSnapshotListTestJSON-148761306 None] Acquiring lock "cinder-quobyte-fd19c8a9-9420-4a66-bbab-a4de69e16602" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:28:33 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1624730a-a124-4431-8b26-be3eb58539c2 tempest-VolumesSnapshotListTestJSON-148761306 None] Lock "cinder-quobyte-fd19c8a9-9420-4a66-bbab-a4de69e16602" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:28:33 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1624730a-a124-4431-8b26-be3eb58539c2 tempest-VolumesSnapshotListTestJSON-148761306 None] Acquiring lock "cinder-quobyte-5038f158-b164-4d46-9493-cb9f94eb2e20" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:28:33 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1624730a-a124-4431-8b26-be3eb58539c2 tempest-VolumesSnapshotListTestJSON-148761306 None] Lock "cinder-quobyte-5038f158-b164-4d46-9493-cb9f94eb2e20" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:28:33 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-1624730a-a124-4431-8b26-be3eb58539c2 tempest-VolumesSnapshotListTestJSON-148761306 None] Deleting offline snapshot 5038f158-b164-4d46-9493-cb9f94eb2e20 of volume fd19c8a9-9420-4a66-bbab-a4de69e16602 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:28:33 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-1624730a-a124-4431-8b26-be3eb58539c2 tempest-VolumesSnapshotListTestJSON-148761306 None] snapshot_file for this snap is: volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5038f158-b164-4d46-9493-cb9f94eb2e20 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:28:33 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c0b531-1793-4f00-841b-1e24c9854885]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:28:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1624730a-a124-4431-8b26-be3eb58539c2 tempest-VolumesSnapshotListTestJSON-148761306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5038f158-b164-4d46-9493-cb9f94eb2e20 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:33 devstack sudo[98568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5038f158-b164-4d46-9493-cb9f94eb2e20 Jun 02 03:28:33 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-f6af758f-c071-4e3a-896a-4bda7be4df75 req-2cbb93b4-8c49-4f9f-89bd-986a51ca4afa tempest-TestServerVolumeAttachmentScenario-1432150825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:28:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-f6af758f-c071-4e3a-896a-4bda7be4df75 req-2cbb93b4-8c49-4f9f-89bd-986a51ca4afa tempest-TestServerVolumeAttachmentScenario-1432150825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:28:33 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fde7ec-7049-4052-8e43-cb50cd633152]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:28:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-f6af758f-c071-4e3a-896a-4bda7be4df75 req-2cbb93b4-8c49-4f9f-89bd-986a51ca4afa tempest-TestServerVolumeAttachmentScenario-1432150825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e5b3727e-fda2-46a1-b763-98a74d870fed {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:33 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e79583db-683c-4fc3-a026-c03650cee55d tempest-VolumesTransfersTest-1337534811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.767s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:33 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-e79583db-683c-4fc3-a026-c03650cee55d tempest-VolumesTransfersTest-1337534811 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:28:33 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-e79583db-683c-4fc3-a026-c03650cee55d tempest-VolumesTransfersTest-1337534811 None] Deleted volume successfully. Jun 02 03:28:33 devstack sudo[98570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e5b3727e-fda2-46a1-b763-98a74d870fed Jun 02 03:28:33 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:33 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e79583db-683c-4fc3-a026-c03650cee55d tempest-VolumesTransfersTest-1337534811 None] Lock "cinder-4a9eda43-0e69-4722-8371-3afab92d9bc3-delete_volume" released by "delete_volume" :: held 2.531s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:28:33 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e04c88b-bae6-41ff-81de-552d7a617bab tempest-VolumesTransfersTest-217255725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6e04c88b-bae6-41ff-81de-552d7a617bab tempest-VolumesTransfersTest-217255725 None] Flow 'volume_create_manager' (65ea504e-b99c-46bd-ae37-44c0a5a6703a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6e04c88b-bae6-41ff-81de-552d7a617bab tempest-VolumesTransfersTest-217255725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d5c47a7-4fe3-4002-84b6-7470b542a998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6e04c88b-bae6-41ff-81de-552d7a617bab tempest-VolumesTransfersTest-217255725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d5c47a7-4fe3-4002-84b6-7470b542a998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-401459870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=070a9c94-5877-426f-9b13-7d38dabe808a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44cd830afcfe40928c1f47ea509ca470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:28:34Z,use_quota=True,user_id='8963d9d0119a4366a6e016b4bacbbb41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6e04c88b-bae6-41ff-81de-552d7a617bab tempest-VolumesTransfersTest-217255725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7e4faef-e532-4c80-82df-cdd79e7f3a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6e04c88b-bae6-41ff-81de-552d7a617bab tempest-VolumesTransfersTest-217255725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7e4faef-e532-4c80-82df-cdd79e7f3a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6e04c88b-bae6-41ff-81de-552d7a617bab tempest-VolumesTransfersTest-217255725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deea81fc-4b9c-4699-ade3-7517474d7857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6e04c88b-bae6-41ff-81de-552d7a617bab tempest-VolumesTransfersTest-217255725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deea81fc-4b9c-4699-ade3-7517474d7857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '070a9c94-5877-426f-9b13-7d38dabe808a', 'volume_name': 'volume-070a9c94-5877-426f-9b13-7d38dabe808a', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6e04c88b-bae6-41ff-81de-552d7a617bab tempest-VolumesTransfersTest-217255725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66630a09-fe6d-4c88-9df1-74bb07ada763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6e04c88b-bae6-41ff-81de-552d7a617bab tempest-VolumesTransfersTest-217255725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66630a09-fe6d-4c88-9df1-74bb07ada763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6e04c88b-bae6-41ff-81de-552d7a617bab tempest-VolumesTransfersTest-217255725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (248d70dc-e554-4ab4-8b6a-2dc6b76143b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:28:34 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-6e04c88b-bae6-41ff-81de-552d7a617bab tempest-VolumesTransfersTest-217255725 None] Volume 070a9c94-5877-426f-9b13-7d38dabe808a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-070a9c94-5877-426f-9b13-7d38dabe808a', 'volume_size': 1} Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6e04c88b-bae6-41ff-81de-552d7a617bab tempest-VolumesTransfersTest-217255725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:28:34 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1624730a-a124-4431-8b26-be3eb58539c2 tempest-VolumesSnapshotListTestJSON-148761306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5038f158-b164-4d46-9493-cb9f94eb2e20" returned: 0 in 0.838s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-1624730a-a124-4431-8b26-be3eb58539c2 tempest-VolumesSnapshotListTestJSON-148761306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd19c8a9-9420-4a66-bbab-a4de69e16602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61ea36e-914d-4344-8b6c-32efbfac9aa0]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1624730a-a124-4431-8b26-be3eb58539c2 tempest-VolumesSnapshotListTestJSON-148761306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.bee4363a-bdda-48c2-928f-452c0c7a1b53 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:34 devstack sudo[98577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.bee4363a-bdda-48c2-928f-452c0c7a1b53 Jun 02 03:28:34 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:34 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-f6af758f-c071-4e3a-896a-4bda7be4df75 req-2cbb93b4-8c49-4f9f-89bd-986a51ca4afa tempest-TestServerVolumeAttachmentScenario-1432150825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e5b3727e-fda2-46a1-b763-98a74d870fed" returned: 0 in 0.878s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-f6af758f-c071-4e3a-896a-4bda7be4df75 req-2cbb93b4-8c49-4f9f-89bd-986a51ca4afa tempest-TestServerVolumeAttachmentScenario-1432150825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.896s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6e04c88b-bae6-41ff-81de-552d7a617bab tempest-VolumesTransfersTest-217255725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.326s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6e04c88b-bae6-41ff-81de-552d7a617bab tempest-VolumesTransfersTest-217255725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-401459870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=070a9c94-5877-426f-9b13-7d38dabe808a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44cd830afcfe40928c1f47ea509ca470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:28:34Z,use_quota=True,user_id='8963d9d0119a4366a6e016b4bacbbb41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-6e04c88b-bae6-41ff-81de-552d7a617bab tempest-VolumesTransfersTest-217255725 None] Creating volume 070a9c94-5877-426f-9b13-7d38dabe808a {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6e04c88b-bae6-41ff-81de-552d7a617bab tempest-VolumesTransfersTest-217255725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6e04c88b-bae6-41ff-81de-552d7a617bab tempest-VolumesTransfersTest-217255725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6e04c88b-bae6-41ff-81de-552d7a617bab tempest-VolumesTransfersTest-217255725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6e04c88b-bae6-41ff-81de-552d7a617bab tempest-VolumesTransfersTest-217255725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6e04c88b-bae6-41ff-81de-552d7a617bab tempest-VolumesTransfersTest-217255725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6e04c88b-bae6-41ff-81de-552d7a617bab tempest-VolumesTransfersTest-217255725 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:28:34 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-6e04c88b-bae6-41ff-81de-552d7a617bab tempest-VolumesTransfersTest-217255725 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6e04c88b-bae6-41ff-81de-552d7a617bab tempest-VolumesTransfersTest-217255725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-070a9c94-5877-426f-9b13-7d38dabe808a 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:34 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-070a9c94-5877-426f-9b13-7d38dabe808a 1073741824 Jun 02 03:28:34 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-f6af758f-c071-4e3a-896a-4bda7be4df75 req-2cbb93b4-8c49-4f9f-89bd-986a51ca4afa tempest-TestServerVolumeAttachmentScenario-1432150825 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1', 'name': 'volume-e5b3727e-fda2-46a1-b763-98a74d870fed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd35c137a-cb49-4378-99d7-ac7f3ce9570e', 'enforce_multipath': True} {{(pid=86431) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Flow 'volume_create_manager' (4be8b171-acdd-469e-ba2d-f0177e847180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e9ced95-3772-4471-b430-ba88b467cb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e9ced95-3772-4471-b430-ba88b467cb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1267547905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6be5aa9f2f504ff29a2302daf2d98e78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:28:35Z,use_quota=True,user_id='94562dc174d14bd7b571cd231454e21e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d105de0-f560-4f9f-8559-ce6bd92f911c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d105de0-f560-4f9f-8559-ce6bd92f911c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6161a75-877a-45c1-82ef-0ed2aee71503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:28:34 devstack cinder-volume[86431]: DEBUG cinder.image.glance [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Creating Keystone auth plugin from conf {{(pid=86431) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 02 03:28:34 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-f6af758f-c071-4e3a-896a-4bda7be4df75 req-2cbb93b4-8c49-4f9f-89bd-986a51ca4afa tempest-TestServerVolumeAttachmentScenario-1432150825 None] attachment_update completed successfully. Jun 02 03:28:35 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6161a75-877a-45c1-82ef-0ed2aee71503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb', 'volume_name': 'volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb', 'volume_size': 1, 'image_id': '54f2c102-8f54-4d66-966a-3fc746680841', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54f2c102-8f54-4d66-966a-3fc746680841', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48b06555345b4428a30a6f37e96ddabe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '54f2c102-8f54-4d66-966a-3fc746680841', 'created_at': datetime.datetime(2026, 6, 2, 1, 9, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 1, 9, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54f2c102-8f54-4d66-966a-3fc746680841/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:28:35 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f5dafa0-2c42-4673-a3ad-6ef456849f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:28:35 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f5dafa0-2c42-4673-a3ad-6ef456849f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:28:35 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b217495-8ba5-4427-9c64-ef57a3f4de0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:28:35 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Volume 1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb', 'volume_size': 1, 'image_id': '54f2c102-8f54-4d66-966a-3fc746680841', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54f2c102-8f54-4d66-966a-3fc746680841', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48b06555345b4428a30a6f37e96ddabe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '54f2c102-8f54-4d66-966a-3fc746680841', 'created_at': datetime.datetime(2026, 6, 2, 1, 9, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 1, 9, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54f2c102-8f54-4d66-966a-3fc746680841/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 02 03:28:35 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Trying to clone 1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb from image 54f2c102-8f54-4d66-966a-3fc746680841 at location (None, [{'url': 'file:///opt/stack/data/glance/images/54f2c102-8f54-4d66-966a-3fc746680841', 'metadata': {}}]). {{(pid=86431) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 02 03:28:35 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1624730a-a124-4431-8b26-be3eb58539c2 tempest-VolumesSnapshotListTestJSON-148761306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.bee4363a-bdda-48c2-928f-452c0c7a1b53" returned: 0 in 0.818s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:35 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-1624730a-a124-4431-8b26-be3eb58539c2 tempest-VolumesSnapshotListTestJSON-148761306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd19c8a9-9420-4a66-bbab-a4de69e16602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:28:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1624730a-a124-4431-8b26-be3eb58539c2 tempest-VolumesSnapshotListTestJSON-148761306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5038f158-b164-4d46-9493-cb9f94eb2e20 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:35 devstack sudo[98592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5038f158-b164-4d46-9493-cb9f94eb2e20 Jun 02 03:28:35 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:35 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_boldzsi5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86431) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 02 03:28:35 devstack cinder-volume[86431]: INFO cinder.image.image_utils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Image download 20.69 MB at 20.69 MB/s Jun 02 03:28:35 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6e04c88b-bae6-41ff-81de-552d7a617bab tempest-VolumesTransfersTest-217255725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-070a9c94-5877-426f-9b13-7d38dabe808a 1073741824" returned: 0 in 0.988s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6e04c88b-bae6-41ff-81de-552d7a617bab tempest-VolumesTransfersTest-217255725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-070a9c94-5877-426f-9b13-7d38dabe808a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:35 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[841d7b14-9592-4342-904e-0ca6eb2eb609]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:28:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_boldzsi5devstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:35 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-070a9c94-5877-426f-9b13-7d38dabe808a Jun 02 03:28:35 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:35 devstack sudo[98663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_boldzsi5devstack@QuobyteHD Jun 02 03:28:35 devstack sudo[98663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:36 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1624730a-a124-4431-8b26-be3eb58539c2 tempest-VolumesSnapshotListTestJSON-148761306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5038f158-b164-4d46-9493-cb9f94eb2e20" returned: 0 in 0.999s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1624730a-a124-4431-8b26-be3eb58539c2 tempest-VolumesSnapshotListTestJSON-148761306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5038f158-b164-4d46-9493-cb9f94eb2e20 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:36 devstack sudo[98986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5038f158-b164-4d46-9493-cb9f94eb2e20 Jun 02 03:28:36 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:36 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6e04c88b-bae6-41ff-81de-552d7a617bab tempest-VolumesTransfersTest-217255725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-070a9c94-5877-426f-9b13-7d38dabe808a" returned: 0 in 0.699s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:36 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6e04c88b-bae6-41ff-81de-552d7a617bab tempest-VolumesTransfersTest-217255725 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:28:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6e04c88b-bae6-41ff-81de-552d7a617bab tempest-VolumesTransfersTest-217255725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:28:36 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6e04c88b-bae6-41ff-81de-552d7a617bab tempest-VolumesTransfersTest-217255725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (248d70dc-e554-4ab4-8b6a-2dc6b76143b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-070a9c94-5877-426f-9b13-7d38dabe808a', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:28:36 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6e04c88b-bae6-41ff-81de-552d7a617bab tempest-VolumesTransfersTest-217255725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (941c1177-546f-4ea5-90be-5108dffeb823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:28:36 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-6e04c88b-bae6-41ff-81de-552d7a617bab tempest-VolumesTransfersTest-217255725 None] Volume volume-070a9c94-5877-426f-9b13-7d38dabe808a (070a9c94-5877-426f-9b13-7d38dabe808a): created successfully Jun 02 03:28:36 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6e04c88b-bae6-41ff-81de-552d7a617bab tempest-VolumesTransfersTest-217255725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (941c1177-546f-4ea5-90be-5108dffeb823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:28:36 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6e04c88b-bae6-41ff-81de-552d7a617bab tempest-VolumesTransfersTest-217255725 None] Flow 'volume_create_manager' (65ea504e-b99c-46bd-ae37-44c0a5a6703a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:28:36 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-6e04c88b-bae6-41ff-81de-552d7a617bab tempest-VolumesTransfersTest-217255725 None] Created volume successfully. Jun 02 03:28:36 devstack sudo[98663]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_boldzsi5devstack@QuobyteHD" returned: 0 in 0.865s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:36 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Temporary image 54f2c102-8f54-4d66-966a-3fc746680841 is fetched for user 94562dc174d14bd7b571cd231454e21e. {{(pid=86431) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 02 03:28:36 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[51aa8330-108d-4506-b290-1e58b74e28ed]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:28:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_boldzsi5devstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:36 devstack sudo[98991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_boldzsi5devstack@QuobyteHD Jun 02 03:28:36 devstack sudo[98991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:36 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1624730a-a124-4431-8b26-be3eb58539c2 tempest-VolumesSnapshotListTestJSON-148761306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.5038f158-b164-4d46-9493-cb9f94eb2e20" returned: 0 in 0.643s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1624730a-a124-4431-8b26-be3eb58539c2 tempest-VolumesSnapshotListTestJSON-148761306 None] Lock "cinder-quobyte-5038f158-b164-4d46-9493-cb9f94eb2e20" released by "_delete_snapshot" :: held 3.444s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:28:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1624730a-a124-4431-8b26-be3eb58539c2 tempest-VolumesSnapshotListTestJSON-148761306 None] Lock "cinder-quobyte-fd19c8a9-9420-4a66-bbab-a4de69e16602" released by "delete_snapshot" :: held 3.480s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:28:36 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-1624730a-a124-4431-8b26-be3eb58539c2 tempest-VolumesSnapshotListTestJSON-148761306 None] Created reservations ['f504f930-e0f4-4759-a268-f97249b2430d', 'e25ed9d8-fe8d-4f17-9c12-c3835e9c9941', '2c6aa4bb-830c-4a22-a173-b82057e60204', '9012f886-9040-4652-b70f-7286ac0dd4d6'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:28:36 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-1624730a-a124-4431-8b26-be3eb58539c2 tempest-VolumesSnapshotListTestJSON-148761306 None] Delete snapshot completed successfully. Jun 02 03:28:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1624730a-a124-4431-8b26-be3eb58539c2 tempest-VolumesSnapshotListTestJSON-148761306 None] Lock "cinder-5038f158-b164-4d46-9493-cb9f94eb2e20-delete_snapshot" released by "delete_snapshot" :: held 3.663s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:28:37 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b5111fc5-055a-4658-bf67-8f03fb061cde tempest-VolumesTransfersTest-1337534811 None] Acquiring lock "cinder-070a9c94-5877-426f-9b13-7d38dabe808a-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:28:37 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b5111fc5-055a-4658-bf67-8f03fb061cde tempest-VolumesTransfersTest-1337534811 None] Lock "cinder-070a9c94-5877-426f-9b13-7d38dabe808a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:28:37 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b5111fc5-055a-4658-bf67-8f03fb061cde tempest-VolumesTransfersTest-1337534811 None] Acquiring lock "cinder-quobyte-070a9c94-5877-426f-9b13-7d38dabe808a" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:28:37 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b5111fc5-055a-4658-bf67-8f03fb061cde tempest-VolumesTransfersTest-1337534811 None] Lock "cinder-quobyte-070a9c94-5877-426f-9b13-7d38dabe808a" acquired by "delete_volume" :: waited 0.017s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:28:37 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b4fce4-937d-4c5b-9b01-13c12fa44122]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:28:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b5111fc5-055a-4658-bf67-8f03fb061cde tempest-VolumesTransfersTest-1337534811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-070a9c94-5877-426f-9b13-7d38dabe808a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:37 devstack sudo[98991]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_boldzsi5devstack@QuobyteHD" returned: 0 in 0.733s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:28:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:28:37 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1267547905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6be5aa9f2f504ff29a2302daf2d98e78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:28:35Z,use_quota=True,user_id='94562dc174d14bd7b571cd231454e21e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:28:37 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Creating volume 1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:28:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:28:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:28:37 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:28:37 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:28:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:28:37 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:28:37 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:28:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:37 devstack sudo[98999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb 1073741824 Jun 02 03:28:37 devstack sudo[98999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:37 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-070a9c94-5877-426f-9b13-7d38dabe808a Jun 02 03:28:37 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:37 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-8bb83fe2-9abd-4d11-80c7-03719771073a tempest-VolumesSnapshotListTestJSON-148761306 None] Acquiring lock "cinder-bee4363a-bdda-48c2-928f-452c0c7a1b53-delete_snapshot" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:28:37 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-8bb83fe2-9abd-4d11-80c7-03719771073a tempest-VolumesSnapshotListTestJSON-148761306 None] Lock "cinder-bee4363a-bdda-48c2-928f-452c0c7a1b53-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:28:37 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-8bb83fe2-9abd-4d11-80c7-03719771073a tempest-VolumesSnapshotListTestJSON-148761306 None] Acquiring lock "cinder-quobyte-fd19c8a9-9420-4a66-bbab-a4de69e16602" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:28:37 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-8bb83fe2-9abd-4d11-80c7-03719771073a tempest-VolumesSnapshotListTestJSON-148761306 None] Lock "cinder-quobyte-fd19c8a9-9420-4a66-bbab-a4de69e16602" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:28:37 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-8bb83fe2-9abd-4d11-80c7-03719771073a tempest-VolumesSnapshotListTestJSON-148761306 None] Acquiring lock "cinder-quobyte-bee4363a-bdda-48c2-928f-452c0c7a1b53" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:28:37 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:37 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-8bb83fe2-9abd-4d11-80c7-03719771073a tempest-VolumesSnapshotListTestJSON-148761306 None] Lock "cinder-quobyte-bee4363a-bdda-48c2-928f-452c0c7a1b53" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:28:37 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-8bb83fe2-9abd-4d11-80c7-03719771073a tempest-VolumesSnapshotListTestJSON-148761306 None] Deleting offline snapshot bee4363a-bdda-48c2-928f-452c0c7a1b53 of volume fd19c8a9-9420-4a66-bbab-a4de69e16602 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:28:37 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-8bb83fe2-9abd-4d11-80c7-03719771073a tempest-VolumesSnapshotListTestJSON-148761306 None] snapshot_file for this snap is: volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.bee4363a-bdda-48c2-928f-452c0c7a1b53 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:28:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b5111fc5-055a-4658-bf67-8f03fb061cde tempest-VolumesTransfersTest-1337534811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-070a9c94-5877-426f-9b13-7d38dabe808a" returned: 0 in 0.754s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b5111fc5-055a-4658-bf67-8f03fb061cde tempest-VolumesTransfersTest-1337534811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-070a9c94-5877-426f-9b13-7d38dabe808a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:37 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c354351-0158-4b00-9b7b-0094fb96147a]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:28:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8bb83fe2-9abd-4d11-80c7-03719771073a tempest-VolumesSnapshotListTestJSON-148761306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.bee4363a-bdda-48c2-928f-452c0c7a1b53 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:37 devstack sudo[99009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-070a9c94-5877-426f-9b13-7d38dabe808a Jun 02 03:28:37 devstack sudo[99009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:38 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.bee4363a-bdda-48c2-928f-452c0c7a1b53 Jun 02 03:28:38 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:38 devstack sudo[98999]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb 1073741824" returned: 0 in 0.852s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:38 devstack sudo[99013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb Jun 02 03:28:38 devstack sudo[99013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:38 devstack sudo[99009]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b5111fc5-055a-4658-bf67-8f03fb061cde tempest-VolumesTransfersTest-1337534811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-070a9c94-5877-426f-9b13-7d38dabe808a" returned: 0 in 0.632s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:38 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b5111fc5-055a-4658-bf67-8f03fb061cde tempest-VolumesTransfersTest-1337534811 None] Lock "cinder-quobyte-070a9c94-5877-426f-9b13-7d38dabe808a" released by "delete_volume" :: held 1.434s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:28:38 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-b5111fc5-055a-4658-bf67-8f03fb061cde tempest-VolumesTransfersTest-1337534811 None] Created reservations ['bfa8ff44-4057-4dd9-99f3-5d695006eaaf', '97360cae-ea53-4cb0-b0b1-049624c4f45f', '7ca66de3-c6a7-4377-8893-aea5f823f79d', 'd48121cf-15c7-44be-aece-2f19d7eedeb3'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:28:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b5111fc5-055a-4658-bf67-8f03fb061cde tempest-VolumesTransfersTest-1337534811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:28:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b5111fc5-055a-4658-bf67-8f03fb061cde tempest-VolumesTransfersTest-1337534811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:28:38 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:38 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b5111fc5-055a-4658-bf67-8f03fb061cde tempest-VolumesTransfersTest-1337534811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:28:38 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b5111fc5-055a-4658-bf67-8f03fb061cde tempest-VolumesTransfersTest-1337534811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:28:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b5111fc5-055a-4658-bf67-8f03fb061cde tempest-VolumesTransfersTest-1337534811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:28:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b5111fc5-055a-4658-bf67-8f03fb061cde tempest-VolumesTransfersTest-1337534811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8bb83fe2-9abd-4d11-80c7-03719771073a tempest-VolumesSnapshotListTestJSON-148761306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.bee4363a-bdda-48c2-928f-452c0c7a1b53" returned: 0 in 0.795s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:38 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-8bb83fe2-9abd-4d11-80c7-03719771073a tempest-VolumesSnapshotListTestJSON-148761306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd19c8a9-9420-4a66-bbab-a4de69e16602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:28:38 devstack sudo[99013]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:38 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:28:38 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb" returned: 0 in 0.634s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:38 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:28:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:28:38 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d26173b-1e70-4e95-b138-f37a6587485a]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:28:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8bb83fe2-9abd-4d11-80c7-03719771073a tempest-VolumesSnapshotListTestJSON-148761306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:38 devstack cinder-volume[86431]: DEBUG cinder.volume.volume_utils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Attempting download of 54f2c102-8f54-4d66-966a-3fc746680841 ((None, [{'url': 'file:///opt/stack/data/glance/images/54f2c102-8f54-4d66-966a-3fc746680841', 'metadata': {}}])) to volume 1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb. {{(pid=86431) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 02 03:28:38 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad97c15-834e-4fc0-8192-a3dee3eb8850]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:28:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54f2c102-8f54-4d66-966a-3fc746680841_afjshn4m {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:38 devstack sudo[99023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602 Jun 02 03:28:38 devstack sudo[99023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:38 devstack sudo[99024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54f2c102-8f54-4d66-966a-3fc746680841_afjshn4m Jun 02 03:28:38 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:39 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b5111fc5-055a-4658-bf67-8f03fb061cde tempest-VolumesTransfersTest-1337534811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.785s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:39 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-b5111fc5-055a-4658-bf67-8f03fb061cde tempest-VolumesTransfersTest-1337534811 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:28:39 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-b5111fc5-055a-4658-bf67-8f03fb061cde tempest-VolumesTransfersTest-1337534811 None] Deleted volume successfully. Jun 02 03:28:39 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b5111fc5-055a-4658-bf67-8f03fb061cde tempest-VolumesTransfersTest-1337534811 None] Lock "cinder-070a9c94-5877-426f-9b13-7d38dabe808a-delete_volume" released by "delete_volume" :: held 2.492s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:28:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54f2c102-8f54-4d66-966a-3fc746680841_afjshn4m" returned: 0 in 0.846s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54f2c102-8f54-4d66-966a-3fc746680841_afjshn4m {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:39 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:39 devstack sudo[99023]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8bb83fe2-9abd-4d11-80c7-03719771073a tempest-VolumesSnapshotListTestJSON-148761306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602" returned: 0 in 1.036s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8bb83fe2-9abd-4d11-80c7-03719771073a tempest-VolumesSnapshotListTestJSON-148761306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.bee4363a-bdda-48c2-928f-452c0c7a1b53 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:39 devstack sudo[99034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54f2c102-8f54-4d66-966a-3fc746680841_afjshn4m Jun 02 03:28:39 devstack sudo[99034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:39 devstack sudo[99035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.bee4363a-bdda-48c2-928f-452c0c7a1b53 Jun 02 03:28:39 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:40 devstack sudo[99034]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54f2c102-8f54-4d66-966a-3fc746680841_afjshn4m" returned: 1 in 0.794s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54f2c102-8f54-4d66-966a-3fc746680841_afjshn4m' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:28:40 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[93da0367-1c42-4c5a-94eb-9618ed5d9895]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:28:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_boldzsi5devstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:40 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:40 devstack sudo[99043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_boldzsi5devstack@QuobyteHD Jun 02 03:28:40 devstack sudo[99043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8bb83fe2-9abd-4d11-80c7-03719771073a tempest-VolumesSnapshotListTestJSON-148761306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.bee4363a-bdda-48c2-928f-452c0c7a1b53" returned: 0 in 0.826s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8bb83fe2-9abd-4d11-80c7-03719771073a tempest-VolumesSnapshotListTestJSON-148761306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.bee4363a-bdda-48c2-928f-452c0c7a1b53 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:40 devstack sudo[99045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.bee4363a-bdda-48c2-928f-452c0c7a1b53 Jun 02 03:28:40 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:41 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8bb83fe2-9abd-4d11-80c7-03719771073a tempest-VolumesSnapshotListTestJSON-148761306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602.bee4363a-bdda-48c2-928f-452c0c7a1b53" returned: 0 in 0.660s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:41 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-8bb83fe2-9abd-4d11-80c7-03719771073a tempest-VolumesSnapshotListTestJSON-148761306 None] Lock "cinder-quobyte-bee4363a-bdda-48c2-928f-452c0c7a1b53" released by "_delete_snapshot" :: held 3.457s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:28:41 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-8bb83fe2-9abd-4d11-80c7-03719771073a tempest-VolumesSnapshotListTestJSON-148761306 None] Lock "cinder-quobyte-fd19c8a9-9420-4a66-bbab-a4de69e16602" released by "delete_snapshot" :: held 3.492s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:28:41 devstack sudo[99043]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_boldzsi5devstack@QuobyteHD" returned: 0 in 0.916s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:41 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] 54f2c102-8f54-4d66-966a-3fc746680841 was qcow2, converting to raw {{(pid=86431) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 02 03:28:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_boldzsi5devstack@QuobyteHD /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:41 devstack sudo[99051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_boldzsi5devstack@QuobyteHD /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb Jun 02 03:28:41 devstack sudo[99051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:41 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-8bb83fe2-9abd-4d11-80c7-03719771073a tempest-VolumesSnapshotListTestJSON-148761306 None] Created reservations ['59d3534d-102c-4c27-bb13-45cca0d07842', '83f494f0-e4dd-4d62-93d0-6421e7265ece', 'b6b818db-550e-41af-ab8b-b38fe443309b', '13a00d54-5839-424a-864d-1c5995b357b3'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:28:41 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-8bb83fe2-9abd-4d11-80c7-03719771073a tempest-VolumesSnapshotListTestJSON-148761306 None] Delete snapshot completed successfully. Jun 02 03:28:41 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-8bb83fe2-9abd-4d11-80c7-03719771073a tempest-VolumesSnapshotListTestJSON-148761306 None] Lock "cinder-bee4363a-bdda-48c2-928f-452c0c7a1b53-delete_snapshot" released by "delete_snapshot" :: held 3.860s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:28:42 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2e4b447e-ec7e-4bc1-8f70-30b9256654a6 tempest-VolumesSnapshotListTestJSON-148761306 None] Acquiring lock "cinder-fd19c8a9-9420-4a66-bbab-a4de69e16602-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:28:42 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2e4b447e-ec7e-4bc1-8f70-30b9256654a6 tempest-VolumesSnapshotListTestJSON-148761306 None] Lock "cinder-fd19c8a9-9420-4a66-bbab-a4de69e16602-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:28:42 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2e4b447e-ec7e-4bc1-8f70-30b9256654a6 tempest-VolumesSnapshotListTestJSON-148761306 None] Acquiring lock "cinder-quobyte-fd19c8a9-9420-4a66-bbab-a4de69e16602" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:28:42 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2e4b447e-ec7e-4bc1-8f70-30b9256654a6 tempest-VolumesSnapshotListTestJSON-148761306 None] Lock "cinder-quobyte-fd19c8a9-9420-4a66-bbab-a4de69e16602" acquired by "delete_volume" :: waited 0.053s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:28:42 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5e2857-2a2c-43cd-b35d-df4c7f010e77]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:28:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2e4b447e-ec7e-4bc1-8f70-30b9256654a6 tempest-VolumesSnapshotListTestJSON-148761306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:42 devstack sudo[99059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602 Jun 02 03:28:42 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:43 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2e4b447e-ec7e-4bc1-8f70-30b9256654a6 tempest-VolumesSnapshotListTestJSON-148761306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602" returned: 0 in 0.892s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2e4b447e-ec7e-4bc1-8f70-30b9256654a6 tempest-VolumesSnapshotListTestJSON-148761306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:43 devstack sudo[99065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602 Jun 02 03:28:43 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:43 devstack sudo[99051]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_boldzsi5devstack@QuobyteHD /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb" returned: 0 in 2.435s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:43 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_boldzsi5devstack@QuobyteHD, size 112.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb {{(pid=86431) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 02 03:28:43 devstack cinder-volume[86431]: INFO cinder.image.image_utils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Converted 112.00 MB image at 45.96 MB/s Jun 02 03:28:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:43 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb 1G Jun 02 03:28:43 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:44 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2e4b447e-ec7e-4bc1-8f70-30b9256654a6 tempest-VolumesSnapshotListTestJSON-148761306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fd19c8a9-9420-4a66-bbab-a4de69e16602" returned: 0 in 0.801s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:44 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2e4b447e-ec7e-4bc1-8f70-30b9256654a6 tempest-VolumesSnapshotListTestJSON-148761306 None] Lock "cinder-quobyte-fd19c8a9-9420-4a66-bbab-a4de69e16602" released by "delete_volume" :: held 1.796s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:28:44 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-2e4b447e-ec7e-4bc1-8f70-30b9256654a6 tempest-VolumesSnapshotListTestJSON-148761306 None] Created reservations ['bf361843-d3ba-4492-b7bf-d38371dc9bc9', 'c7a35d00-083f-4db4-aa52-8d377766baa3', 'ed5a8997-1b23-44c5-9741-a594a1b7f2b5', 'fca1e342-a3e3-4059-adf7-5ae3a8fbadc6'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:28:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2e4b447e-ec7e-4bc1-8f70-30b9256654a6 tempest-VolumesSnapshotListTestJSON-148761306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:28:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2e4b447e-ec7e-4bc1-8f70-30b9256654a6 tempest-VolumesSnapshotListTestJSON-148761306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:28:44 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-2e4b447e-ec7e-4bc1-8f70-30b9256654a6 tempest-VolumesSnapshotListTestJSON-148761306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:28:44 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-2e4b447e-ec7e-4bc1-8f70-30b9256654a6 tempest-VolumesSnapshotListTestJSON-148761306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:28:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2e4b447e-ec7e-4bc1-8f70-30b9256654a6 tempest-VolumesSnapshotListTestJSON-148761306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:28:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2e4b447e-ec7e-4bc1-8f70-30b9256654a6 tempest-VolumesSnapshotListTestJSON-148761306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:44 devstack sudo[99070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:28:44 devstack sudo[99070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:44 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb 1G" returned: 0 in 0.883s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:44 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceebb729-0823-4a93-9da2-d06f5d753e7f]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:28:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:44 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb Jun 02 03:28:44 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:45 devstack sudo[99070]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2e4b447e-ec7e-4bc1-8f70-30b9256654a6 tempest-VolumesSnapshotListTestJSON-148761306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.716s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:45 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-2e4b447e-ec7e-4bc1-8f70-30b9256654a6 tempest-VolumesSnapshotListTestJSON-148761306 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:28:45 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-2e4b447e-ec7e-4bc1-8f70-30b9256654a6 tempest-VolumesSnapshotListTestJSON-148761306 None] Deleted volume successfully. Jun 02 03:28:45 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2e4b447e-ec7e-4bc1-8f70-30b9256654a6 tempest-VolumesSnapshotListTestJSON-148761306 None] Lock "cinder-fd19c8a9-9420-4a66-bbab-a4de69e16602-delete_volume" released by "delete_volume" :: held 2.823s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:28:45 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb" returned: 0 in 0.801s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:45 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb Jun 02 03:28:45 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:46 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb" returned: 1 in 0.805s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:28:46 devstack cinder-volume[86431]: DEBUG cinder.volume.volume_utils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Downloaded image 54f2c102-8f54-4d66-966a-3fc746680841 ((None, [{'url': 'file:///opt/stack/data/glance/images/54f2c102-8f54-4d66-966a-3fc746680841', 'metadata': {}}])) to volume 1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb successfully. {{(pid=86431) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 02 03:28:46 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Temporary image 54f2c102-8f54-4d66-966a-3fc746680841 for user 94562dc174d14bd7b571cd231454e21e is deleted. {{(pid=86431) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 02 03:28:46 devstack cinder-volume[86431]: DEBUG cinder.volume.volume_utils [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Marking volume 1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb as bootable. {{(pid=86431) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 02 03:28:46 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Copying metadata from image 54f2c102-8f54-4d66-966a-3fc746680841 to 1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb. {{(pid=86431) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 02 03:28:46 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Creating volume glance metadata for volume 1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb backed by image 54f2c102-8f54-4d66-966a-3fc746680841 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '54f2c102-8f54-4d66-966a-3fc746680841', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86431) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 02 03:28:46 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b217495-8ba5-4427-9c64-ef57a3f4de0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb', 'volume_size': 1, 'image_id': '54f2c102-8f54-4d66-966a-3fc746680841', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54f2c102-8f54-4d66-966a-3fc746680841', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48b06555345b4428a30a6f37e96ddabe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '54f2c102-8f54-4d66-966a-3fc746680841', 'created_at': datetime.datetime(2026, 6, 2, 1, 9, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 1, 9, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54f2c102-8f54-4d66-966a-3fc746680841/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:28:46 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba00cc87-2f83-4da2-8c61-c2765cf664b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:28:46 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Volume volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb (1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb): created successfully Jun 02 03:28:46 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba00cc87-2f83-4da2-8c61-c2765cf664b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:28:46 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Flow 'volume_create_manager' (4be8b171-acdd-469e-ba2d-f0177e847180) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:28:46 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-349a0887-bf62-4f56-8d54-7bbcefb91e73 tempest-TestShelveInstance-217844603 None] Created volume successfully. Jun 02 03:28:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-a38dbc2e-70a2-452f-9768-10e92f716183 req-a68d8e58-3139-4a01-9536-230696760aa5 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:28:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-a38dbc2e-70a2-452f-9768-10e92f716183 req-a68d8e58-3139-4a01-9536-230696760aa5 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:28:48 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[d085bff4-3acf-4e38-8399-7849c267063d]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:28:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-a38dbc2e-70a2-452f-9768-10e92f716183 req-a68d8e58-3139-4a01-9536-230696760aa5 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-58912baa-273a-4f1a-8a54-504417438ec5 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:48 devstack sudo[99093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-58912baa-273a-4f1a-8a54-504417438ec5 Jun 02 03:28:48 devstack sudo[99093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:48 devstack sudo[99093]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-a38dbc2e-70a2-452f-9768-10e92f716183 req-a68d8e58-3139-4a01-9536-230696760aa5 tempest-TestServerVolumeAttachmentScenario-1432150825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-58912baa-273a-4f1a-8a54-504417438ec5" returned: 0 in 0.874s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-a38dbc2e-70a2-452f-9768-10e92f716183 req-a68d8e58-3139-4a01-9536-230696760aa5 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.896s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:28:48 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-a38dbc2e-70a2-452f-9768-10e92f716183 req-a68d8e58-3139-4a01-9536-230696760aa5 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1', 'name': 'volume-58912baa-273a-4f1a-8a54-504417438ec5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3c7fd5f0-19b7-4eca-a84b-6389f958eef8', 'enforce_multipath': True} {{(pid=86431) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 02 03:28:48 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-a38dbc2e-70a2-452f-9768-10e92f716183 req-a68d8e58-3139-4a01-9536-230696760aa5 tempest-TestServerVolumeAttachmentScenario-1432150825 None] attachment_update completed successfully. Jun 02 03:28:54 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-2def3de9-9afc-4e69-8456-88044def286a req-fcbf7f50-fc34-44ff-9701-70eb98e4879b tempest-TestServerVolumeAttachmentScenario-1432150825 None] Terminate volume connection completed successfully. Jun 02 03:28:54 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-2def3de9-9afc-4e69-8456-88044def286a req-fcbf7f50-fc34-44ff-9701-70eb98e4879b tempest-TestServerVolumeAttachmentScenario-1432150825 None] Deleting attachment 3c7fd5f0-19b7-4eca-a84b-6389f958eef8. {{(pid=86431) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 02 03:28:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-64cdf7ee-6863-47ab-a49c-eac7624e5910 req-f47ccb33-3f79-4cbf-8157-134d1ba8a30f tempest-TestShelveInstance-217844603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:28:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-64cdf7ee-6863-47ab-a49c-eac7624e5910 req-f47ccb33-3f79-4cbf-8157-134d1ba8a30f tempest-TestShelveInstance-217844603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:28:55 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdf5fb5-55ad-4853-aa7f-173e11dd3270]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:28:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-64cdf7ee-6863-47ab-a49c-eac7624e5910 req-f47ccb33-3f79-4cbf-8157-134d1ba8a30f tempest-TestShelveInstance-217844603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:55 devstack sudo[99137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb Jun 02 03:28:55 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:56 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-64cdf7ee-6863-47ab-a49c-eac7624e5910 req-f47ccb33-3f79-4cbf-8157-134d1ba8a30f tempest-TestShelveInstance-217844603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb" returned: 0 in 1.068s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-64cdf7ee-6863-47ab-a49c-eac7624e5910 req-f47ccb33-3f79-4cbf-8157-134d1ba8a30f tempest-TestShelveInstance-217844603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:56 devstack sudo[99141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb Jun 02 03:28:56 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:56 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc48261e-32e3-4c6e-a18a-2821ca8eb88f tempest-VolumesActionsTest-1558050684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:28:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fc48261e-32e3-4c6e-a18a-2821ca8eb88f tempest-VolumesActionsTest-1558050684 None] Flow 'volume_create_manager' (e240c80c-2db4-48ca-91d2-9792f719923d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:28:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fc48261e-32e3-4c6e-a18a-2821ca8eb88f tempest-VolumesActionsTest-1558050684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e19513ad-4cf0-4ec4-bfda-428ee8cd1529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:28:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fc48261e-32e3-4c6e-a18a-2821ca8eb88f tempest-VolumesActionsTest-1558050684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e19513ad-4cf0-4ec4-bfda-428ee8cd1529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1484417812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8db5193-e350-46f0-98cd-1ea4eed9f539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84a90f3fb9bb41d2be2a8cc5f913f964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:28:57Z,use_quota=True,user_id='ffd867af6997463c9102ea1cf87e69c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:28:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fc48261e-32e3-4c6e-a18a-2821ca8eb88f tempest-VolumesActionsTest-1558050684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dad92ba-0ac1-43f1-a7d3-1306c2fb22d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:28:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fc48261e-32e3-4c6e-a18a-2821ca8eb88f tempest-VolumesActionsTest-1558050684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dad92ba-0ac1-43f1-a7d3-1306c2fb22d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:28:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fc48261e-32e3-4c6e-a18a-2821ca8eb88f tempest-VolumesActionsTest-1558050684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc2f4782-7e34-4a97-9e86-21d9a276a8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:28:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fc48261e-32e3-4c6e-a18a-2821ca8eb88f tempest-VolumesActionsTest-1558050684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc2f4782-7e34-4a97-9e86-21d9a276a8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8db5193-e350-46f0-98cd-1ea4eed9f539', 'volume_name': 'volume-c8db5193-e350-46f0-98cd-1ea4eed9f539', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:28:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fc48261e-32e3-4c6e-a18a-2821ca8eb88f tempest-VolumesActionsTest-1558050684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (375e1908-7822-4d11-8f67-29cb1d98416a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:28:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fc48261e-32e3-4c6e-a18a-2821ca8eb88f tempest-VolumesActionsTest-1558050684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (375e1908-7822-4d11-8f67-29cb1d98416a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:28:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fc48261e-32e3-4c6e-a18a-2821ca8eb88f tempest-VolumesActionsTest-1558050684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3bd6a23-9794-4d93-827f-35043ec850f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:28:57 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-fc48261e-32e3-4c6e-a18a-2821ca8eb88f tempest-VolumesActionsTest-1558050684 None] Volume c8db5193-e350-46f0-98cd-1ea4eed9f539: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8db5193-e350-46f0-98cd-1ea4eed9f539', 'volume_size': 1} Jun 02 03:28:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fc48261e-32e3-4c6e-a18a-2821ca8eb88f tempest-VolumesActionsTest-1558050684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:28:57 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-64cdf7ee-6863-47ab-a49c-eac7624e5910 req-f47ccb33-3f79-4cbf-8157-134d1ba8a30f tempest-TestShelveInstance-217844603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb" returned: 1 in 1.010s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-64cdf7ee-6863-47ab-a49c-eac7624e5910 req-f47ccb33-3f79-4cbf-8157-134d1ba8a30f tempest-TestShelveInstance-217844603 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:28:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-64cdf7ee-6863-47ab-a49c-eac7624e5910 req-f47ccb33-3f79-4cbf-8157-134d1ba8a30f tempest-TestShelveInstance-217844603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.133s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:28:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fc48261e-32e3-4c6e-a18a-2821ca8eb88f tempest-VolumesActionsTest-1558050684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.690s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:28:57 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-fc48261e-32e3-4c6e-a18a-2821ca8eb88f tempest-VolumesActionsTest-1558050684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1484417812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8db5193-e350-46f0-98cd-1ea4eed9f539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84a90f3fb9bb41d2be2a8cc5f913f964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:28:57Z,use_quota=True,user_id='ffd867af6997463c9102ea1cf87e69c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:28:57 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-fc48261e-32e3-4c6e-a18a-2821ca8eb88f tempest-VolumesActionsTest-1558050684 None] Creating volume c8db5193-e350-46f0-98cd-1ea4eed9f539 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:28:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fc48261e-32e3-4c6e-a18a-2821ca8eb88f tempest-VolumesActionsTest-1558050684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:28:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fc48261e-32e3-4c6e-a18a-2821ca8eb88f tempest-VolumesActionsTest-1558050684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:28:57 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-fc48261e-32e3-4c6e-a18a-2821ca8eb88f tempest-VolumesActionsTest-1558050684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:28:57 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-fc48261e-32e3-4c6e-a18a-2821ca8eb88f tempest-VolumesActionsTest-1558050684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:28:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fc48261e-32e3-4c6e-a18a-2821ca8eb88f tempest-VolumesActionsTest-1558050684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:28:57 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-fc48261e-32e3-4c6e-a18a-2821ca8eb88f tempest-VolumesActionsTest-1558050684 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:28:57 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-fc48261e-32e3-4c6e-a18a-2821ca8eb88f tempest-VolumesActionsTest-1558050684 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:28:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fc48261e-32e3-4c6e-a18a-2821ca8eb88f tempest-VolumesActionsTest-1558050684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:57 devstack sudo[99146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539 1073741824 Jun 02 03:28:57 devstack sudo[99146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-64cdf7ee-6863-47ab-a49c-eac7624e5910 req-f47ccb33-3f79-4cbf-8157-134d1ba8a30f tempest-TestShelveInstance-217844603 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1', 'name': 'volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '959086f4-5535-4deb-868d-1ddd40303f93', 'enforce_multipath': True} {{(pid=86431) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 02 03:28:57 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-64cdf7ee-6863-47ab-a49c-eac7624e5910 req-f47ccb33-3f79-4cbf-8157-134d1ba8a30f tempest-TestShelveInstance-217844603 None] attachment_update completed successfully. Jun 02 03:28:58 devstack sudo[99146]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fc48261e-32e3-4c6e-a18a-2821ca8eb88f tempest-VolumesActionsTest-1558050684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539 1073741824" returned: 0 in 1.075s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fc48261e-32e3-4c6e-a18a-2821ca8eb88f tempest-VolumesActionsTest-1558050684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:28:58 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-9c55d9c4-42f9-4cbd-887d-16c89b9ed6fc req-7197ee3a-c0d0-4c65-a6f4-670f63e1ca88 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Terminate volume connection completed successfully. Jun 02 03:28:58 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-9c55d9c4-42f9-4cbd-887d-16c89b9ed6fc req-7197ee3a-c0d0-4c65-a6f4-670f63e1ca88 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Deleting attachment d35c137a-cb49-4378-99d7-ac7f3ce9570e. {{(pid=86431) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 02 03:28:58 devstack sudo[99157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539 Jun 02 03:28:58 devstack sudo[99157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:28:59 devstack sudo[99157]: pam_unix(sudo:session): session closed for user root Jun 02 03:28:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fc48261e-32e3-4c6e-a18a-2821ca8eb88f tempest-VolumesActionsTest-1558050684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539" returned: 0 in 0.681s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:28:59 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-fc48261e-32e3-4c6e-a18a-2821ca8eb88f tempest-VolumesActionsTest-1558050684 None] <== create_volume: return (1819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:28:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fc48261e-32e3-4c6e-a18a-2821ca8eb88f tempest-VolumesActionsTest-1558050684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.822s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:28:59 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fc48261e-32e3-4c6e-a18a-2821ca8eb88f tempest-VolumesActionsTest-1558050684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3bd6a23-9794-4d93-827f-35043ec850f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8db5193-e350-46f0-98cd-1ea4eed9f539', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:28:59 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fc48261e-32e3-4c6e-a18a-2821ca8eb88f tempest-VolumesActionsTest-1558050684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aad883f-a9d0-4f24-a852-b222f1e1988b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:28:59 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-fc48261e-32e3-4c6e-a18a-2821ca8eb88f tempest-VolumesActionsTest-1558050684 None] Volume volume-c8db5193-e350-46f0-98cd-1ea4eed9f539 (c8db5193-e350-46f0-98cd-1ea4eed9f539): created successfully Jun 02 03:28:59 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fc48261e-32e3-4c6e-a18a-2821ca8eb88f tempest-VolumesActionsTest-1558050684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aad883f-a9d0-4f24-a852-b222f1e1988b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:28:59 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fc48261e-32e3-4c6e-a18a-2821ca8eb88f tempest-VolumesActionsTest-1558050684 None] Flow 'volume_create_manager' (e240c80c-2db4-48ca-91d2-9792f719923d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:28:59 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-fc48261e-32e3-4c6e-a18a-2821ca8eb88f tempest-VolumesActionsTest-1558050684 None] Created volume successfully. Jun 02 03:29:09 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:29:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:29:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:29:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:29:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:29:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:29:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:09 devstack sudo[99727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:29:09 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:09 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=84,cinder:UPDATE=92,cinder:INSERT=23,cinder:DELETE=5 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:29:09 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:UPDATE=85,cinder:SELECT=98,cinder:DELETE=9,cinder:INSERT=32 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:29:10 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.818s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:10 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:29:10 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager._thread_info {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:29:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread count: 28 {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 02 03:29:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread info: [<_MainThread(MainThread, started 138618128814208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 02 03:29:12 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-401d4c5b-e2c2-40b2-9ca3-67484e7896f0 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Acquiring lock "cinder-58912baa-273a-4f1a-8a54-504417438ec5-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:29:12 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-401d4c5b-e2c2-40b2-9ca3-67484e7896f0 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Lock "cinder-58912baa-273a-4f1a-8a54-504417438ec5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:29:12 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-401d4c5b-e2c2-40b2-9ca3-67484e7896f0 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Acquiring lock "cinder-quobyte-58912baa-273a-4f1a-8a54-504417438ec5" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:29:12 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-401d4c5b-e2c2-40b2-9ca3-67484e7896f0 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Lock "cinder-quobyte-58912baa-273a-4f1a-8a54-504417438ec5" acquired by "delete_volume" :: waited 0.024s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:29:12 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ffcdb2-8d1d-4ed9-a8a5-028d964b0fe1]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:29:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-401d4c5b-e2c2-40b2-9ca3-67484e7896f0 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-58912baa-273a-4f1a-8a54-504417438ec5 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:12 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-58912baa-273a-4f1a-8a54-504417438ec5 Jun 02 03:29:12 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:12 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-401d4c5b-e2c2-40b2-9ca3-67484e7896f0 tempest-TestServerVolumeAttachmentScenario-1432150825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-58912baa-273a-4f1a-8a54-504417438ec5" returned: 0 in 0.843s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-401d4c5b-e2c2-40b2-9ca3-67484e7896f0 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-58912baa-273a-4f1a-8a54-504417438ec5 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:12 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-58912baa-273a-4f1a-8a54-504417438ec5 Jun 02 03:29:12 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:13 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-401d4c5b-e2c2-40b2-9ca3-67484e7896f0 tempest-TestServerVolumeAttachmentScenario-1432150825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-58912baa-273a-4f1a-8a54-504417438ec5" returned: 0 in 0.627s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:13 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-401d4c5b-e2c2-40b2-9ca3-67484e7896f0 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Lock "cinder-quobyte-58912baa-273a-4f1a-8a54-504417438ec5" released by "delete_volume" :: held 1.516s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:29:13 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-401d4c5b-e2c2-40b2-9ca3-67484e7896f0 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Created reservations ['c348a6aa-a69e-46a8-b1c8-19288472b46b', '1707c2c0-4248-4d9c-b483-9c244bb8a022', 'b5387089-2959-4e4e-9aed-614bf07aaf8c', 'feda2708-e231-4021-a378-f880806cd46e'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:29:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-401d4c5b-e2c2-40b2-9ca3-67484e7896f0 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:29:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-401d4c5b-e2c2-40b2-9ca3-67484e7896f0 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:29:13 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-401d4c5b-e2c2-40b2-9ca3-67484e7896f0 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:29:13 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-401d4c5b-e2c2-40b2-9ca3-67484e7896f0 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:29:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-401d4c5b-e2c2-40b2-9ca3-67484e7896f0 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:29:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-401d4c5b-e2c2-40b2-9ca3-67484e7896f0 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:13 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:29:13 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:14 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4ca77637-bc38-43fe-aa4a-1a7ae96bc479 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Acquiring lock "cinder-e5b3727e-fda2-46a1-b763-98a74d870fed-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:29:14 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4ca77637-bc38-43fe-aa4a-1a7ae96bc479 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Lock "cinder-e5b3727e-fda2-46a1-b763-98a74d870fed-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:29:14 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4ca77637-bc38-43fe-aa4a-1a7ae96bc479 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Acquiring lock "cinder-quobyte-e5b3727e-fda2-46a1-b763-98a74d870fed" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:29:14 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4ca77637-bc38-43fe-aa4a-1a7ae96bc479 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Lock "cinder-quobyte-e5b3727e-fda2-46a1-b763-98a74d870fed" acquired by "delete_volume" :: waited 0.042s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:29:14 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a932764-ba01-4679-9c5e-7ed4e93d81cb]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:29:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4ca77637-bc38-43fe-aa4a-1a7ae96bc479 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e5b3727e-fda2-46a1-b763-98a74d870fed {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:14 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e5b3727e-fda2-46a1-b763-98a74d870fed Jun 02 03:29:14 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:15 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-401d4c5b-e2c2-40b2-9ca3-67484e7896f0 tempest-TestServerVolumeAttachmentScenario-1432150825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 1.304s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:15 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-401d4c5b-e2c2-40b2-9ca3-67484e7896f0 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:29:15 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-401d4c5b-e2c2-40b2-9ca3-67484e7896f0 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Deleted volume successfully. Jun 02 03:29:15 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-401d4c5b-e2c2-40b2-9ca3-67484e7896f0 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Lock "cinder-58912baa-273a-4f1a-8a54-504417438ec5-delete_volume" released by "delete_volume" :: held 3.079s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:29:15 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4ca77637-bc38-43fe-aa4a-1a7ae96bc479 tempest-TestServerVolumeAttachmentScenario-1432150825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e5b3727e-fda2-46a1-b763-98a74d870fed" returned: 0 in 0.983s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4ca77637-bc38-43fe-aa4a-1a7ae96bc479 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e5b3727e-fda2-46a1-b763-98a74d870fed {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:15 devstack sudo[99815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e5b3727e-fda2-46a1-b763-98a74d870fed Jun 02 03:29:15 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:16 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4ca77637-bc38-43fe-aa4a-1a7ae96bc479 tempest-TestServerVolumeAttachmentScenario-1432150825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e5b3727e-fda2-46a1-b763-98a74d870fed" returned: 0 in 0.643s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:16 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4ca77637-bc38-43fe-aa4a-1a7ae96bc479 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Lock "cinder-quobyte-e5b3727e-fda2-46a1-b763-98a74d870fed" released by "delete_volume" :: held 1.708s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:29:16 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-4ca77637-bc38-43fe-aa4a-1a7ae96bc479 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Created reservations ['f32917bb-73d9-4bbd-b010-e5ee6f73452e', 'e51b2552-8138-49c6-a1c6-6a7962a50dc0', '15453325-e2d2-486d-aa7e-fde41b2c2129', 'cb45a0d2-e7ac-4740-8a20-587fea9f2d0d'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:29:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4ca77637-bc38-43fe-aa4a-1a7ae96bc479 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:29:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4ca77637-bc38-43fe-aa4a-1a7ae96bc479 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:29:16 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-4ca77637-bc38-43fe-aa4a-1a7ae96bc479 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:29:16 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-4ca77637-bc38-43fe-aa4a-1a7ae96bc479 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:29:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4ca77637-bc38-43fe-aa4a-1a7ae96bc479 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:29:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4ca77637-bc38-43fe-aa4a-1a7ae96bc479 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:16 devstack sudo[99820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:29:16 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:17 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4ca77637-bc38-43fe-aa4a-1a7ae96bc479 tempest-TestServerVolumeAttachmentScenario-1432150825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.969s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:17 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-4ca77637-bc38-43fe-aa4a-1a7ae96bc479 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:29:17 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-4ca77637-bc38-43fe-aa4a-1a7ae96bc479 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Deleted volume successfully. Jun 02 03:29:17 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4ca77637-bc38-43fe-aa4a-1a7ae96bc479 tempest-TestServerVolumeAttachmentScenario-1432150825 None] Lock "cinder-e5b3727e-fda2-46a1-b763-98a74d870fed-delete_volume" released by "delete_volume" :: held 3.070s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:29:21 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-944312b1-b8c0-4c43-9839-3ca313dd79fb tempest-TestInstancesWithCinderVolumes-1072920434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:29:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-944312b1-b8c0-4c43-9839-3ca313dd79fb tempest-TestInstancesWithCinderVolumes-1072920434 None] Flow 'volume_create_manager' (8d05dd0a-017d-42ff-8a46-33b4c9a922ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:29:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-944312b1-b8c0-4c43-9839-3ca313dd79fb tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e56485-acc6-4831-8af5-198c47532cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:29:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-944312b1-b8c0-4c43-9839-3ca313dd79fb tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e56485-acc6-4831-8af5-198c47532cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1314140534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=993e7a9b-b819-45eb-a2ad-d2b4e9ce694f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea982870bdbc4e72a84ec3e44a98c6f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:29:21Z,use_quota=True,user_id='344ef3a08dcb451a853005baf21e0794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2f00e2e-bc5d-4043-b589-c17146733047),volume_type_id=e2f00e2e-bc5d-4043-b589-c17146733047)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:29:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-944312b1-b8c0-4c43-9839-3ca313dd79fb tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5ec3f99-5254-459e-b7ee-bbfdf57a4d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:29:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-944312b1-b8c0-4c43-9839-3ca313dd79fb tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5ec3f99-5254-459e-b7ee-bbfdf57a4d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:29:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-944312b1-b8c0-4c43-9839-3ca313dd79fb tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f01542-c17b-4781-bd54-4dafe1da30bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:29:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-944312b1-b8c0-4c43-9839-3ca313dd79fb tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f01542-c17b-4781-bd54-4dafe1da30bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '993e7a9b-b819-45eb-a2ad-d2b4e9ce694f', 'volume_name': 'volume-993e7a9b-b819-45eb-a2ad-d2b4e9ce694f', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:29:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-944312b1-b8c0-4c43-9839-3ca313dd79fb tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (795d56b8-f32c-4962-9566-77497df0bd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:29:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-944312b1-b8c0-4c43-9839-3ca313dd79fb tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (795d56b8-f32c-4962-9566-77497df0bd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:29:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-944312b1-b8c0-4c43-9839-3ca313dd79fb tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82720661-8999-4cad-ae95-f79b4545404c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:29:21 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-944312b1-b8c0-4c43-9839-3ca313dd79fb tempest-TestInstancesWithCinderVolumes-1072920434 None] Volume 993e7a9b-b819-45eb-a2ad-d2b4e9ce694f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-993e7a9b-b819-45eb-a2ad-d2b4e9ce694f', 'volume_size': 1} Jun 02 03:29:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-944312b1-b8c0-4c43-9839-3ca313dd79fb tempest-TestInstancesWithCinderVolumes-1072920434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:29:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-944312b1-b8c0-4c43-9839-3ca313dd79fb tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:29:21 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-944312b1-b8c0-4c43-9839-3ca313dd79fb tempest-TestInstancesWithCinderVolumes-1072920434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1314140534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=993e7a9b-b819-45eb-a2ad-d2b4e9ce694f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea982870bdbc4e72a84ec3e44a98c6f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:29:21Z,use_quota=True,user_id='344ef3a08dcb451a853005baf21e0794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2f00e2e-bc5d-4043-b589-c17146733047),volume_type_id=e2f00e2e-bc5d-4043-b589-c17146733047)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:29:21 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-944312b1-b8c0-4c43-9839-3ca313dd79fb tempest-TestInstancesWithCinderVolumes-1072920434 None] Creating volume 993e7a9b-b819-45eb-a2ad-d2b4e9ce694f {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:29:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-944312b1-b8c0-4c43-9839-3ca313dd79fb tempest-TestInstancesWithCinderVolumes-1072920434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:29:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-944312b1-b8c0-4c43-9839-3ca313dd79fb tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:29:21 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-944312b1-b8c0-4c43-9839-3ca313dd79fb tempest-TestInstancesWithCinderVolumes-1072920434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:29:21 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-944312b1-b8c0-4c43-9839-3ca313dd79fb tempest-TestInstancesWithCinderVolumes-1072920434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:29:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-944312b1-b8c0-4c43-9839-3ca313dd79fb tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:29:21 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-944312b1-b8c0-4c43-9839-3ca313dd79fb tempest-TestInstancesWithCinderVolumes-1072920434 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:29:21 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-944312b1-b8c0-4c43-9839-3ca313dd79fb tempest-TestInstancesWithCinderVolumes-1072920434 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:29:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-944312b1-b8c0-4c43-9839-3ca313dd79fb tempest-TestInstancesWithCinderVolumes-1072920434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-993e7a9b-b819-45eb-a2ad-d2b4e9ce694f 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:21 devstack sudo[99855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-993e7a9b-b819-45eb-a2ad-d2b4e9ce694f 1073741824 Jun 02 03:29:21 devstack sudo[99855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:22 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-a45759f9-eede-4c3b-b8ce-2affb184de10 tempest-TestInstancesWithCinderVolumes-1072920434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:29:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a45759f9-eede-4c3b-b8ce-2affb184de10 tempest-TestInstancesWithCinderVolumes-1072920434 None] Flow 'volume_create_manager' (1da15133-69e5-40b6-95e7-1339c3810a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:29:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a45759f9-eede-4c3b-b8ce-2affb184de10 tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4eba343-33fb-4b06-a2b6-c81ab1353340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:29:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a45759f9-eede-4c3b-b8ce-2affb184de10 tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4eba343-33fb-4b06-a2b6-c81ab1353340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2090536525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b18b337-6aef-4aec-ab58-89d75dad1309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea982870bdbc4e72a84ec3e44a98c6f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:29:22Z,use_quota=True,user_id='344ef3a08dcb451a853005baf21e0794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dcbdb6d-204e-4730-90d3-59dd94bf1d64),volume_type_id=9dcbdb6d-204e-4730-90d3-59dd94bf1d64)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:29:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a45759f9-eede-4c3b-b8ce-2affb184de10 tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (819c29d1-9a90-4604-aae8-137c21e38932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:29:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a45759f9-eede-4c3b-b8ce-2affb184de10 tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (819c29d1-9a90-4604-aae8-137c21e38932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:29:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a45759f9-eede-4c3b-b8ce-2affb184de10 tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f20c52d3-f05e-4434-98a2-bf8be92c82d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:29:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a45759f9-eede-4c3b-b8ce-2affb184de10 tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f20c52d3-f05e-4434-98a2-bf8be92c82d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b18b337-6aef-4aec-ab58-89d75dad1309', 'volume_name': 'volume-7b18b337-6aef-4aec-ab58-89d75dad1309', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:29:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a45759f9-eede-4c3b-b8ce-2affb184de10 tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (600eb843-973b-43f3-b5e8-1209029e9fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:29:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a45759f9-eede-4c3b-b8ce-2affb184de10 tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (600eb843-973b-43f3-b5e8-1209029e9fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:29:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a45759f9-eede-4c3b-b8ce-2affb184de10 tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d657bfa6-b4cc-4015-a90f-4e6f4724bcd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:29:22 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-a45759f9-eede-4c3b-b8ce-2affb184de10 tempest-TestInstancesWithCinderVolumes-1072920434 None] Volume 7b18b337-6aef-4aec-ab58-89d75dad1309: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b18b337-6aef-4aec-ab58-89d75dad1309', 'volume_size': 1} Jun 02 03:29:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a45759f9-eede-4c3b-b8ce-2affb184de10 tempest-TestInstancesWithCinderVolumes-1072920434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:29:24 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:29:24 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Flow 'volume_create_manager' (77cafed9-68ea-4956-987e-84dd949a3865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:29:24 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f81d0b-0758-48ee-9b8e-fd56afd898de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:29:24 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f81d0b-0758-48ee-9b8e-fd56afd898de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-943643956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f25d535b-1ae2-47b0-a4c7-c18036e55a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea982870bdbc4e72a84ec3e44a98c6f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:29:24Z,use_quota=True,user_id='344ef3a08dcb451a853005baf21e0794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04be9f59-378a-446c-b467-556d80c4c4f1),volume_type_id=04be9f59-378a-446c-b467-556d80c4c4f1)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:29:24 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da87f6ec-14bb-47d4-8db5-675f3faa9f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:29:24 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da87f6ec-14bb-47d4-8db5-675f3faa9f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:29:24 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d0bda7c-9e0f-469a-b900-daa97dc3b426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:29:24 devstack cinder-volume[86431]: DEBUG cinder.image.glance [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Creating Keystone auth plugin from conf {{(pid=86431) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 02 03:29:24 devstack sudo[99855]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-944312b1-b8c0-4c43-9839-3ca313dd79fb tempest-TestInstancesWithCinderVolumes-1072920434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-993e7a9b-b819-45eb-a2ad-d2b4e9ce694f 1073741824" returned: 0 in 2.793s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-944312b1-b8c0-4c43-9839-3ca313dd79fb tempest-TestInstancesWithCinderVolumes-1072920434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-993e7a9b-b819-45eb-a2ad-d2b4e9ce694f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:24 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-993e7a9b-b819-45eb-a2ad-d2b4e9ce694f Jun 02 03:29:24 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:24 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d0bda7c-9e0f-469a-b900-daa97dc3b426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f25d535b-1ae2-47b0-a4c7-c18036e55a72', 'volume_name': 'volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72', 'volume_size': 1, 'image_id': '5d41e545-de88-46ba-a462-f443959d0b3f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d41e545-de88-46ba-a462-f443959d0b3f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2090848060', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea982870bdbc4e72a84ec3e44a98c6f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5d41e545-de88-46ba-a462-f443959d0b3f', 'created_at': datetime.datetime(2026, 6, 2, 1, 29, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 1, 29, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d41e545-de88-46ba-a462-f443959d0b3f/file', 'properties': {}}, 'image_service': }' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:29:24 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db6a9967-89ff-4631-b9b5-035a60fa3487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:29:24 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db6a9967-89ff-4631-b9b5-035a60fa3487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:29:24 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e01c6fd-c8f4-4cb1-97f1-4f7724afb6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:29:24 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Volume f25d535b-1ae2-47b0-a4c7-c18036e55a72: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72', 'volume_size': 1, 'image_id': '5d41e545-de88-46ba-a462-f443959d0b3f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d41e545-de88-46ba-a462-f443959d0b3f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2090848060', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea982870bdbc4e72a84ec3e44a98c6f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5d41e545-de88-46ba-a462-f443959d0b3f', 'created_at': datetime.datetime(2026, 6, 2, 1, 29, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 1, 29, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d41e545-de88-46ba-a462-f443959d0b3f/file', 'properties': {}}, 'image_service': } Jun 02 03:29:25 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Trying to clone f25d535b-1ae2-47b0-a4c7-c18036e55a72 from image 5d41e545-de88-46ba-a462-f443959d0b3f at location (None, [{'url': 'file:///opt/stack/data/glance/images/5d41e545-de88-46ba-a462-f443959d0b3f', 'metadata': {}}]). {{(pid=86431) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 02 03:29:25 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-944312b1-b8c0-4c43-9839-3ca313dd79fb tempest-TestInstancesWithCinderVolumes-1072920434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-993e7a9b-b819-45eb-a2ad-d2b4e9ce694f" returned: 0 in 1.404s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:25 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-944312b1-b8c0-4c43-9839-3ca313dd79fb tempest-TestInstancesWithCinderVolumes-1072920434 None] <== create_volume: return (4295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:29:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-944312b1-b8c0-4c43-9839-3ca313dd79fb tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.297s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:29:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a45759f9-eede-4c3b-b8ce-2affb184de10 tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.448s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:29:25 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a45759f9-eede-4c3b-b8ce-2affb184de10 tempest-TestInstancesWithCinderVolumes-1072920434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2090536525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b18b337-6aef-4aec-ab58-89d75dad1309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea982870bdbc4e72a84ec3e44a98c6f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:29:22Z,use_quota=True,user_id='344ef3a08dcb451a853005baf21e0794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dcbdb6d-204e-4730-90d3-59dd94bf1d64),volume_type_id=9dcbdb6d-204e-4730-90d3-59dd94bf1d64)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:29:26 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-a45759f9-eede-4c3b-b8ce-2affb184de10 tempest-TestInstancesWithCinderVolumes-1072920434 None] Creating volume 7b18b337-6aef-4aec-ab58-89d75dad1309 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:29:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a45759f9-eede-4c3b-b8ce-2affb184de10 tempest-TestInstancesWithCinderVolumes-1072920434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:29:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a45759f9-eede-4c3b-b8ce-2affb184de10 tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:29:26 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a45759f9-eede-4c3b-b8ce-2affb184de10 tempest-TestInstancesWithCinderVolumes-1072920434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:29:26 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a45759f9-eede-4c3b-b8ce-2affb184de10 tempest-TestInstancesWithCinderVolumes-1072920434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:29:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a45759f9-eede-4c3b-b8ce-2affb184de10 tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:29:26 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a45759f9-eede-4c3b-b8ce-2affb184de10 tempest-TestInstancesWithCinderVolumes-1072920434 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:29:26 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-a45759f9-eede-4c3b-b8ce-2affb184de10 tempest-TestInstancesWithCinderVolumes-1072920434 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:29:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a45759f9-eede-4c3b-b8ce-2affb184de10 tempest-TestInstancesWithCinderVolumes-1072920434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7b18b337-6aef-4aec-ab58-89d75dad1309 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-944312b1-b8c0-4c43-9839-3ca313dd79fb tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82720661-8999-4cad-ae95-f79b4545404c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-993e7a9b-b819-45eb-a2ad-d2b4e9ce694f', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:29:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-944312b1-b8c0-4c43-9839-3ca313dd79fb tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71b4940a-bd82-4a74-9421-8f95485dfd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:29:26 devstack sudo[99905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7b18b337-6aef-4aec-ab58-89d75dad1309 1073741824 Jun 02 03:29:26 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:26 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-944312b1-b8c0-4c43-9839-3ca313dd79fb tempest-TestInstancesWithCinderVolumes-1072920434 None] Volume volume-993e7a9b-b819-45eb-a2ad-d2b4e9ce694f (993e7a9b-b819-45eb-a2ad-d2b4e9ce694f): created successfully Jun 02 03:29:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-944312b1-b8c0-4c43-9839-3ca313dd79fb tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71b4940a-bd82-4a74-9421-8f95485dfd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:29:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-944312b1-b8c0-4c43-9839-3ca313dd79fb tempest-TestInstancesWithCinderVolumes-1072920434 None] Flow 'volume_create_manager' (8d05dd0a-017d-42ff-8a46-33b4c9a922ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:29:26 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-944312b1-b8c0-4c43-9839-3ca313dd79fb tempest-TestInstancesWithCinderVolumes-1072920434 None] Created volume successfully. Jun 02 03:29:27 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-428cb73c-930e-4217-a84c-3fde07c36f59 tempest-VolumesActionsTest-1558050684 None] Acquiring lock "cinder-c8db5193-e350-46f0-98cd-1ea4eed9f539" by "attach_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:29:27 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-428cb73c-930e-4217-a84c-3fde07c36f59 tempest-VolumesActionsTest-1558050684 None] Lock "cinder-c8db5193-e350-46f0-98cd-1ea4eed9f539" acquired by "attach_volume" :: waited 0.049s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:29:27 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-428cb73c-930e-4217-a84c-3fde07c36f59 tempest-VolumesActionsTest-1558050684 None] Attaching volume c8db5193-e350-46f0-98cd-1ea4eed9f539 to instance 7741862d-c5fb-471f-add2-b6591daad5f8 at mountpoint /dev/vdb on host None. Jun 02 03:29:27 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-428cb73c-930e-4217-a84c-3fde07c36f59 tempest-VolumesActionsTest-1558050684 None] Attach volume completed successfully. Jun 02 03:29:27 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-428cb73c-930e-4217-a84c-3fde07c36f59 tempest-VolumesActionsTest-1558050684 None] Lock "cinder-c8db5193-e350-46f0-98cd-1ea4eed9f539" released by "attach_volume" :: held 0.316s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:29:28 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f8818c38-01d4-41f1-bc6f-d1724cce8cae tempest-VolumesActionsTest-1558050684 None] Acquiring lock "cinder-c8db5193-e350-46f0-98cd-1ea4eed9f539-detach_volume" by "detach_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:29:28 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f8818c38-01d4-41f1-bc6f-d1724cce8cae tempest-VolumesActionsTest-1558050684 None] Lock "cinder-c8db5193-e350-46f0-98cd-1ea4eed9f539-detach_volume" acquired by "detach_volume" :: waited 0.054s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:29:28 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-f8818c38-01d4-41f1-bc6f-d1724cce8cae tempest-VolumesActionsTest-1558050684 None] Detaching volume c8db5193-e350-46f0-98cd-1ea4eed9f539 from instance 7741862d-c5fb-471f-add2-b6591daad5f8. Jun 02 03:29:28 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a45759f9-eede-4c3b-b8ce-2affb184de10 tempest-TestInstancesWithCinderVolumes-1072920434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7b18b337-6aef-4aec-ab58-89d75dad1309 1073741824" returned: 0 in 2.198s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a45759f9-eede-4c3b-b8ce-2affb184de10 tempest-TestInstancesWithCinderVolumes-1072920434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7b18b337-6aef-4aec-ab58-89d75dad1309 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:28 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-f8818c38-01d4-41f1-bc6f-d1724cce8cae tempest-VolumesActionsTest-1558050684 None] Detach volume completed successfully. Jun 02 03:29:28 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f8818c38-01d4-41f1-bc6f-d1724cce8cae tempest-VolumesActionsTest-1558050684 None] Lock "cinder-c8db5193-e350-46f0-98cd-1ea4eed9f539-detach_volume" released by "detach_volume" :: held 0.158s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:29:28 devstack sudo[99911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7b18b337-6aef-4aec-ab58-89d75dad1309 Jun 02 03:29:28 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:29 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a45759f9-eede-4c3b-b8ce-2affb184de10 tempest-TestInstancesWithCinderVolumes-1072920434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7b18b337-6aef-4aec-ab58-89d75dad1309" returned: 0 in 1.572s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:29 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a45759f9-eede-4c3b-b8ce-2affb184de10 tempest-TestInstancesWithCinderVolumes-1072920434 None] <== create_volume: return (3866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:29:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a45759f9-eede-4c3b-b8ce-2affb184de10 tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.875s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:29:29 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a45759f9-eede-4c3b-b8ce-2affb184de10 tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d657bfa6-b4cc-4015-a90f-4e6f4724bcd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b18b337-6aef-4aec-ab58-89d75dad1309', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:29:29 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a45759f9-eede-4c3b-b8ce-2affb184de10 tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d644d37-aaa1-45c8-a8aa-b4877cd77c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:29:29 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-a45759f9-eede-4c3b-b8ce-2affb184de10 tempest-TestInstancesWithCinderVolumes-1072920434 None] Volume volume-7b18b337-6aef-4aec-ab58-89d75dad1309 (7b18b337-6aef-4aec-ab58-89d75dad1309): created successfully Jun 02 03:29:29 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a45759f9-eede-4c3b-b8ce-2affb184de10 tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d644d37-aaa1-45c8-a8aa-b4877cd77c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:29:29 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a45759f9-eede-4c3b-b8ce-2affb184de10 tempest-TestInstancesWithCinderVolumes-1072920434 None] Flow 'volume_create_manager' (1da15133-69e5-40b6-95e7-1339c3810a58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:29:29 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-a45759f9-eede-4c3b-b8ce-2affb184de10 tempest-TestInstancesWithCinderVolumes-1072920434 None] Created volume successfully. Jun 02 03:29:32 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5d41e545-de88-46ba-a462-f443959d0b3f_p3eo2flpdevstack@QuobyteHD, size 20.69 MB, duration 7.89 sec {{(pid=86431) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 02 03:29:32 devstack cinder-volume[86431]: INFO cinder.image.image_utils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Image download 20.69 MB at 2.62 MB/s Jun 02 03:29:32 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[644f4a27-335d-48e3-aaea-53640de735fd]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:29:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d41e545-de88-46ba-a462-f443959d0b3f_p3eo2flpdevstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:33 devstack sudo[99961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d41e545-de88-46ba-a462-f443959d0b3f_p3eo2flpdevstack@QuobyteHD Jun 02 03:29:33 devstack sudo[99961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:33 devstack sudo[99961]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d41e545-de88-46ba-a462-f443959d0b3f_p3eo2flpdevstack@QuobyteHD" returned: 0 in 0.738s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:33 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Temporary image 5d41e545-de88-46ba-a462-f443959d0b3f is fetched for user 344ef3a08dcb451a853005baf21e0794. {{(pid=86431) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 02 03:29:33 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdb27de-96ad-4e0a-b636-a7714b4b0225]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:29:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d41e545-de88-46ba-a462-f443959d0b3f_p3eo2flpdevstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:33 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d41e545-de88-46ba-a462-f443959d0b3f_p3eo2flpdevstack@QuobyteHD Jun 02 03:29:33 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:34 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d41e545-de88-46ba-a462-f443959d0b3f_p3eo2flpdevstack@QuobyteHD" returned: 0 in 1.048s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:29:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:29:34 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-943643956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f25d535b-1ae2-47b0-a4c7-c18036e55a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea982870bdbc4e72a84ec3e44a98c6f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:29:24Z,use_quota=True,user_id='344ef3a08dcb451a853005baf21e0794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04be9f59-378a-446c-b467-556d80c4c4f1),volume_type_id=04be9f59-378a-446c-b467-556d80c4c4f1)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:29:34 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Creating volume f25d535b-1ae2-47b0-a4c7-c18036e55a72 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:29:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:29:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:29:34 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:29:34 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:29:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:29:34 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:29:34 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:29:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:34 devstack sudo[100056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72 1073741824 Jun 02 03:29:34 devstack sudo[100056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:35 devstack sudo[100056]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72 1073741824" returned: 0 in 0.954s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:35 devstack sudo[100061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72 Jun 02 03:29:35 devstack sudo[100061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:36 devstack sudo[100061]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72" returned: 0 in 0.635s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:36 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:29:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:29:36 devstack cinder-volume[86431]: DEBUG cinder.volume.volume_utils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Attempting download of 5d41e545-de88-46ba-a462-f443959d0b3f ((None, [{'url': 'file:///opt/stack/data/glance/images/5d41e545-de88-46ba-a462-f443959d0b3f', 'metadata': {}}])) to volume f25d535b-1ae2-47b0-a4c7-c18036e55a72. {{(pid=86431) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 02 03:29:36 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[786ab717-a96f-4164-84e5-3e2beb8c08f9]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:29:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d41e545-de88-46ba-a462-f443959d0b3f_gz70i4ym {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:36 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d41e545-de88-46ba-a462-f443959d0b3f_gz70i4ym Jun 02 03:29:36 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:37 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5d41e545-de88-46ba-a462-f443959d0b3f_gz70i4ym" returned: 0 in 0.709s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d41e545-de88-46ba-a462-f443959d0b3f_gz70i4ym {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:37 devstack sudo[100070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d41e545-de88-46ba-a462-f443959d0b3f_gz70i4ym Jun 02 03:29:37 devstack sudo[100070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:37 devstack sudo[100070]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d41e545-de88-46ba-a462-f443959d0b3f_gz70i4ym" returned: 1 in 0.673s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5d41e545-de88-46ba-a462-f443959d0b3f_gz70i4ym' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:29:37 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcb1ed8-8cb3-4905-970b-8bbc2c95b014]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:29:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d41e545-de88-46ba-a462-f443959d0b3f_p3eo2flpdevstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:38 devstack sudo[100074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d41e545-de88-46ba-a462-f443959d0b3f_p3eo2flpdevstack@QuobyteHD Jun 02 03:29:38 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:38 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5d41e545-de88-46ba-a462-f443959d0b3f_p3eo2flpdevstack@QuobyteHD" returned: 0 in 0.698s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:38 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] 5d41e545-de88-46ba-a462-f443959d0b3f was qcow2, converting to raw {{(pid=86431) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 02 03:29:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5d41e545-de88-46ba-a462-f443959d0b3f_p3eo2flpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:38 devstack sudo[100079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5d41e545-de88-46ba-a462-f443959d0b3f_p3eo2flpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72 Jun 02 03:29:38 devstack sudo[100079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:39 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:29:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Flow 'volume_create_manager' (df1dbad3-df5d-44dd-930d-7ef5d1091bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:29:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab50f53-c118-43f8-8dcb-cdebcf06e286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:29:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab50f53-c118-43f8-8dcb-cdebcf06e286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7a7d33c-963c-4e28-8afe-f2201e788a6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d1ded16e8145ef818ad7c90e732988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:29:39Z,use_quota=True,user_id='eaf408e2e22c4538a12e0216f1cb9b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:29:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff0db88b-dcc7-45f2-ab3c-d0df2e4c99c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:29:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff0db88b-dcc7-45f2-ab3c-d0df2e4c99c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:29:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e84f7ff8-b370-4a28-bf78-ab82d747b662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:29:39 devstack cinder-volume[86431]: DEBUG cinder.image.glance [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Creating Keystone auth plugin from conf {{(pid=86431) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 02 03:29:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e84f7ff8-b370-4a28-bf78-ab82d747b662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c7a7d33c-963c-4e28-8afe-f2201e788a6c', 'volume_name': 'volume-c7a7d33c-963c-4e28-8afe-f2201e788a6c', 'volume_size': 1, 'image_id': 'fe9f4baf-7206-45e5-9a8b-f30046ad8141', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe9f4baf-7206-45e5-9a8b-f30046ad8141', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0b3da8a12bf17b4f2378ed1247fe7b3c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '01d1ded16e8145ef818ad7c90e732988', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f8cc771e5adcb87f8ad8c1b8fd13ed892c97124089a1bd89db2875872f8487c45d629eefc530c33a49bda06e73309afafd9b18107e98ad846be779f7cf893d00', 'id': 'fe9f4baf-7206-45e5-9a8b-f30046ad8141', 'created_at': datetime.datetime(2026, 6, 2, 1, 29, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 1, 29, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe9f4baf-7206-45e5-9a8b-f30046ad8141/file', 'properties': {}}, 'image_service': }' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:29:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb07b171-5c58-4aac-96ea-22b91b189c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:29:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb07b171-5c58-4aac-96ea-22b91b189c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:29:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8ab511-ae78-4eae-a054-d008295f810c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:29:39 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Volume c7a7d33c-963c-4e28-8afe-f2201e788a6c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c7a7d33c-963c-4e28-8afe-f2201e788a6c', 'volume_size': 1, 'image_id': 'fe9f4baf-7206-45e5-9a8b-f30046ad8141', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe9f4baf-7206-45e5-9a8b-f30046ad8141', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0b3da8a12bf17b4f2378ed1247fe7b3c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '01d1ded16e8145ef818ad7c90e732988', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f8cc771e5adcb87f8ad8c1b8fd13ed892c97124089a1bd89db2875872f8487c45d629eefc530c33a49bda06e73309afafd9b18107e98ad846be779f7cf893d00', 'id': 'fe9f4baf-7206-45e5-9a8b-f30046ad8141', 'created_at': datetime.datetime(2026, 6, 2, 1, 29, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 1, 29, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe9f4baf-7206-45e5-9a8b-f30046ad8141/file', 'properties': {}}, 'image_service': } Jun 02 03:29:39 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Trying to clone c7a7d33c-963c-4e28-8afe-f2201e788a6c from image fe9f4baf-7206-45e5-9a8b-f30046ad8141 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fe9f4baf-7206-45e5-9a8b-f30046ad8141', 'metadata': {}}]). {{(pid=86431) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 02 03:29:39 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fe9f4baf-7206-45e5-9a8b-f30046ad8141_5he1z5y1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86431) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 02 03:29:39 devstack cinder-volume[86431]: INFO cinder.image.image_utils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Image download 0.00 MB at 0.00 MB/s Jun 02 03:29:39 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[c083964f-eac3-4e8d-8930-0d4bc5424894]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:29:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe9f4baf-7206-45e5-9a8b-f30046ad8141_5he1z5y1devstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:39 devstack sudo[100088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe9f4baf-7206-45e5-9a8b-f30046ad8141_5he1z5y1devstack@QuobyteHD Jun 02 03:29:39 devstack sudo[100088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:40 devstack sudo[100088]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe9f4baf-7206-45e5-9a8b-f30046ad8141_5he1z5y1devstack@QuobyteHD" returned: 0 in 0.762s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe9f4baf-7206-45e5-9a8b-f30046ad8141_5he1z5y1devstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:40 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe9f4baf-7206-45e5-9a8b-f30046ad8141_5he1z5y1devstack@QuobyteHD Jun 02 03:29:40 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:40 devstack sudo[100079]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5d41e545-de88-46ba-a462-f443959d0b3f_p3eo2flpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72" returned: 0 in 1.941s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:40 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5d41e545-de88-46ba-a462-f443959d0b3f_p3eo2flpdevstack@QuobyteHD, size 112.00 MB, duration 1.94 sec, destination /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72 {{(pid=86431) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 02 03:29:40 devstack cinder-volume[86431]: INFO cinder.image.image_utils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Converted 112.00 MB image at 57.65 MB/s Jun 02 03:29:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:40 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72 1G Jun 02 03:29:40 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:41 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe9f4baf-7206-45e5-9a8b-f30046ad8141_5he1z5y1devstack@QuobyteHD" returned: 1 in 0.726s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe9f4baf-7206-45e5-9a8b-f30046ad8141_5he1z5y1devstack@QuobyteHD' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:29:41 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Temporary image fe9f4baf-7206-45e5-9a8b-f30046ad8141 is fetched for user eaf408e2e22c4538a12e0216f1cb9b7a. {{(pid=86431) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 02 03:29:41 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[c580d6f9-fd42-4954-920c-a823c066aacb]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:29:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe9f4baf-7206-45e5-9a8b-f30046ad8141_5he1z5y1devstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:41 devstack sudo[100100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe9f4baf-7206-45e5-9a8b-f30046ad8141_5he1z5y1devstack@QuobyteHD Jun 02 03:29:41 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:41 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72 1G" returned: 0 in 0.672s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:41 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[69162208-2e63-4743-9f16-657438742140]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:29:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:41 devstack sudo[100104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72 Jun 02 03:29:41 devstack sudo[100104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:42 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe9f4baf-7206-45e5-9a8b-f30046ad8141_5he1z5y1devstack@QuobyteHD" returned: 0 in 0.972s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe9f4baf-7206-45e5-9a8b-f30046ad8141_5he1z5y1devstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:42 devstack sudo[100110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe9f4baf-7206-45e5-9a8b-f30046ad8141_5he1z5y1devstack@QuobyteHD Jun 02 03:29:42 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:42 devstack sudo[100104]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72" returned: 0 in 0.931s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:42 devstack sudo[100112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72 Jun 02 03:29:42 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:43 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe9f4baf-7206-45e5-9a8b-f30046ad8141_5he1z5y1devstack@QuobyteHD" returned: 1 in 1.074s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe9f4baf-7206-45e5-9a8b-f30046ad8141_5he1z5y1devstack@QuobyteHD' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:29:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:29:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:29:43 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7a7d33c-963c-4e28-8afe-f2201e788a6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d1ded16e8145ef818ad7c90e732988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:29:39Z,use_quota=True,user_id='eaf408e2e22c4538a12e0216f1cb9b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:29:43 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Creating volume c7a7d33c-963c-4e28-8afe-f2201e788a6c {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:29:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:29:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:29:43 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:29:43 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:29:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:29:43 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:29:43 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:29:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c7a7d33c-963c-4e28-8afe-f2201e788a6c 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:43 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c7a7d33c-963c-4e28-8afe-f2201e788a6c 1073741824 Jun 02 03:29:43 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:43 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72" returned: 1 in 1.182s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:29:43 devstack cinder-volume[86431]: DEBUG cinder.volume.volume_utils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Downloaded image 5d41e545-de88-46ba-a462-f443959d0b3f ((None, [{'url': 'file:///opt/stack/data/glance/images/5d41e545-de88-46ba-a462-f443959d0b3f', 'metadata': {}}])) to volume f25d535b-1ae2-47b0-a4c7-c18036e55a72 successfully. {{(pid=86431) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 02 03:29:43 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Temporary image 5d41e545-de88-46ba-a462-f443959d0b3f for user 344ef3a08dcb451a853005baf21e0794 is deleted. {{(pid=86431) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 02 03:29:43 devstack cinder-volume[86431]: DEBUG cinder.volume.volume_utils [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Marking volume f25d535b-1ae2-47b0-a4c7-c18036e55a72 as bootable. {{(pid=86431) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 02 03:29:43 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Copying metadata from image 5d41e545-de88-46ba-a462-f443959d0b3f to f25d535b-1ae2-47b0-a4c7-c18036e55a72. {{(pid=86431) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 02 03:29:43 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Creating volume glance metadata for volume f25d535b-1ae2-47b0-a4c7-c18036e55a72 backed by image 5d41e545-de88-46ba-a462-f443959d0b3f with: {'image_id': '5d41e545-de88-46ba-a462-f443959d0b3f', 'image_name': 'tempest-scenario-img--2090848060', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86431) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 02 03:29:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e01c6fd-c8f4-4cb1-97f1-4f7724afb6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72', 'volume_size': 1, 'image_id': '5d41e545-de88-46ba-a462-f443959d0b3f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5d41e545-de88-46ba-a462-f443959d0b3f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2090848060', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea982870bdbc4e72a84ec3e44a98c6f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5d41e545-de88-46ba-a462-f443959d0b3f', 'created_at': datetime.datetime(2026, 6, 2, 1, 29, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 1, 29, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5d41e545-de88-46ba-a462-f443959d0b3f/file', 'properties': {}}, 'image_service': }' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:29:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94d7650d-6b03-4e9b-b2de-ad8dee4db85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:29:43 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Volume volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72 (f25d535b-1ae2-47b0-a4c7-c18036e55a72): created successfully Jun 02 03:29:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94d7650d-6b03-4e9b-b2de-ad8dee4db85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:29:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Flow 'volume_create_manager' (77cafed9-68ea-4956-987e-84dd949a3865) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:29:43 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-8007ca64-5503-4708-9696-bd3929d7698f tempest-TestInstancesWithCinderVolumes-1072920434 None] Created volume successfully. Jun 02 03:29:44 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c7a7d33c-963c-4e28-8afe-f2201e788a6c 1073741824" returned: 0 in 1.137s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c7a7d33c-963c-4e28-8afe-f2201e788a6c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:44 devstack sudo[100145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c7a7d33c-963c-4e28-8afe-f2201e788a6c Jun 02 03:29:44 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:44 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c7a7d33c-963c-4e28-8afe-f2201e788a6c" returned: 0 in 0.615s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:44 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] <== create_volume: return (1816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:29:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.820s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:29:45 devstack cinder-volume[86431]: DEBUG cinder.volume.volume_utils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Attempting download of fe9f4baf-7206-45e5-9a8b-f30046ad8141 ((None, [{'url': 'file:///opt/stack/data/glance/images/fe9f4baf-7206-45e5-9a8b-f30046ad8141', 'metadata': {}}])) to volume c7a7d33c-963c-4e28-8afe-f2201e788a6c. {{(pid=86431) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 02 03:29:45 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccba0ff8-1dc7-43a5-9cf1-a4aa5cbce595]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:29:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe9f4baf-7206-45e5-9a8b-f30046ad8141_db4exaq7 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:45 devstack sudo[100148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe9f4baf-7206-45e5-9a8b-f30046ad8141_db4exaq7 Jun 02 03:29:45 devstack sudo[100148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:45 devstack sudo[100148]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe9f4baf-7206-45e5-9a8b-f30046ad8141_db4exaq7" returned: 0 in 0.855s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe9f4baf-7206-45e5-9a8b-f30046ad8141_db4exaq7 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:46 devstack sudo[100160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe9f4baf-7206-45e5-9a8b-f30046ad8141_db4exaq7 Jun 02 03:29:46 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:46 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe9f4baf-7206-45e5-9a8b-f30046ad8141_db4exaq7" returned: 1 in 0.720s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe9f4baf-7206-45e5-9a8b-f30046ad8141_db4exaq7' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:29:46 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b1e1c8-94f5-4cf1-8694-52736dd59569]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:29:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe9f4baf-7206-45e5-9a8b-f30046ad8141_5he1z5y1devstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:46 devstack sudo[100164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe9f4baf-7206-45e5-9a8b-f30046ad8141_5he1z5y1devstack@QuobyteHD Jun 02 03:29:46 devstack sudo[100164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:47 devstack sudo[100164]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe9f4baf-7206-45e5-9a8b-f30046ad8141_5he1z5y1devstack@QuobyteHD" returned: 0 in 0.681s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe9f4baf-7206-45e5-9a8b-f30046ad8141_5he1z5y1devstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:47 devstack sudo[100168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe9f4baf-7206-45e5-9a8b-f30046ad8141_5he1z5y1devstack@QuobyteHD Jun 02 03:29:47 devstack sudo[100168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:48 devstack sudo[100168]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe9f4baf-7206-45e5-9a8b-f30046ad8141_5he1z5y1devstack@QuobyteHD" returned: 1 in 0.887s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe9f4baf-7206-45e5-9a8b-f30046ad8141_5he1z5y1devstack@QuobyteHD' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:29:48 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] fe9f4baf-7206-45e5-9a8b-f30046ad8141 was raw, converting to raw {{(pid=86431) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 02 03:29:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fe9f4baf-7206-45e5-9a8b-f30046ad8141_5he1z5y1devstack@QuobyteHD /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c7a7d33c-963c-4e28-8afe-f2201e788a6c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:48 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fe9f4baf-7206-45e5-9a8b-f30046ad8141_5he1z5y1devstack@QuobyteHD /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c7a7d33c-963c-4e28-8afe-f2201e788a6c Jun 02 03:29:48 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:48 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_fe9f4baf-7206-45e5-9a8b-f30046ad8141_5he1z5y1devstack@QuobyteHD /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c7a7d33c-963c-4e28-8afe-f2201e788a6c" returned: 0 in 0.713s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:48 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fe9f4baf-7206-45e5-9a8b-f30046ad8141_5he1z5y1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c7a7d33c-963c-4e28-8afe-f2201e788a6c {{(pid=86431) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 02 03:29:48 devstack cinder-volume[86431]: INFO cinder.image.image_utils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Converted 0.00 MB image at 0.00 MB/s Jun 02 03:29:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c7a7d33c-963c-4e28-8afe-f2201e788a6c 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:49 devstack sudo[100231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c7a7d33c-963c-4e28-8afe-f2201e788a6c 1G Jun 02 03:29:49 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:49 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c7a7d33c-963c-4e28-8afe-f2201e788a6c 1G" returned: 0 in 1.028s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:50 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[743edc40-e92c-4a94-8b1c-dc8746b5491a]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:29:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c7a7d33c-963c-4e28-8afe-f2201e788a6c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:50 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c7a7d33c-963c-4e28-8afe-f2201e788a6c Jun 02 03:29:50 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:51 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c7a7d33c-963c-4e28-8afe-f2201e788a6c" returned: 0 in 1.143s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c7a7d33c-963c-4e28-8afe-f2201e788a6c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:51 devstack sudo[100324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c7a7d33c-963c-4e28-8afe-f2201e788a6c Jun 02 03:29:51 devstack sudo[100324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-12f50e79-182d-43f5-9ee4-d0d2b2c0347f req-d86bef7b-e12d-4582-98e3-1c5dde04d78b tempest-TestInstancesWithCinderVolumes-1072920434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:29:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-12f50e79-182d-43f5-9ee4-d0d2b2c0347f req-d86bef7b-e12d-4582-98e3-1c5dde04d78b tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:29:52 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[700b85ed-3457-4da8-9b7a-b7b75909a2ef]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:29:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-12f50e79-182d-43f5-9ee4-d0d2b2c0347f req-d86bef7b-e12d-4582-98e3-1c5dde04d78b tempest-TestInstancesWithCinderVolumes-1072920434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:52 devstack sudo[100335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72 Jun 02 03:29:52 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:52 devstack sudo[100324]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c7a7d33c-963c-4e28-8afe-f2201e788a6c" returned: 1 in 1.369s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c7a7d33c-963c-4e28-8afe-f2201e788a6c' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:29:52 devstack cinder-volume[86431]: DEBUG cinder.volume.volume_utils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Downloaded image fe9f4baf-7206-45e5-9a8b-f30046ad8141 ((None, [{'url': 'file:///opt/stack/data/glance/images/fe9f4baf-7206-45e5-9a8b-f30046ad8141', 'metadata': {}}])) to volume c7a7d33c-963c-4e28-8afe-f2201e788a6c successfully. {{(pid=86431) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 02 03:29:52 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Temporary image fe9f4baf-7206-45e5-9a8b-f30046ad8141 for user eaf408e2e22c4538a12e0216f1cb9b7a is deleted. {{(pid=86431) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 02 03:29:52 devstack cinder-volume[86431]: DEBUG cinder.volume.volume_utils [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Marking volume c7a7d33c-963c-4e28-8afe-f2201e788a6c as bootable. {{(pid=86431) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 02 03:29:52 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Copying metadata from image fe9f4baf-7206-45e5-9a8b-f30046ad8141 to c7a7d33c-963c-4e28-8afe-f2201e788a6c. {{(pid=86431) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 02 03:29:52 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Creating volume glance metadata for volume c7a7d33c-963c-4e28-8afe-f2201e788a6c backed by image fe9f4baf-7206-45e5-9a8b-f30046ad8141 with: {'image_id': 'fe9f4baf-7206-45e5-9a8b-f30046ad8141', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '0b3da8a12bf17b4f2378ed1247fe7b3c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86431) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 02 03:29:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8ab511-ae78-4eae-a054-d008295f810c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7a7d33c-963c-4e28-8afe-f2201e788a6c', 'volume_size': 1, 'image_id': 'fe9f4baf-7206-45e5-9a8b-f30046ad8141', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe9f4baf-7206-45e5-9a8b-f30046ad8141', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0b3da8a12bf17b4f2378ed1247fe7b3c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '01d1ded16e8145ef818ad7c90e732988', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f8cc771e5adcb87f8ad8c1b8fd13ed892c97124089a1bd89db2875872f8487c45d629eefc530c33a49bda06e73309afafd9b18107e98ad846be779f7cf893d00', 'id': 'fe9f4baf-7206-45e5-9a8b-f30046ad8141', 'created_at': datetime.datetime(2026, 6, 2, 1, 29, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 1, 29, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe9f4baf-7206-45e5-9a8b-f30046ad8141/file', 'properties': {}}, 'image_service': }' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:29:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd3ddb4d-2d03-41fd-80f5-6616ba469e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:29:52 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Volume volume-c7a7d33c-963c-4e28-8afe-f2201e788a6c (c7a7d33c-963c-4e28-8afe-f2201e788a6c): created successfully Jun 02 03:29:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd3ddb4d-2d03-41fd-80f5-6616ba469e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:29:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Flow 'volume_create_manager' (df1dbad3-df5d-44dd-930d-7ef5d1091bbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:29:52 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-bec6c962-7913-465c-9d8f-b11f71fd39ac tempest-VolumeImageDependencyTests-2136704750 None] Created volume successfully. Jun 02 03:29:53 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-541255d0-b41c-475b-997c-5d5b61e65efa tempest-VolumeImageDependencyTests-2136704750 None] Acquiring lock "cinder-c7a7d33c-963c-4e28-8afe-f2201e788a6c-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:29:53 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-541255d0-b41c-475b-997c-5d5b61e65efa tempest-VolumeImageDependencyTests-2136704750 None] Lock "cinder-c7a7d33c-963c-4e28-8afe-f2201e788a6c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:29:53 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-541255d0-b41c-475b-997c-5d5b61e65efa tempest-VolumeImageDependencyTests-2136704750 None] Acquiring lock "cinder-quobyte-c7a7d33c-963c-4e28-8afe-f2201e788a6c" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:29:53 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-541255d0-b41c-475b-997c-5d5b61e65efa tempest-VolumeImageDependencyTests-2136704750 None] Lock "cinder-quobyte-c7a7d33c-963c-4e28-8afe-f2201e788a6c" acquired by "delete_volume" :: waited 0.017s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:29:53 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-12f50e79-182d-43f5-9ee4-d0d2b2c0347f req-d86bef7b-e12d-4582-98e3-1c5dde04d78b tempest-TestInstancesWithCinderVolumes-1072920434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72" returned: 0 in 1.459s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-12f50e79-182d-43f5-9ee4-d0d2b2c0347f req-d86bef7b-e12d-4582-98e3-1c5dde04d78b tempest-TestInstancesWithCinderVolumes-1072920434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:53 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[346af4fc-fe85-41e6-98b7-3f1495a39212]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:29:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-541255d0-b41c-475b-997c-5d5b61e65efa tempest-VolumeImageDependencyTests-2136704750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c7a7d33c-963c-4e28-8afe-f2201e788a6c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:53 devstack sudo[100346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72 Jun 02 03:29:53 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:53 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c7a7d33c-963c-4e28-8afe-f2201e788a6c Jun 02 03:29:53 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:54 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-7161ccaa-9881-4b11-b03f-063bd110f620 req-3bf772d9-56e0-4a2c-a8b2-a6b08a0c91f0 tempest-TestShelveInstance-217844603 None] Terminate volume connection completed successfully. Jun 02 03:29:54 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-7161ccaa-9881-4b11-b03f-063bd110f620 req-3bf772d9-56e0-4a2c-a8b2-a6b08a0c91f0 tempest-TestShelveInstance-217844603 None] Deleting attachment 959086f4-5535-4deb-868d-1ddd40303f93. {{(pid=86431) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 02 03:29:54 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-12f50e79-182d-43f5-9ee4-d0d2b2c0347f req-d86bef7b-e12d-4582-98e3-1c5dde04d78b tempest-TestInstancesWithCinderVolumes-1072920434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72" returned: 1 in 0.983s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-12f50e79-182d-43f5-9ee4-d0d2b2c0347f req-d86bef7b-e12d-4582-98e3-1c5dde04d78b tempest-TestInstancesWithCinderVolumes-1072920434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:29:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-12f50e79-182d-43f5-9ee4-d0d2b2c0347f req-d86bef7b-e12d-4582-98e3-1c5dde04d78b tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.513s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:29:54 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-12f50e79-182d-43f5-9ee4-d0d2b2c0347f req-d86bef7b-e12d-4582-98e3-1c5dde04d78b tempest-TestInstancesWithCinderVolumes-1072920434 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1', 'name': 'volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '29ada636-f8eb-4c90-aa65-9b2f99d7ddeb', 'enforce_multipath': True} {{(pid=86431) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 02 03:29:54 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4346808e-adce-42ee-8f15-2bfc6c88b725 tempest-VolumesActionsTest-1558050684 None] Acquiring lock "cinder-c8db5193-e350-46f0-98cd-1ea4eed9f539" by "attach_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:29:54 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4346808e-adce-42ee-8f15-2bfc6c88b725 tempest-VolumesActionsTest-1558050684 None] Lock "cinder-c8db5193-e350-46f0-98cd-1ea4eed9f539" acquired by "attach_volume" :: waited 0.030s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:29:54 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-4346808e-adce-42ee-8f15-2bfc6c88b725 tempest-VolumesActionsTest-1558050684 None] Attaching volume c8db5193-e350-46f0-98cd-1ea4eed9f539 to instance e1f3c3ca-78c4-4fe3-a169-5dd4ffbdc4d0 at mountpoint /dev/vdb on host None. Jun 02 03:29:54 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-12f50e79-182d-43f5-9ee4-d0d2b2c0347f req-d86bef7b-e12d-4582-98e3-1c5dde04d78b tempest-TestInstancesWithCinderVolumes-1072920434 None] attachment_update completed successfully. Jun 02 03:29:54 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-4346808e-adce-42ee-8f15-2bfc6c88b725 tempest-VolumesActionsTest-1558050684 None] Attach volume completed successfully. Jun 02 03:29:54 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4346808e-adce-42ee-8f15-2bfc6c88b725 tempest-VolumesActionsTest-1558050684 None] Lock "cinder-c8db5193-e350-46f0-98cd-1ea4eed9f539" released by "attach_volume" :: held 0.101s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:29:54 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-541255d0-b41c-475b-997c-5d5b61e65efa tempest-VolumeImageDependencyTests-2136704750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c7a7d33c-963c-4e28-8afe-f2201e788a6c" returned: 0 in 1.244s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-541255d0-b41c-475b-997c-5d5b61e65efa tempest-VolumeImageDependencyTests-2136704750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c7a7d33c-963c-4e28-8afe-f2201e788a6c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:55 devstack sudo[100356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c7a7d33c-963c-4e28-8afe-f2201e788a6c Jun 02 03:29:55 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:55 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-91045786-ba6f-483f-a7e5-0d2a2fac5808 tempest-VolumesActionsTest-1558050684 None] Acquiring lock "cinder-c8db5193-e350-46f0-98cd-1ea4eed9f539-detach_volume" by "detach_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:29:55 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-91045786-ba6f-483f-a7e5-0d2a2fac5808 tempest-VolumesActionsTest-1558050684 None] Lock "cinder-c8db5193-e350-46f0-98cd-1ea4eed9f539-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:29:55 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-91045786-ba6f-483f-a7e5-0d2a2fac5808 tempest-VolumesActionsTest-1558050684 None] Detaching volume c8db5193-e350-46f0-98cd-1ea4eed9f539 from instance e1f3c3ca-78c4-4fe3-a169-5dd4ffbdc4d0. Jun 02 03:29:55 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-91045786-ba6f-483f-a7e5-0d2a2fac5808 tempest-VolumesActionsTest-1558050684 None] Detach volume completed successfully. Jun 02 03:29:55 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-91045786-ba6f-483f-a7e5-0d2a2fac5808 tempest-VolumesActionsTest-1558050684 None] Lock "cinder-c8db5193-e350-46f0-98cd-1ea4eed9f539-detach_volume" released by "detach_volume" :: held 0.097s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:29:56 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-541255d0-b41c-475b-997c-5d5b61e65efa tempest-VolumeImageDependencyTests-2136704750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c7a7d33c-963c-4e28-8afe-f2201e788a6c" returned: 1 in 1.122s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-541255d0-b41c-475b-997c-5d5b61e65efa tempest-VolumeImageDependencyTests-2136704750 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c7a7d33c-963c-4e28-8afe-f2201e788a6c' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:29:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-541255d0-b41c-475b-997c-5d5b61e65efa tempest-VolumeImageDependencyTests-2136704750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c7a7d33c-963c-4e28-8afe-f2201e788a6c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:56 devstack sudo[100361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c7a7d33c-963c-4e28-8afe-f2201e788a6c Jun 02 03:29:56 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:57 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-541255d0-b41c-475b-997c-5d5b61e65efa tempest-VolumeImageDependencyTests-2136704750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c7a7d33c-963c-4e28-8afe-f2201e788a6c" returned: 0 in 1.214s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:57 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-541255d0-b41c-475b-997c-5d5b61e65efa tempest-VolumeImageDependencyTests-2136704750 None] Lock "cinder-quobyte-c7a7d33c-963c-4e28-8afe-f2201e788a6c" released by "delete_volume" :: held 3.696s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:29:57 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-541255d0-b41c-475b-997c-5d5b61e65efa tempest-VolumeImageDependencyTests-2136704750 None] Created reservations ['4cbf6182-4c55-4174-bece-e950ae4abe83', '02e2549e-9ef3-472d-8aa4-10fb1ed5a1bf', '403a9434-ed8a-4a69-a501-5a7e4fa25536', '2dd472b4-8d36-4023-b372-8da4cd0ba1b9'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:29:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-541255d0-b41c-475b-997c-5d5b61e65efa tempest-VolumeImageDependencyTests-2136704750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:29:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-541255d0-b41c-475b-997c-5d5b61e65efa tempest-VolumeImageDependencyTests-2136704750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:29:57 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-541255d0-b41c-475b-997c-5d5b61e65efa tempest-VolumeImageDependencyTests-2136704750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:29:57 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-541255d0-b41c-475b-997c-5d5b61e65efa tempest-VolumeImageDependencyTests-2136704750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:29:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-541255d0-b41c-475b-997c-5d5b61e65efa tempest-VolumeImageDependencyTests-2136704750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:29:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-541255d0-b41c-475b-997c-5d5b61e65efa tempest-VolumeImageDependencyTests-2136704750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:29:57 devstack sudo[100375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:29:57 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:29:58 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root Jun 02 03:29:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-541255d0-b41c-475b-997c-5d5b61e65efa tempest-VolumeImageDependencyTests-2136704750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 1.002s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:29:58 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-541255d0-b41c-475b-997c-5d5b61e65efa tempest-VolumeImageDependencyTests-2136704750 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:29:58 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-541255d0-b41c-475b-997c-5d5b61e65efa tempest-VolumeImageDependencyTests-2136704750 None] Deleted volume successfully. Jun 02 03:29:58 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-541255d0-b41c-475b-997c-5d5b61e65efa tempest-VolumeImageDependencyTests-2136704750 None] Lock "cinder-c7a7d33c-963c-4e28-8afe-f2201e788a6c-delete_volume" released by "delete_volume" :: held 5.058s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:30:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-8570a5c8-966d-4418-9662-093718f1404e req-10a515e0-4228-43e4-a225-d45ae454c6f1 tempest-TestShelveInstance-217844603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:30:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-8570a5c8-966d-4418-9662-093718f1404e req-10a515e0-4228-43e4-a225-d45ae454c6f1 tempest-TestShelveInstance-217844603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:30:00 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca57a848-3ae8-49c9-8f61-c7160a8235ed]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:30:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-8570a5c8-966d-4418-9662-093718f1404e req-10a515e0-4228-43e4-a225-d45ae454c6f1 tempest-TestShelveInstance-217844603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:30:00 devstack sudo[100487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb Jun 02 03:30:00 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:30:01 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root Jun 02 03:30:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-8570a5c8-966d-4418-9662-093718f1404e req-10a515e0-4228-43e4-a225-d45ae454c6f1 tempest-TestShelveInstance-217844603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb" returned: 0 in 0.698s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:30:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-8570a5c8-966d-4418-9662-093718f1404e req-10a515e0-4228-43e4-a225-d45ae454c6f1 tempest-TestShelveInstance-217844603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:30:01 devstack sudo[100491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb Jun 02 03:30:01 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:30:02 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root Jun 02 03:30:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-8570a5c8-966d-4418-9662-093718f1404e req-10a515e0-4228-43e4-a225-d45ae454c6f1 tempest-TestShelveInstance-217844603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb" returned: 1 in 1.099s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:30:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-8570a5c8-966d-4418-9662-093718f1404e req-10a515e0-4228-43e4-a225-d45ae454c6f1 tempest-TestShelveInstance-217844603 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:30:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-8570a5c8-966d-4418-9662-093718f1404e req-10a515e0-4228-43e4-a225-d45ae454c6f1 tempest-TestShelveInstance-217844603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.844s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:30:02 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-8570a5c8-966d-4418-9662-093718f1404e req-10a515e0-4228-43e4-a225-d45ae454c6f1 tempest-TestShelveInstance-217844603 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1', 'name': 'volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '686ed59a-38cf-4bd5-939e-eef5014979d2', 'enforce_multipath': True} {{(pid=86431) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 02 03:30:02 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-8570a5c8-966d-4418-9662-093718f1404e req-10a515e0-4228-43e4-a225-d45ae454c6f1 tempest-TestShelveInstance-217844603 None] attachment_update completed successfully. Jun 02 03:30:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6814551e-9a29-4f89-8583-b2c37704b891 tempest-VolumesActionsTest-1558050684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:30:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6814551e-9a29-4f89-8583-b2c37704b891 tempest-VolumesActionsTest-1558050684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:30:05 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[74123a74-daaa-48b3-ac8f-01d0b5a4dd23]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:30:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6814551e-9a29-4f89-8583-b2c37704b891 tempest-VolumesActionsTest-1558050684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:30:05 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539 Jun 02 03:30:05 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:30:06 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Jun 02 03:30:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6814551e-9a29-4f89-8583-b2c37704b891 tempest-VolumesActionsTest-1558050684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539" returned: 0 in 0.869s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:30:06 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e38343d-4835-465f-973a-563684e0cb5e]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:30:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6814551e-9a29-4f89-8583-b2c37704b891 tempest-VolumesActionsTest-1558050684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:30:06 devstack sudo[100879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539 Jun 02 03:30:06 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:30:07 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root Jun 02 03:30:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6814551e-9a29-4f89-8583-b2c37704b891 tempest-VolumesActionsTest-1558050684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539" returned: 0 in 0.864s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:30:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6814551e-9a29-4f89-8583-b2c37704b891 tempest-VolumesActionsTest-1558050684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539 /opt/stack/data/cinder/conversion/c8db5193-e350-46f0-98cd-1ea4eed9f539.temp_image.0cfd98f7-05ab-48e4-9940-e73da98e25e8vw5g7xdw.img {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:30:07 devstack sudo[100885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539 /opt/stack/data/cinder/conversion/c8db5193-e350-46f0-98cd-1ea4eed9f539.temp_image.0cfd98f7-05ab-48e4-9940-e73da98e25e8vw5g7xdw.img Jun 02 03:30:07 devstack sudo[100885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:30:09 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:30:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:30:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:30:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:30:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:30:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:30:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:30:09 devstack sudo[100900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:30:09 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:30:11 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root Jun 02 03:30:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 2.249s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:30:11 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:30:11 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager._thread_info {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:30:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread count: 28 {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 02 03:30:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread info: [<_MainThread(MainThread, started 138618128814208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 02 03:30:12 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=61,cinder:UPDATE=48,cinder:INSERT=17,cinder:DELETE=2 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:30:15 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=58,cinder:UPDATE=48,cinder:INSERT=21,cinder:DELETE=5 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:30:15 devstack sudo[100885]: pam_unix(sudo:session): session closed for user root Jun 02 03:30:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6814551e-9a29-4f89-8583-b2c37704b891 tempest-VolumesActionsTest-1558050684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539 /opt/stack/data/cinder/conversion/c8db5193-e350-46f0-98cd-1ea4eed9f539.temp_image.0cfd98f7-05ab-48e4-9940-e73da98e25e8vw5g7xdw.img" returned: 0 in 8.649s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:30:15 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd6ed60-9139-4fb9-92f1-033378f79b3a]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:30:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6814551e-9a29-4f89-8583-b2c37704b891 tempest-VolumesActionsTest-1558050684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:30:15 devstack sudo[100906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539 Jun 02 03:30:15 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:30:16 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root Jun 02 03:30:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6814551e-9a29-4f89-8583-b2c37704b891 tempest-VolumesActionsTest-1558050684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539" returned: 0 in 1.263s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:30:16 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-6814551e-9a29-4f89-8583-b2c37704b891 tempest-VolumesActionsTest-1558050684 None] Image conversion details: src /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539, size 1024.00 MB, duration 8.65 sec, destination /opt/stack/data/cinder/conversion/c8db5193-e350-46f0-98cd-1ea4eed9f539.temp_image.0cfd98f7-05ab-48e4-9940-e73da98e25e8vw5g7xdw.img {{(pid=86431) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 02 03:30:16 devstack cinder-volume[86431]: INFO cinder.image.image_utils [None req-6814551e-9a29-4f89-8583-b2c37704b891 tempest-VolumesActionsTest-1558050684 None] Converted 1024.00 MB image at 118.38 MB/s Jun 02 03:30:16 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-6814551e-9a29-4f89-8583-b2c37704b891 tempest-VolumesActionsTest-1558050684 None] 0cfd98f7-05ab-48e4-9940-e73da98e25e8 was raw, no need to convert to raw {{(pid=86431) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 02 03:30:26 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=2 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:30:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-986cfb5b-a6a3-4789-85f8-1ea11e6b2cc0 req-46f1acfa-0100-4777-a908-da1764e6d46b tempest-TestInstancesWithCinderVolumes-1072920434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:30:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6814551e-9a29-4f89-8583-b2c37704b891 tempest-VolumesActionsTest-1558050684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.010s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:30:38 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6814551e-9a29-4f89-8583-b2c37704b891 tempest-VolumesActionsTest-1558050684 None] Uploaded volume to glance image-id: 0cfd98f7-05ab-48e4-9940-e73da98e25e8. {{(pid=86431) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1782}} Jun 02 03:30:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-986cfb5b-a6a3-4789-85f8-1ea11e6b2cc0 req-46f1acfa-0100-4777-a908-da1764e6d46b tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.364s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:30:38 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d17560-a2b0-439c-9a05-00140bc06553]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:30:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-986cfb5b-a6a3-4789-85f8-1ea11e6b2cc0 req-46f1acfa-0100-4777-a908-da1764e6d46b tempest-TestInstancesWithCinderVolumes-1072920434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-993e7a9b-b819-45eb-a2ad-d2b4e9ce694f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:30:38 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-6814551e-9a29-4f89-8583-b2c37704b891 tempest-VolumesActionsTest-1558050684 None] Copy volume to image completed successfully. Jun 02 03:30:38 devstack sudo[101128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-993e7a9b-b819-45eb-a2ad-d2b4e9ce694f Jun 02 03:30:38 devstack sudo[101128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:30:38 devstack sudo[101128]: pam_unix(sudo:session): session closed for user root Jun 02 03:30:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-986cfb5b-a6a3-4789-85f8-1ea11e6b2cc0 req-46f1acfa-0100-4777-a908-da1764e6d46b tempest-TestInstancesWithCinderVolumes-1072920434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-993e7a9b-b819-45eb-a2ad-d2b4e9ce694f" returned: 0 in 0.704s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:30:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-986cfb5b-a6a3-4789-85f8-1ea11e6b2cc0 req-46f1acfa-0100-4777-a908-da1764e6d46b tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.724s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:30:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-986cfb5b-a6a3-4789-85f8-1ea11e6b2cc0 req-46f1acfa-0100-4777-a908-da1764e6d46b tempest-TestInstancesWithCinderVolumes-1072920434 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1', 'name': 'volume-993e7a9b-b819-45eb-a2ad-d2b4e9ce694f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd5fb90ba-1fac-497b-9c38-d4c8b34aa43c', 'enforce_multipath': True} {{(pid=86431) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 02 03:30:39 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-986cfb5b-a6a3-4789-85f8-1ea11e6b2cc0 req-46f1acfa-0100-4777-a908-da1764e6d46b tempest-TestInstancesWithCinderVolumes-1072920434 None] attachment_update completed successfully. Jun 02 03:30:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b1df1f6b-39c1-4d00-9b51-f9de7e46de5d tempest-VolumesActionsTest-1558050684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:30:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b1df1f6b-39c1-4d00-9b51-f9de7e46de5d tempest-VolumesActionsTest-1558050684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:30:40 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e522074-55dd-4f42-b596-c3b7adba0b28]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:30:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b1df1f6b-39c1-4d00-9b51-f9de7e46de5d tempest-VolumesActionsTest-1558050684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:30:40 devstack sudo[101135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539 Jun 02 03:30:40 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:30:40 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root Jun 02 03:30:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b1df1f6b-39c1-4d00-9b51-f9de7e46de5d tempest-VolumesActionsTest-1558050684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539" returned: 0 in 0.723s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:30:40 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f7e30b-e6bb-40fb-9654-66dc00b748da]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:30:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b1df1f6b-39c1-4d00-9b51-f9de7e46de5d tempest-VolumesActionsTest-1558050684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:30:41 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539 Jun 02 03:30:41 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:30:41 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Jun 02 03:30:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b1df1f6b-39c1-4d00-9b51-f9de7e46de5d tempest-VolumesActionsTest-1558050684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539" returned: 0 in 0.785s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:30:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b1df1f6b-39c1-4d00-9b51-f9de7e46de5d tempest-VolumesActionsTest-1558050684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539 /opt/stack/data/cinder/conversion/c8db5193-e350-46f0-98cd-1ea4eed9f539.temp_image.9c6cbc3e-2371-4214-9cb7-6771b118fb512pwy_s8a.img {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:30:41 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539 /opt/stack/data/cinder/conversion/c8db5193-e350-46f0-98cd-1ea4eed9f539.temp_image.9c6cbc3e-2371-4214-9cb7-6771b118fb512pwy_s8a.img Jun 02 03:30:41 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:30:46 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Jun 02 03:30:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b1df1f6b-39c1-4d00-9b51-f9de7e46de5d tempest-VolumesActionsTest-1558050684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539 /opt/stack/data/cinder/conversion/c8db5193-e350-46f0-98cd-1ea4eed9f539.temp_image.9c6cbc3e-2371-4214-9cb7-6771b118fb512pwy_s8a.img" returned: 0 in 4.698s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:30:46 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74d7655-7925-4dbd-a7cc-f59faca8e3c2]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:30:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b1df1f6b-39c1-4d00-9b51-f9de7e46de5d tempest-VolumesActionsTest-1558050684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:30:46 devstack sudo[101166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539 Jun 02 03:30:46 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:30:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-9e980c6a-76ea-4b0d-b0b0-09f60f5d4288 req-02a22d2a-68dd-437d-b589-ace50041f042 tempest-TestInstancesWithCinderVolumes-1072920434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:30:47 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root Jun 02 03:30:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b1df1f6b-39c1-4d00-9b51-f9de7e46de5d tempest-VolumesActionsTest-1558050684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539" returned: 0 in 0.869s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:30:47 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-b1df1f6b-39c1-4d00-9b51-f9de7e46de5d tempest-VolumesActionsTest-1558050684 None] Image conversion details: src /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539, size 1024.00 MB, duration 4.70 sec, destination /opt/stack/data/cinder/conversion/c8db5193-e350-46f0-98cd-1ea4eed9f539.temp_image.9c6cbc3e-2371-4214-9cb7-6771b118fb512pwy_s8a.img {{(pid=86431) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 02 03:30:47 devstack cinder-volume[86431]: INFO cinder.image.image_utils [None req-b1df1f6b-39c1-4d00-9b51-f9de7e46de5d tempest-VolumesActionsTest-1558050684 None] Converted 1024.00 MB image at 217.91 MB/s Jun 02 03:30:47 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-b1df1f6b-39c1-4d00-9b51-f9de7e46de5d tempest-VolumesActionsTest-1558050684 None] 9c6cbc3e-2371-4214-9cb7-6771b118fb51 was raw, converting to qcow2 {{(pid=86431) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 02 03:30:47 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[281bf3e1-85d3-43d3-8b0d-8c07cfef34a0]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:30:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b1df1f6b-39c1-4d00-9b51-f9de7e46de5d tempest-VolumesActionsTest-1558050684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c8db5193-e350-46f0-98cd-1ea4eed9f539.temp_image.9c6cbc3e-2371-4214-9cb7-6771b118fb512pwy_s8a.img {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:30:47 devstack sudo[101179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c8db5193-e350-46f0-98cd-1ea4eed9f539.temp_image.9c6cbc3e-2371-4214-9cb7-6771b118fb512pwy_s8a.img Jun 02 03:30:47 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:30:48 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root Jun 02 03:30:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b1df1f6b-39c1-4d00-9b51-f9de7e46de5d tempest-VolumesActionsTest-1558050684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c8db5193-e350-46f0-98cd-1ea4eed9f539.temp_image.9c6cbc3e-2371-4214-9cb7-6771b118fb512pwy_s8a.img" returned: 0 in 0.674s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:30:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b1df1f6b-39c1-4d00-9b51-f9de7e46de5d tempest-VolumesActionsTest-1558050684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c8db5193-e350-46f0-98cd-1ea4eed9f539.temp_image.9c6cbc3e-2371-4214-9cb7-6771b118fb512pwy_s8a.img {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:30:48 devstack sudo[101183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c8db5193-e350-46f0-98cd-1ea4eed9f539.temp_image.9c6cbc3e-2371-4214-9cb7-6771b118fb512pwy_s8a.img Jun 02 03:30:48 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:30:48 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root Jun 02 03:30:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b1df1f6b-39c1-4d00-9b51-f9de7e46de5d tempest-VolumesActionsTest-1558050684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c8db5193-e350-46f0-98cd-1ea4eed9f539.temp_image.9c6cbc3e-2371-4214-9cb7-6771b118fb512pwy_s8a.img" returned: 1 in 0.687s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:30:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b1df1f6b-39c1-4d00-9b51-f9de7e46de5d tempest-VolumesActionsTest-1558050684 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c8db5193-e350-46f0-98cd-1ea4eed9f539.temp_image.9c6cbc3e-2371-4214-9cb7-6771b118fb512pwy_s8a.img' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:30:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b1df1f6b-39c1-4d00-9b51-f9de7e46de5d tempest-VolumesActionsTest-1558050684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c8db5193-e350-46f0-98cd-1ea4eed9f539.temp_image.9c6cbc3e-2371-4214-9cb7-6771b118fb512pwy_s8a.img /opt/stack/data/cinder/conversion/vol_upload_1ugxdntt {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:30:48 devstack sudo[101188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c8db5193-e350-46f0-98cd-1ea4eed9f539.temp_image.9c6cbc3e-2371-4214-9cb7-6771b118fb512pwy_s8a.img /opt/stack/data/cinder/conversion/vol_upload_1ugxdntt Jun 02 03:30:48 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:30:49 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root Jun 02 03:30:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b1df1f6b-39c1-4d00-9b51-f9de7e46de5d tempest-VolumesActionsTest-1558050684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c8db5193-e350-46f0-98cd-1ea4eed9f539.temp_image.9c6cbc3e-2371-4214-9cb7-6771b118fb512pwy_s8a.img /opt/stack/data/cinder/conversion/vol_upload_1ugxdntt" returned: 0 in 0.585s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:30:49 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-b1df1f6b-39c1-4d00-9b51-f9de7e46de5d tempest-VolumesActionsTest-1558050684 None] Image conversion details: src /opt/stack/data/cinder/conversion/c8db5193-e350-46f0-98cd-1ea4eed9f539.temp_image.9c6cbc3e-2371-4214-9cb7-6771b118fb512pwy_s8a.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_1ugxdntt {{(pid=86431) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 02 03:30:49 devstack cinder-volume[86431]: INFO cinder.image.image_utils [None req-b1df1f6b-39c1-4d00-9b51-f9de7e46de5d tempest-VolumesActionsTest-1558050684 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 02 03:30:49 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6f7570-b896-4a11-b276-5892f6fcd006]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:30:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b1df1f6b-39c1-4d00-9b51-f9de7e46de5d tempest-VolumesActionsTest-1558050684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_1ugxdntt {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:30:49 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_1ugxdntt Jun 02 03:30:49 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:30:49 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Jun 02 03:30:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b1df1f6b-39c1-4d00-9b51-f9de7e46de5d tempest-VolumesActionsTest-1558050684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_1ugxdntt" returned: 0 in 0.681s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:30:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b1df1f6b-39c1-4d00-9b51-f9de7e46de5d tempest-VolumesActionsTest-1558050684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.025s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:30:51 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b1df1f6b-39c1-4d00-9b51-f9de7e46de5d tempest-VolumesActionsTest-1558050684 None] Uploaded volume to glance image-id: 9c6cbc3e-2371-4214-9cb7-6771b118fb51. {{(pid=86431) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1782}} Jun 02 03:30:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-9e980c6a-76ea-4b0d-b0b0-09f60f5d4288 req-02a22d2a-68dd-437d-b589-ace50041f042 tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.063s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:30:51 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60e6748-34fd-4939-944c-31820893de04]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:30:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-9e980c6a-76ea-4b0d-b0b0-09f60f5d4288 req-02a22d2a-68dd-437d-b589-ace50041f042 tempest-TestInstancesWithCinderVolumes-1072920434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7b18b337-6aef-4aec-ab58-89d75dad1309 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:30:51 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-b1df1f6b-39c1-4d00-9b51-f9de7e46de5d tempest-VolumesActionsTest-1558050684 None] Copy volume to image completed successfully. Jun 02 03:30:51 devstack sudo[101198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7b18b337-6aef-4aec-ab58-89d75dad1309 Jun 02 03:30:51 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:30:51 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root Jun 02 03:30:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-9e980c6a-76ea-4b0d-b0b0-09f60f5d4288 req-02a22d2a-68dd-437d-b589-ace50041f042 tempest-TestInstancesWithCinderVolumes-1072920434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7b18b337-6aef-4aec-ab58-89d75dad1309" returned: 0 in 0.698s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:30:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-9e980c6a-76ea-4b0d-b0b0-09f60f5d4288 req-02a22d2a-68dd-437d-b589-ace50041f042 tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.720s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:30:51 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-9e980c6a-76ea-4b0d-b0b0-09f60f5d4288 req-02a22d2a-68dd-437d-b589-ace50041f042 tempest-TestInstancesWithCinderVolumes-1072920434 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1', 'name': 'volume-7b18b337-6aef-4aec-ab58-89d75dad1309', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8764174d-6968-407c-bcd3-92e033f8ca17', 'enforce_multipath': True} {{(pid=86431) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 02 03:30:52 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-9e980c6a-76ea-4b0d-b0b0-09f60f5d4288 req-02a22d2a-68dd-437d-b589-ace50041f042 tempest-TestInstancesWithCinderVolumes-1072920434 None] attachment_update completed successfully. Jun 02 03:30:52 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-60a14102-3c86-4e10-bdf4-f23e10d0e4f4 tempest-VolumesActionsTest-1558050684 None] Acquiring lock "cinder-c8db5193-e350-46f0-98cd-1ea4eed9f539-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:30:52 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-60a14102-3c86-4e10-bdf4-f23e10d0e4f4 tempest-VolumesActionsTest-1558050684 None] Lock "cinder-c8db5193-e350-46f0-98cd-1ea4eed9f539-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:30:52 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-60a14102-3c86-4e10-bdf4-f23e10d0e4f4 tempest-VolumesActionsTest-1558050684 None] Acquiring lock "cinder-quobyte-c8db5193-e350-46f0-98cd-1ea4eed9f539" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:30:52 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-60a14102-3c86-4e10-bdf4-f23e10d0e4f4 tempest-VolumesActionsTest-1558050684 None] Lock "cinder-quobyte-c8db5193-e350-46f0-98cd-1ea4eed9f539" acquired by "delete_volume" :: waited 0.017s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:30:52 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc8f462-e0c4-4ed8-9bdb-d7469a7b3a1c]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:30:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-60a14102-3c86-4e10-bdf4-f23e10d0e4f4 tempest-VolumesActionsTest-1558050684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:30:52 devstack sudo[101203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539 Jun 02 03:30:52 devstack sudo[101203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:30:53 devstack sudo[101203]: pam_unix(sudo:session): session closed for user root Jun 02 03:30:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-60a14102-3c86-4e10-bdf4-f23e10d0e4f4 tempest-VolumesActionsTest-1558050684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539" returned: 0 in 0.749s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:30:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-60a14102-3c86-4e10-bdf4-f23e10d0e4f4 tempest-VolumesActionsTest-1558050684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:30:53 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539 Jun 02 03:30:53 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:30:53 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Jun 02 03:30:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-60a14102-3c86-4e10-bdf4-f23e10d0e4f4 tempest-VolumesActionsTest-1558050684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c8db5193-e350-46f0-98cd-1ea4eed9f539" returned: 0 in 0.604s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:30:53 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-60a14102-3c86-4e10-bdf4-f23e10d0e4f4 tempest-VolumesActionsTest-1558050684 None] Lock "cinder-quobyte-c8db5193-e350-46f0-98cd-1ea4eed9f539" released by "delete_volume" :: held 1.389s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:30:53 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-60a14102-3c86-4e10-bdf4-f23e10d0e4f4 tempest-VolumesActionsTest-1558050684 None] Created reservations ['cebf3a66-d408-47c3-a6d9-55dfce79efcb', 'd9e77556-0f9e-44c1-aa3b-a676c900d33a', '5e4559dd-b3ad-40cf-8103-68525baf926c', '3507ec6d-4de8-4be4-84dd-41cf7fe0f23e'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:30:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-60a14102-3c86-4e10-bdf4-f23e10d0e4f4 tempest-VolumesActionsTest-1558050684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:30:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-60a14102-3c86-4e10-bdf4-f23e10d0e4f4 tempest-VolumesActionsTest-1558050684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:30:53 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-60a14102-3c86-4e10-bdf4-f23e10d0e4f4 tempest-VolumesActionsTest-1558050684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:30:53 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-60a14102-3c86-4e10-bdf4-f23e10d0e4f4 tempest-VolumesActionsTest-1558050684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:30:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-60a14102-3c86-4e10-bdf4-f23e10d0e4f4 tempest-VolumesActionsTest-1558050684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:30:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-60a14102-3c86-4e10-bdf4-f23e10d0e4f4 tempest-VolumesActionsTest-1558050684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:30:53 devstack sudo[101214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:30:53 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:30:54 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root Jun 02 03:30:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-60a14102-3c86-4e10-bdf4-f23e10d0e4f4 tempest-VolumesActionsTest-1558050684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.587s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:30:54 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-60a14102-3c86-4e10-bdf4-f23e10d0e4f4 tempest-VolumesActionsTest-1558050684 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:30:54 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-60a14102-3c86-4e10-bdf4-f23e10d0e4f4 tempest-VolumesActionsTest-1558050684 None] Deleted volume successfully. Jun 02 03:30:54 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-60a14102-3c86-4e10-bdf4-f23e10d0e4f4 tempest-VolumesActionsTest-1558050684 None] Lock "cinder-c8db5193-e350-46f0-98cd-1ea4eed9f539-delete_volume" released by "delete_volume" :: held 2.160s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:31:01 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:31:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Flow 'volume_create_manager' (89f66293-ff04-4ffd-baa2-34d863624ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:31:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14a96f33-6673-4114-a16e-8c8bbadd1aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14a96f33-6673-4114-a16e-8c8bbadd1aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2080324090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='796304c09abc46fe95d88de6b5b29b93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:31:01Z,use_quota=True,user_id='b6ea9c8ba1d1485d90f4fb14c5e47293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b8e6d8-bba7-4531-a815-dbf1ddf5ef75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b8e6d8-bba7-4531-a815-dbf1ddf5ef75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a276dd4-3df5-4d0f-a7fc-baefb6a5f1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:01 devstack cinder-volume[86431]: DEBUG cinder.image.glance [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Creating Keystone auth plugin from conf {{(pid=86431) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 02 03:31:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a276dd4-3df5-4d0f-a7fc-baefb6a5f1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd', 'volume_name': 'volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd', 'volume_size': 1, 'image_id': '54f2c102-8f54-4d66-966a-3fc746680841', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54f2c102-8f54-4d66-966a-3fc746680841', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48b06555345b4428a30a6f37e96ddabe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '54f2c102-8f54-4d66-966a-3fc746680841', 'created_at': datetime.datetime(2026, 6, 2, 1, 9, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 1, 9, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54f2c102-8f54-4d66-966a-3fc746680841/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f507864f-ccad-4959-9d21-e5fbddce75be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f507864f-ccad-4959-9d21-e5fbddce75be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce6bdda-9bf0-4b9e-ac64-905ef873672c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:01 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Volume afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd', 'volume_size': 1, 'image_id': '54f2c102-8f54-4d66-966a-3fc746680841', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54f2c102-8f54-4d66-966a-3fc746680841', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48b06555345b4428a30a6f37e96ddabe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '54f2c102-8f54-4d66-966a-3fc746680841', 'created_at': datetime.datetime(2026, 6, 2, 1, 9, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 1, 9, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54f2c102-8f54-4d66-966a-3fc746680841/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 02 03:31:01 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Trying to clone afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd from image 54f2c102-8f54-4d66-966a-3fc746680841 at location (None, [{'url': 'file:///opt/stack/data/glance/images/54f2c102-8f54-4d66-966a-3fc746680841', 'metadata': {}}]). {{(pid=86431) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 02 03:31:01 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-dff1903a-480d-44cf-aba9-dd551461200c req-e059438d-eb8f-4550-8edd-4cacada7d3ec tempest-TestInstancesWithCinderVolumes-1072920434 None] Terminate volume connection completed successfully. Jun 02 03:31:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-dff1903a-480d-44cf-aba9-dd551461200c req-e059438d-eb8f-4550-8edd-4cacada7d3ec tempest-TestInstancesWithCinderVolumes-1072920434 None] Deleting attachment d5fb90ba-1fac-497b-9c38-d4c8b34aa43c. {{(pid=86431) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 02 03:31:01 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_6f95ax6idevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86431) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 02 03:31:01 devstack cinder-volume[86431]: INFO cinder.image.image_utils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Image download 20.69 MB at 20.69 MB/s Jun 02 03:31:01 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b616eb-fefb-47e7-99b7-143c1177d7f7]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:31:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_6f95ax6idevstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:02 devstack sudo[101299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_6f95ax6idevstack@QuobyteHD Jun 02 03:31:02 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:02 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-2efa0852-15aa-45a0-a2e4-9bbbc0f3ed17 req-d8fc3ed2-530e-4c9f-99a9-b45a9c06445d tempest-TestShelveInstance-217844603 None] Terminate volume connection completed successfully. Jun 02 03:31:02 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-2efa0852-15aa-45a0-a2e4-9bbbc0f3ed17 req-d8fc3ed2-530e-4c9f-99a9-b45a9c06445d tempest-TestShelveInstance-217844603 None] Deleting attachment 686ed59a-38cf-4bd5-939e-eef5014979d2. {{(pid=86431) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 02 03:31:02 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_6f95ax6idevstack@QuobyteHD" returned: 0 in 0.716s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:02 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Temporary image 54f2c102-8f54-4d66-966a-3fc746680841 is fetched for user b6ea9c8ba1d1485d90f4fb14c5e47293. {{(pid=86431) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 02 03:31:02 devstack cinder-volume[86431]: DEBUG cinder.coordination [req-2efa0852-15aa-45a0-a2e4-9bbbc0f3ed17 req-ea58b868-8290-4bb2-b1f9-ce9b82e9ae94 tempest-TestShelveInstance-217844603 None] Acquiring lock "cinder-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:31:02 devstack cinder-volume[86431]: DEBUG cinder.coordination [req-2efa0852-15aa-45a0-a2e4-9bbbc0f3ed17 req-ea58b868-8290-4bb2-b1f9-ce9b82e9ae94 tempest-TestShelveInstance-217844603 None] Lock "cinder-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:31:02 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[9128e7d9-77b8-4097-a78d-90c29f9be4c1]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:31:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_6f95ax6idevstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:02 devstack cinder-volume[86431]: DEBUG cinder.coordination [req-2efa0852-15aa-45a0-a2e4-9bbbc0f3ed17 req-ea58b868-8290-4bb2-b1f9-ce9b82e9ae94 tempest-TestShelveInstance-217844603 None] Acquiring lock "cinder-quobyte-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:31:02 devstack cinder-volume[86431]: DEBUG cinder.coordination [req-2efa0852-15aa-45a0-a2e4-9bbbc0f3ed17 req-ea58b868-8290-4bb2-b1f9-ce9b82e9ae94 tempest-TestShelveInstance-217844603 None] Lock "cinder-quobyte-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb" acquired by "delete_volume" :: waited 0.017s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:31:02 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[d845640f-414b-450b-8a2b-6b4fa242a75b]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:31:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-2efa0852-15aa-45a0-a2e4-9bbbc0f3ed17 req-ea58b868-8290-4bb2-b1f9-ce9b82e9ae94 tempest-TestShelveInstance-217844603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:02 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_6f95ax6idevstack@QuobyteHD Jun 02 03:31:02 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:02 devstack sudo[101306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb Jun 02 03:31:02 devstack sudo[101306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:03 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_6f95ax6idevstack@QuobyteHD" returned: 0 in 0.750s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:31:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:31:03 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2080324090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='796304c09abc46fe95d88de6b5b29b93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:31:01Z,use_quota=True,user_id='b6ea9c8ba1d1485d90f4fb14c5e47293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:31:03 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Creating volume afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:31:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:31:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:31:03 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:31:03 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:31:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:31:03 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:31:03 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:31:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:03 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd 1073741824 Jun 02 03:31:03 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:03 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7aba7fa5-9d11-496c-8fba-815ca0feb780 tempest-TestInstancesWithCinderVolumes-1072920434 None] Acquiring lock "cinder-993e7a9b-b819-45eb-a2ad-d2b4e9ce694f-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:31:03 devstack sudo[101306]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:03 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7aba7fa5-9d11-496c-8fba-815ca0feb780 tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "cinder-993e7a9b-b819-45eb-a2ad-d2b4e9ce694f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:31:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-2efa0852-15aa-45a0-a2e4-9bbbc0f3ed17 req-ea58b868-8290-4bb2-b1f9-ce9b82e9ae94 tempest-TestShelveInstance-217844603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb" returned: 0 in 0.830s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-2efa0852-15aa-45a0-a2e4-9bbbc0f3ed17 req-ea58b868-8290-4bb2-b1f9-ce9b82e9ae94 tempest-TestShelveInstance-217844603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:03 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7aba7fa5-9d11-496c-8fba-815ca0feb780 tempest-TestInstancesWithCinderVolumes-1072920434 None] Acquiring lock "cinder-quobyte-993e7a9b-b819-45eb-a2ad-d2b4e9ce694f" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:31:03 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7aba7fa5-9d11-496c-8fba-815ca0feb780 tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "cinder-quobyte-993e7a9b-b819-45eb-a2ad-d2b4e9ce694f" acquired by "delete_volume" :: waited 0.023s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:31:03 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a337f6-ec36-4982-b19a-463d58835ef6]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:31:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7aba7fa5-9d11-496c-8fba-815ca0feb780 tempest-TestInstancesWithCinderVolumes-1072920434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-993e7a9b-b819-45eb-a2ad-d2b4e9ce694f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:03 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb Jun 02 03:31:03 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:03 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-993e7a9b-b819-45eb-a2ad-d2b4e9ce694f Jun 02 03:31:03 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:04 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd 1073741824" returned: 0 in 0.953s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:04 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-2efa0852-15aa-45a0-a2e4-9bbbc0f3ed17 req-ea58b868-8290-4bb2-b1f9-ce9b82e9ae94 tempest-TestShelveInstance-217844603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb" returned: 1 in 0.887s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-2efa0852-15aa-45a0-a2e4-9bbbc0f3ed17 req-ea58b868-8290-4bb2-b1f9-ce9b82e9ae94 tempest-TestShelveInstance-217844603 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:31:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-2efa0852-15aa-45a0-a2e4-9bbbc0f3ed17 req-ea58b868-8290-4bb2-b1f9-ce9b82e9ae94 tempest-TestShelveInstance-217844603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:04 devstack sudo[101332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd Jun 02 03:31:04 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:04 devstack sudo[101333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb Jun 02 03:31:04 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:04 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7aba7fa5-9d11-496c-8fba-815ca0feb780 tempest-TestInstancesWithCinderVolumes-1072920434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-993e7a9b-b819-45eb-a2ad-d2b4e9ce694f" returned: 0 in 1.010s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7aba7fa5-9d11-496c-8fba-815ca0feb780 tempest-TestInstancesWithCinderVolumes-1072920434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-993e7a9b-b819-45eb-a2ad-d2b4e9ce694f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:04 devstack sudo[101339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-993e7a9b-b819-45eb-a2ad-d2b4e9ce694f Jun 02 03:31:04 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:05 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd" returned: 0 in 0.721s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:05 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] <== create_volume: return (1751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:31:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.754s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:31:05 devstack cinder-volume[86431]: DEBUG cinder.volume.volume_utils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Attempting download of 54f2c102-8f54-4d66-966a-3fc746680841 ((None, [{'url': 'file:///opt/stack/data/glance/images/54f2c102-8f54-4d66-966a-3fc746680841', 'metadata': {}}])) to volume afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd. {{(pid=86431) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 02 03:31:05 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-2efa0852-15aa-45a0-a2e4-9bbbc0f3ed17 req-ea58b868-8290-4bb2-b1f9-ce9b82e9ae94 tempest-TestShelveInstance-217844603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb" returned: 0 in 0.758s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:05 devstack cinder-volume[86431]: DEBUG cinder.coordination [req-2efa0852-15aa-45a0-a2e4-9bbbc0f3ed17 req-ea58b868-8290-4bb2-b1f9-ce9b82e9ae94 tempest-TestShelveInstance-217844603 None] Lock "cinder-quobyte-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb" released by "delete_volume" :: held 2.546s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:31:05 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[1644aa04-75d1-4197-9721-b5b91ac56211]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:31:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54f2c102-8f54-4d66-966a-3fc746680841_jrbqqsv1 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:05 devstack cinder-volume[86431]: DEBUG cinder.quota [req-2efa0852-15aa-45a0-a2e4-9bbbc0f3ed17 req-ea58b868-8290-4bb2-b1f9-ce9b82e9ae94 tempest-TestShelveInstance-217844603 None] Created reservations ['c3f7f32f-6264-404d-9bc0-22326f4e019e', 'ba19f0be-0dbe-427f-9d3c-52f635b9f2d6', '5474b461-f070-4da5-8402-6a5e1a383f08', 'a134b35d-76ae-4878-8f9f-b732b0fc926d'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:31:05 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54f2c102-8f54-4d66-966a-3fc746680841_jrbqqsv1 Jun 02 03:31:05 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:05 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7aba7fa5-9d11-496c-8fba-815ca0feb780 tempest-TestInstancesWithCinderVolumes-1072920434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-993e7a9b-b819-45eb-a2ad-d2b4e9ce694f" returned: 0 in 0.700s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:05 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7aba7fa5-9d11-496c-8fba-815ca0feb780 tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "cinder-quobyte-993e7a9b-b819-45eb-a2ad-d2b4e9ce694f" released by "delete_volume" :: held 1.774s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:31:05 devstack cinder-volume[86431]: WARNING cinder.quota [None req-7aba7fa5-9d11-496c-8fba-815ca0feb780 tempest-TestInstancesWithCinderVolumes-1072920434 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-568666092-757110843 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-568666092-757110843, it is now deprecated. Please use the default quota class for default quota. Jun 02 03:31:05 devstack cinder-volume[86431]: WARNING cinder.quota [None req-7aba7fa5-9d11-496c-8fba-815ca0feb780 tempest-TestInstancesWithCinderVolumes-1072920434 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-568666092-757110843 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-568666092-757110843, it is now deprecated. Please use the default quota class for default quota. Jun 02 03:31:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-2efa0852-15aa-45a0-a2e4-9bbbc0f3ed17 req-ea58b868-8290-4bb2-b1f9-ce9b82e9ae94 tempest-TestShelveInstance-217844603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:31:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-2efa0852-15aa-45a0-a2e4-9bbbc0f3ed17 req-ea58b868-8290-4bb2-b1f9-ce9b82e9ae94 tempest-TestShelveInstance-217844603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:31:05 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [req-2efa0852-15aa-45a0-a2e4-9bbbc0f3ed17 req-ea58b868-8290-4bb2-b1f9-ce9b82e9ae94 tempest-TestShelveInstance-217844603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:31:05 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [req-2efa0852-15aa-45a0-a2e4-9bbbc0f3ed17 req-ea58b868-8290-4bb2-b1f9-ce9b82e9ae94 tempest-TestShelveInstance-217844603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:31:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-2efa0852-15aa-45a0-a2e4-9bbbc0f3ed17 req-ea58b868-8290-4bb2-b1f9-ce9b82e9ae94 tempest-TestShelveInstance-217844603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:31:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-2efa0852-15aa-45a0-a2e4-9bbbc0f3ed17 req-ea58b868-8290-4bb2-b1f9-ce9b82e9ae94 tempest-TestShelveInstance-217844603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:05 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-7aba7fa5-9d11-496c-8fba-815ca0feb780 tempest-TestInstancesWithCinderVolumes-1072920434 None] Created reservations ['027d54e5-fad1-4c09-8dba-9d0d37bdc36a', 'e9cc469e-1b9e-43d0-8797-08564172f83d', '89693bc3-17b4-4f68-8128-aa1598812480', 'c73bb712-daf5-4ef4-bbdc-311c2f0a4733'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:31:05 devstack sudo[101346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:31:05 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7aba7fa5-9d11-496c-8fba-815ca0feb780 tempest-TestInstancesWithCinderVolumes-1072920434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:31:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7aba7fa5-9d11-496c-8fba-815ca0feb780 tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:31:05 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-7aba7fa5-9d11-496c-8fba-815ca0feb780 tempest-TestInstancesWithCinderVolumes-1072920434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:31:05 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-7aba7fa5-9d11-496c-8fba-815ca0feb780 tempest-TestInstancesWithCinderVolumes-1072920434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:31:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7aba7fa5-9d11-496c-8fba-815ca0feb780 tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:31:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7aba7fa5-9d11-496c-8fba-815ca0feb780 tempest-TestInstancesWithCinderVolumes-1072920434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:05 devstack sudo[101348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:31:05 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:06 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54f2c102-8f54-4d66-966a-3fc746680841_jrbqqsv1" returned: 0 in 0.932s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54f2c102-8f54-4d66-966a-3fc746680841_jrbqqsv1 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:06 devstack sudo[101364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54f2c102-8f54-4d66-966a-3fc746680841_jrbqqsv1 Jun 02 03:31:06 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:06 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-2efa0852-15aa-45a0-a2e4-9bbbc0f3ed17 req-ea58b868-8290-4bb2-b1f9-ce9b82e9ae94 tempest-TestShelveInstance-217844603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.897s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:06 devstack cinder-volume[86431]: DEBUG cinder.manager [req-2efa0852-15aa-45a0-a2e4-9bbbc0f3ed17 req-ea58b868-8290-4bb2-b1f9-ce9b82e9ae94 tempest-TestShelveInstance-217844603 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:31:06 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-2efa0852-15aa-45a0-a2e4-9bbbc0f3ed17 req-ea58b868-8290-4bb2-b1f9-ce9b82e9ae94 tempest-TestShelveInstance-217844603 None] Deleted volume successfully. Jun 02 03:31:06 devstack cinder-volume[86431]: DEBUG cinder.coordination [req-2efa0852-15aa-45a0-a2e4-9bbbc0f3ed17 req-ea58b868-8290-4bb2-b1f9-ce9b82e9ae94 tempest-TestShelveInstance-217844603 None] Lock "cinder-1f2f7aba-7e3b-49c4-9e3f-f63ae1ffacbb-delete_volume" released by "delete_volume" :: held 3.810s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:31:06 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7aba7fa5-9d11-496c-8fba-815ca0feb780 tempest-TestInstancesWithCinderVolumes-1072920434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.842s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:06 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-7aba7fa5-9d11-496c-8fba-815ca0feb780 tempest-TestInstancesWithCinderVolumes-1072920434 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:31:06 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-7aba7fa5-9d11-496c-8fba-815ca0feb780 tempest-TestInstancesWithCinderVolumes-1072920434 None] Deleted volume successfully. Jun 02 03:31:06 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7aba7fa5-9d11-496c-8fba-815ca0feb780 tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "cinder-993e7a9b-b819-45eb-a2ad-d2b4e9ce694f-delete_volume" released by "delete_volume" :: held 2.947s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:31:07 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54f2c102-8f54-4d66-966a-3fc746680841_jrbqqsv1" returned: 1 in 0.807s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54f2c102-8f54-4d66-966a-3fc746680841_jrbqqsv1' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:31:07 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f40a76d-cb2d-4c30-9699-c1de0a1c78b7]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:31:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_6f95ax6idevstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:07 devstack sudo[101380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_6f95ax6idevstack@QuobyteHD Jun 02 03:31:07 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:07 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_6f95ax6idevstack@QuobyteHD" returned: 0 in 0.711s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:07 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] 54f2c102-8f54-4d66-966a-3fc746680841 was qcow2, converting to raw {{(pid=86431) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 02 03:31:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_6f95ax6idevstack@QuobyteHD /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:07 devstack sudo[101385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_6f95ax6idevstack@QuobyteHD /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd Jun 02 03:31:07 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:08 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-e2cf39fe-62d2-4593-9163-2c0417b93bc9 req-deefbc81-f9ee-4041-8e95-281df78e21cc tempest-TestInstancesWithCinderVolumes-1072920434 None] Terminate volume connection completed successfully. Jun 02 03:31:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-e2cf39fe-62d2-4593-9163-2c0417b93bc9 req-deefbc81-f9ee-4041-8e95-281df78e21cc tempest-TestInstancesWithCinderVolumes-1072920434 None] Deleting attachment 8764174d-6968-407c-bcd3-92e033f8ca17. {{(pid=86431) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 02 03:31:09 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:31:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:31:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:31:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:31:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:31:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:31:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:09 devstack sudo[101398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:31:09 devstack sudo[101398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:09 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_6f95ax6idevstack@QuobyteHD /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd" returned: 0 in 2.148s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:09 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_54f2c102-8f54-4d66-966a-3fc746680841_6f95ax6idevstack@QuobyteHD, size 112.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd {{(pid=86431) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 02 03:31:09 devstack cinder-volume[86431]: INFO cinder.image.image_utils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Converted 112.00 MB image at 52.10 MB/s Jun 02 03:31:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:10 devstack sudo[101401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd 1G Jun 02 03:31:10 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:10 devstack sudo[101398]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.771s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:10 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:31:10 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager._thread_info {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:31:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread count: 28 {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 02 03:31:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread info: [<_MainThread(MainThread, started 138618128814208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 02 03:31:10 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ab226a35-3321-4f27-93cb-b59ada4f3b96 tempest-TestInstancesWithCinderVolumes-1072920434 None] Acquiring lock "cinder-7b18b337-6aef-4aec-ab58-89d75dad1309-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:31:10 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ab226a35-3321-4f27-93cb-b59ada4f3b96 tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "cinder-7b18b337-6aef-4aec-ab58-89d75dad1309-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:31:10 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ab226a35-3321-4f27-93cb-b59ada4f3b96 tempest-TestInstancesWithCinderVolumes-1072920434 None] Acquiring lock "cinder-quobyte-7b18b337-6aef-4aec-ab58-89d75dad1309" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:31:10 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ab226a35-3321-4f27-93cb-b59ada4f3b96 tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "cinder-quobyte-7b18b337-6aef-4aec-ab58-89d75dad1309" acquired by "delete_volume" :: waited 0.019s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:31:10 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d25c1e2-03c9-4ab2-a13d-8f1e085370a8]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:31:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ab226a35-3321-4f27-93cb-b59ada4f3b96 tempest-TestInstancesWithCinderVolumes-1072920434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7b18b337-6aef-4aec-ab58-89d75dad1309 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:10 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd 1G" returned: 0 in 0.791s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:10 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac41369-93b9-4a1b-9bc2-92b906492580]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:31:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:10 devstack sudo[101408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7b18b337-6aef-4aec-ab58-89d75dad1309 Jun 02 03:31:10 devstack sudo[101408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:10 devstack sudo[101409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd Jun 02 03:31:10 devstack sudo[101409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:11 devstack sudo[101409]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd" returned: 0 in 0.951s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:11 devstack sudo[101408]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ab226a35-3321-4f27-93cb-b59ada4f3b96 tempest-TestInstancesWithCinderVolumes-1072920434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7b18b337-6aef-4aec-ab58-89d75dad1309" returned: 0 in 1.148s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ab226a35-3321-4f27-93cb-b59ada4f3b96 tempest-TestInstancesWithCinderVolumes-1072920434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7b18b337-6aef-4aec-ab58-89d75dad1309 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:11 devstack sudo[101419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7b18b337-6aef-4aec-ab58-89d75dad1309 Jun 02 03:31:11 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:11 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd Jun 02 03:31:11 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:12 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd" returned: 1 in 0.902s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:31:12 devstack cinder-volume[86431]: DEBUG cinder.volume.volume_utils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Downloaded image 54f2c102-8f54-4d66-966a-3fc746680841 ((None, [{'url': 'file:///opt/stack/data/glance/images/54f2c102-8f54-4d66-966a-3fc746680841', 'metadata': {}}])) to volume afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd successfully. {{(pid=86431) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 02 03:31:12 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Temporary image 54f2c102-8f54-4d66-966a-3fc746680841 for user b6ea9c8ba1d1485d90f4fb14c5e47293 is deleted. {{(pid=86431) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 02 03:31:12 devstack cinder-volume[86431]: DEBUG cinder.volume.volume_utils [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Marking volume afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd as bootable. {{(pid=86431) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 02 03:31:12 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Copying metadata from image 54f2c102-8f54-4d66-966a-3fc746680841 to afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd. {{(pid=86431) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 02 03:31:12 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Creating volume glance metadata for volume afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd backed by image 54f2c102-8f54-4d66-966a-3fc746680841 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '54f2c102-8f54-4d66-966a-3fc746680841', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86431) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 02 03:31:12 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce6bdda-9bf0-4b9e-ac64-905ef873672c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd', 'volume_size': 1, 'image_id': '54f2c102-8f54-4d66-966a-3fc746680841', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54f2c102-8f54-4d66-966a-3fc746680841', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '48b06555345b4428a30a6f37e96ddabe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '54f2c102-8f54-4d66-966a-3fc746680841', 'created_at': datetime.datetime(2026, 6, 2, 1, 9, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 1, 9, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54f2c102-8f54-4d66-966a-3fc746680841/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:12 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:12 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3bb6de-b75e-4b5c-bed4-7f035070beaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ab226a35-3321-4f27-93cb-b59ada4f3b96 tempest-TestInstancesWithCinderVolumes-1072920434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7b18b337-6aef-4aec-ab58-89d75dad1309" returned: 0 in 1.013s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:12 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ab226a35-3321-4f27-93cb-b59ada4f3b96 tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "cinder-quobyte-7b18b337-6aef-4aec-ab58-89d75dad1309" released by "delete_volume" :: held 2.219s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:31:12 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Volume volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd (afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd): created successfully Jun 02 03:31:12 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3bb6de-b75e-4b5c-bed4-7f035070beaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:12 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Flow 'volume_create_manager' (89f66293-ff04-4ffd-baa2-34d863624ae8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:31:12 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-6d044c63-3a36-4fa1-913a-f76ec18ba139 tempest-VolumesExtendTest-265044759 None] Created volume successfully. Jun 02 03:31:12 devstack cinder-volume[86431]: WARNING cinder.quota [None req-ab226a35-3321-4f27-93cb-b59ada4f3b96 tempest-TestInstancesWithCinderVolumes-1072920434 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-628919905-1988845919 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-628919905-1988845919, it is now deprecated. Please use the default quota class for default quota. Jun 02 03:31:12 devstack cinder-volume[86431]: WARNING cinder.quota [None req-ab226a35-3321-4f27-93cb-b59ada4f3b96 tempest-TestInstancesWithCinderVolumes-1072920434 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-628919905-1988845919 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-628919905-1988845919, it is now deprecated. Please use the default quota class for default quota. Jun 02 03:31:12 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-ab226a35-3321-4f27-93cb-b59ada4f3b96 tempest-TestInstancesWithCinderVolumes-1072920434 None] Created reservations ['f910d713-06ab-44ea-b6da-a63f0a41211f', '2a83c203-764f-4fd4-88c9-d9b0aa8bd169', '15993a97-1df4-448c-b038-c7364829112c', '5e2525cf-775c-47da-98ad-8510e12f2445'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:31:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ab226a35-3321-4f27-93cb-b59ada4f3b96 tempest-TestInstancesWithCinderVolumes-1072920434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:31:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ab226a35-3321-4f27-93cb-b59ada4f3b96 tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:31:12 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ab226a35-3321-4f27-93cb-b59ada4f3b96 tempest-TestInstancesWithCinderVolumes-1072920434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:31:12 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ab226a35-3321-4f27-93cb-b59ada4f3b96 tempest-TestInstancesWithCinderVolumes-1072920434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:31:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ab226a35-3321-4f27-93cb-b59ada4f3b96 tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:31:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ab226a35-3321-4f27-93cb-b59ada4f3b96 tempest-TestInstancesWithCinderVolumes-1072920434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:13 devstack sudo[101430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:31:13 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-98751f34-4fe1-40ee-aaf8-a3540a368b45 tempest-VolumesExtendTest-265044759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:31:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-98751f34-4fe1-40ee-aaf8-a3540a368b45 tempest-VolumesExtendTest-265044759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:31:13 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a13f02-3b4e-4499-9446-e2487be64940]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:31:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-98751f34-4fe1-40ee-aaf8-a3540a368b45 tempest-VolumesExtendTest-265044759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:13 devstack sudo[101433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd Jun 02 03:31:13 devstack sudo[101433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:13 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ab226a35-3321-4f27-93cb-b59ada4f3b96 tempest-TestInstancesWithCinderVolumes-1072920434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.931s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:13 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-ab226a35-3321-4f27-93cb-b59ada4f3b96 tempest-TestInstancesWithCinderVolumes-1072920434 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:31:13 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-ab226a35-3321-4f27-93cb-b59ada4f3b96 tempest-TestInstancesWithCinderVolumes-1072920434 None] Deleted volume successfully. Jun 02 03:31:13 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ab226a35-3321-4f27-93cb-b59ada4f3b96 tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "cinder-7b18b337-6aef-4aec-ab58-89d75dad1309-delete_volume" released by "delete_volume" :: held 3.417s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:31:14 devstack sudo[101433]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-98751f34-4fe1-40ee-aaf8-a3540a368b45 tempest-VolumesExtendTest-265044759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd" returned: 0 in 0.924s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-98751f34-4fe1-40ee-aaf8-a3540a368b45 tempest-VolumesExtendTest-265044759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:14 devstack sudo[101439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd Jun 02 03:31:14 devstack sudo[101439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:15 devstack sudo[101439]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-98751f34-4fe1-40ee-aaf8-a3540a368b45 tempest-VolumesExtendTest-265044759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd" returned: 1 in 0.913s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-98751f34-4fe1-40ee-aaf8-a3540a368b45 tempest-VolumesExtendTest-265044759 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:31:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-98751f34-4fe1-40ee-aaf8-a3540a368b45 tempest-VolumesExtendTest-265044759 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd 2G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-98751f34-4fe1-40ee-aaf8-a3540a368b45 tempest-VolumesExtendTest-265044759 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd 2G" returned: 0 in 0.082s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-98751f34-4fe1-40ee-aaf8-a3540a368b45 tempest-VolumesExtendTest-265044759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:31:15 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-98751f34-4fe1-40ee-aaf8-a3540a368b45 tempest-VolumesExtendTest-265044759 None] Extend volume completed successfully. Jun 02 03:31:15 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e18f1d34-de19-4af1-970d-1824e607e9d5 tempest-VolumesExtendTest-265044759 None] Acquiring lock "cinder-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:31:15 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e18f1d34-de19-4af1-970d-1824e607e9d5 tempest-VolumesExtendTest-265044759 None] Lock "cinder-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:31:15 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e18f1d34-de19-4af1-970d-1824e607e9d5 tempest-VolumesExtendTest-265044759 None] Acquiring lock "cinder-quobyte-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:31:15 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e18f1d34-de19-4af1-970d-1824e607e9d5 tempest-VolumesExtendTest-265044759 None] Lock "cinder-quobyte-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd" acquired by "delete_volume" :: waited 0.042s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:31:15 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bef4d6c-d8fa-4b52-af99-21ccb9e2a2aa]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:31:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e18f1d34-de19-4af1-970d-1824e607e9d5 tempest-VolumesExtendTest-265044759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:16 devstack sudo[101489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd Jun 02 03:31:16 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:16 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e18f1d34-de19-4af1-970d-1824e607e9d5 tempest-VolumesExtendTest-265044759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd" returned: 0 in 0.784s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e18f1d34-de19-4af1-970d-1824e607e9d5 tempest-VolumesExtendTest-265044759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:16 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd Jun 02 03:31:16 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:17 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e18f1d34-de19-4af1-970d-1824e607e9d5 tempest-VolumesExtendTest-265044759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd" returned: 1 in 0.832s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e18f1d34-de19-4af1-970d-1824e607e9d5 tempest-VolumesExtendTest-265044759 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:31:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e18f1d34-de19-4af1-970d-1824e607e9d5 tempest-VolumesExtendTest-265044759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:17 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd Jun 02 03:31:17 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:18 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-4d615df9-2e70-4160-8f96-2e3595e3b94c req-cb1aff49-4c57-4fe8-879d-92fc9fe4c24e tempest-TestInstancesWithCinderVolumes-1072920434 None] Terminate volume connection completed successfully. Jun 02 03:31:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-4d615df9-2e70-4160-8f96-2e3595e3b94c req-cb1aff49-4c57-4fe8-879d-92fc9fe4c24e tempest-TestInstancesWithCinderVolumes-1072920434 None] Deleting attachment 29ada636-f8eb-4c90-aa65-9b2f99d7ddeb. {{(pid=86431) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 02 03:31:18 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e18f1d34-de19-4af1-970d-1824e607e9d5 tempest-VolumesExtendTest-265044759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd" returned: 0 in 0.630s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:18 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e18f1d34-de19-4af1-970d-1824e607e9d5 tempest-VolumesExtendTest-265044759 None] Lock "cinder-quobyte-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd" released by "delete_volume" :: held 2.345s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:31:18 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-e18f1d34-de19-4af1-970d-1824e607e9d5 tempest-VolumesExtendTest-265044759 None] Created reservations ['ae9524f2-2072-45d8-aaa6-5288057be182', 'a3edddd8-d0d4-438c-9109-5c755045ab28', '93726cb5-9249-41cb-b188-6bb873ef9b63', '9d8f2f6e-cfba-4f8e-ab7c-64c255b6686e'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:31:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e18f1d34-de19-4af1-970d-1824e607e9d5 tempest-VolumesExtendTest-265044759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:31:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e18f1d34-de19-4af1-970d-1824e607e9d5 tempest-VolumesExtendTest-265044759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:31:18 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e18f1d34-de19-4af1-970d-1824e607e9d5 tempest-VolumesExtendTest-265044759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:31:18 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e18f1d34-de19-4af1-970d-1824e607e9d5 tempest-VolumesExtendTest-265044759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:31:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e18f1d34-de19-4af1-970d-1824e607e9d5 tempest-VolumesExtendTest-265044759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:31:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e18f1d34-de19-4af1-970d-1824e607e9d5 tempest-VolumesExtendTest-265044759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:18 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:31:18 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:19 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e18f1d34-de19-4af1-970d-1824e607e9d5 tempest-VolumesExtendTest-265044759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.631s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-e18f1d34-de19-4af1-970d-1824e607e9d5 tempest-VolumesExtendTest-265044759 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:31:19 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-e18f1d34-de19-4af1-970d-1824e607e9d5 tempest-VolumesExtendTest-265044759 None] Deleted volume successfully. Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e18f1d34-de19-4af1-970d-1824e607e9d5 tempest-VolumesExtendTest-265044759 None] Lock "cinder-afb98aa8-f6f4-4cf9-9c8f-2fe9a46608dd-delete_volume" released by "delete_volume" :: held 3.322s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7949e19-45fe-44af-b2bd-e53e01c2f840 tempest-VolumeDependencyTests-1178729307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e7949e19-45fe-44af-b2bd-e53e01c2f840 tempest-VolumeDependencyTests-1178729307 None] Flow 'volume_create_manager' (2e381db2-01b8-40a1-9a76-3a69ced86f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e7949e19-45fe-44af-b2bd-e53e01c2f840 tempest-VolumeDependencyTests-1178729307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c2bb1ac-eaaf-4832-80c9-b5640dde6dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e7949e19-45fe-44af-b2bd-e53e01c2f840 tempest-VolumeDependencyTests-1178729307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c2bb1ac-eaaf-4832-80c9-b5640dde6dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1314906024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e28b3bb-39d8-4208-a9f4-dd3763738207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b0f280d4f064b40aecbb44114dcc85c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:31:19Z,use_quota=True,user_id='09b850c133744f23babb840bde9cef6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e7949e19-45fe-44af-b2bd-e53e01c2f840 tempest-VolumeDependencyTests-1178729307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0e0b81e-9f88-444b-b9e4-d7439998582f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e7949e19-45fe-44af-b2bd-e53e01c2f840 tempest-VolumeDependencyTests-1178729307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0e0b81e-9f88-444b-b9e4-d7439998582f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e7949e19-45fe-44af-b2bd-e53e01c2f840 tempest-VolumeDependencyTests-1178729307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d369edb3-dc1d-417e-870d-d4311726436d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e7949e19-45fe-44af-b2bd-e53e01c2f840 tempest-VolumeDependencyTests-1178729307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d369edb3-dc1d-417e-870d-d4311726436d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e28b3bb-39d8-4208-a9f4-dd3763738207', 'volume_name': 'volume-1e28b3bb-39d8-4208-a9f4-dd3763738207', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e7949e19-45fe-44af-b2bd-e53e01c2f840 tempest-VolumeDependencyTests-1178729307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (159305f1-d929-49d5-9142-9bb7e127064c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e7949e19-45fe-44af-b2bd-e53e01c2f840 tempest-VolumeDependencyTests-1178729307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (159305f1-d929-49d5-9142-9bb7e127064c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e7949e19-45fe-44af-b2bd-e53e01c2f840 tempest-VolumeDependencyTests-1178729307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7afc4469-2c5e-4349-8bca-4b4128a66337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:19 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-e7949e19-45fe-44af-b2bd-e53e01c2f840 tempest-VolumeDependencyTests-1178729307 None] Volume 1e28b3bb-39d8-4208-a9f4-dd3763738207: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e28b3bb-39d8-4208-a9f4-dd3763738207', 'volume_size': 1} Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e7949e19-45fe-44af-b2bd-e53e01c2f840 tempest-VolumeDependencyTests-1178729307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e7949e19-45fe-44af-b2bd-e53e01c2f840 tempest-VolumeDependencyTests-1178729307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e7949e19-45fe-44af-b2bd-e53e01c2f840 tempest-VolumeDependencyTests-1178729307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1314906024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e28b3bb-39d8-4208-a9f4-dd3763738207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b0f280d4f064b40aecbb44114dcc85c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:31:19Z,use_quota=True,user_id='09b850c133744f23babb840bde9cef6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-e7949e19-45fe-44af-b2bd-e53e01c2f840 tempest-VolumeDependencyTests-1178729307 None] Creating volume 1e28b3bb-39d8-4208-a9f4-dd3763738207 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e7949e19-45fe-44af-b2bd-e53e01c2f840 tempest-VolumeDependencyTests-1178729307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e7949e19-45fe-44af-b2bd-e53e01c2f840 tempest-VolumeDependencyTests-1178729307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e7949e19-45fe-44af-b2bd-e53e01c2f840 tempest-VolumeDependencyTests-1178729307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e7949e19-45fe-44af-b2bd-e53e01c2f840 tempest-VolumeDependencyTests-1178729307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e7949e19-45fe-44af-b2bd-e53e01c2f840 tempest-VolumeDependencyTests-1178729307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e7949e19-45fe-44af-b2bd-e53e01c2f840 tempest-VolumeDependencyTests-1178729307 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:31:19 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-e7949e19-45fe-44af-b2bd-e53e01c2f840 tempest-VolumeDependencyTests-1178729307 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e7949e19-45fe-44af-b2bd-e53e01c2f840 tempest-VolumeDependencyTests-1178729307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-9005a41e-2ee4-46a3-9984-1f3e62f5d3fe tempest-VolumesExtendTest-265044759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:31:19 devstack sudo[101505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207 1073741824 Jun 02 03:31:19 devstack sudo[101505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9005a41e-2ee4-46a3-9984-1f3e62f5d3fe tempest-VolumesExtendTest-265044759 None] Flow 'volume_create_manager' (9a88834b-c294-41b3-a92b-29fe2bedcb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9005a41e-2ee4-46a3-9984-1f3e62f5d3fe tempest-VolumesExtendTest-265044759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (953c314e-2e25-4e70-b8a9-8b60b6096613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9005a41e-2ee4-46a3-9984-1f3e62f5d3fe tempest-VolumesExtendTest-265044759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (953c314e-2e25-4e70-b8a9-8b60b6096613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-930533755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a011a12-293c-4d90-89ac-25b199a5db11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='796304c09abc46fe95d88de6b5b29b93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:31:19Z,use_quota=True,user_id='b6ea9c8ba1d1485d90f4fb14c5e47293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9005a41e-2ee4-46a3-9984-1f3e62f5d3fe tempest-VolumesExtendTest-265044759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (792a67a7-a581-4098-988c-711b55ef81ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9005a41e-2ee4-46a3-9984-1f3e62f5d3fe tempest-VolumesExtendTest-265044759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (792a67a7-a581-4098-988c-711b55ef81ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9005a41e-2ee4-46a3-9984-1f3e62f5d3fe tempest-VolumesExtendTest-265044759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee5b6769-c41e-4b09-a4f1-1fc9912f12c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9005a41e-2ee4-46a3-9984-1f3e62f5d3fe tempest-VolumesExtendTest-265044759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee5b6769-c41e-4b09-a4f1-1fc9912f12c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a011a12-293c-4d90-89ac-25b199a5db11', 'volume_name': 'volume-2a011a12-293c-4d90-89ac-25b199a5db11', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9005a41e-2ee4-46a3-9984-1f3e62f5d3fe tempest-VolumesExtendTest-265044759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (408e0a68-d1a7-4a11-abda-f8c89a81d91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9005a41e-2ee4-46a3-9984-1f3e62f5d3fe tempest-VolumesExtendTest-265044759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (408e0a68-d1a7-4a11-abda-f8c89a81d91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9005a41e-2ee4-46a3-9984-1f3e62f5d3fe tempest-VolumesExtendTest-265044759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bfa9db5-d664-4b34-b400-e75bbc480981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:19 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-9005a41e-2ee4-46a3-9984-1f3e62f5d3fe tempest-VolumesExtendTest-265044759 None] Volume 2a011a12-293c-4d90-89ac-25b199a5db11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a011a12-293c-4d90-89ac-25b199a5db11', 'volume_size': 1} Jun 02 03:31:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9005a41e-2ee4-46a3-9984-1f3e62f5d3fe tempest-VolumesExtendTest-265044759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:31:20 devstack sudo[101505]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e7949e19-45fe-44af-b2bd-e53e01c2f840 tempest-VolumeDependencyTests-1178729307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207 1073741824" returned: 0 in 0.760s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e7949e19-45fe-44af-b2bd-e53e01c2f840 tempest-VolumeDependencyTests-1178729307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:20 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207 Jun 02 03:31:20 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:20 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e7949e19-45fe-44af-b2bd-e53e01c2f840 tempest-VolumeDependencyTests-1178729307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207" returned: 0 in 0.597s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e7949e19-45fe-44af-b2bd-e53e01c2f840 tempest-VolumeDependencyTests-1178729307 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:31:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e7949e19-45fe-44af-b2bd-e53e01c2f840 tempest-VolumeDependencyTests-1178729307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.396s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:31:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9005a41e-2ee4-46a3-9984-1f3e62f5d3fe tempest-VolumesExtendTest-265044759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.285s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:31:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9005a41e-2ee4-46a3-9984-1f3e62f5d3fe tempest-VolumesExtendTest-265044759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-930533755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a011a12-293c-4d90-89ac-25b199a5db11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='796304c09abc46fe95d88de6b5b29b93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:31:19Z,use_quota=True,user_id='b6ea9c8ba1d1485d90f4fb14c5e47293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:31:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-9005a41e-2ee4-46a3-9984-1f3e62f5d3fe tempest-VolumesExtendTest-265044759 None] Creating volume 2a011a12-293c-4d90-89ac-25b199a5db11 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:31:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9005a41e-2ee4-46a3-9984-1f3e62f5d3fe tempest-VolumesExtendTest-265044759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:31:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9005a41e-2ee4-46a3-9984-1f3e62f5d3fe tempest-VolumesExtendTest-265044759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:31:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9005a41e-2ee4-46a3-9984-1f3e62f5d3fe tempest-VolumesExtendTest-265044759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:31:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9005a41e-2ee4-46a3-9984-1f3e62f5d3fe tempest-VolumesExtendTest-265044759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:31:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9005a41e-2ee4-46a3-9984-1f3e62f5d3fe tempest-VolumesExtendTest-265044759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:31:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9005a41e-2ee4-46a3-9984-1f3e62f5d3fe tempest-VolumesExtendTest-265044759 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:31:20 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-9005a41e-2ee4-46a3-9984-1f3e62f5d3fe tempest-VolumesExtendTest-265044759 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:31:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9005a41e-2ee4-46a3-9984-1f3e62f5d3fe tempest-VolumesExtendTest-265044759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e7949e19-45fe-44af-b2bd-e53e01c2f840 tempest-VolumeDependencyTests-1178729307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7afc4469-2c5e-4349-8bca-4b4128a66337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e28b3bb-39d8-4208-a9f4-dd3763738207', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:21 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11 1073741824 Jun 02 03:31:21 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e7949e19-45fe-44af-b2bd-e53e01c2f840 tempest-VolumeDependencyTests-1178729307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7a215ae-5a1c-4c47-8656-95ced425481e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:21 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-e7949e19-45fe-44af-b2bd-e53e01c2f840 tempest-VolumeDependencyTests-1178729307 None] Volume volume-1e28b3bb-39d8-4208-a9f4-dd3763738207 (1e28b3bb-39d8-4208-a9f4-dd3763738207): created successfully Jun 02 03:31:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e7949e19-45fe-44af-b2bd-e53e01c2f840 tempest-VolumeDependencyTests-1178729307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7a215ae-5a1c-4c47-8656-95ced425481e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e7949e19-45fe-44af-b2bd-e53e01c2f840 tempest-VolumeDependencyTests-1178729307 None] Flow 'volume_create_manager' (2e381db2-01b8-40a1-9a76-3a69ced86f39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:31:21 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-e7949e19-45fe-44af-b2bd-e53e01c2f840 tempest-VolumeDependencyTests-1178729307 None] Created volume successfully. Jun 02 03:31:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c39b4143-8066-441d-89ce-8c6e32ad87c1 tempest-VolumeDependencyTests-1178729307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:31:21 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-9c9915c8-7504-4c27-ade5-3001627824c2 tempest-TestInstancesWithCinderVolumes-1072920434 None] Acquiring lock "cinder-f25d535b-1ae2-47b0-a4c7-c18036e55a72-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:31:21 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-9c9915c8-7504-4c27-ade5-3001627824c2 tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "cinder-f25d535b-1ae2-47b0-a4c7-c18036e55a72-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:31:21 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9005a41e-2ee4-46a3-9984-1f3e62f5d3fe tempest-VolumesExtendTest-265044759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11 1073741824" returned: 0 in 0.859s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:21 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-9c9915c8-7504-4c27-ade5-3001627824c2 tempest-TestInstancesWithCinderVolumes-1072920434 None] Acquiring lock "cinder-quobyte-f25d535b-1ae2-47b0-a4c7-c18036e55a72" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:31:21 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-9c9915c8-7504-4c27-ade5-3001627824c2 tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "cinder-quobyte-f25d535b-1ae2-47b0-a4c7-c18036e55a72" acquired by "delete_volume" :: waited 0.027s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:31:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9005a41e-2ee4-46a3-9984-1f3e62f5d3fe tempest-VolumesExtendTest-265044759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:21 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bd377c-d9fe-4e41-b903-639ec12c7e6f]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:31:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9c9915c8-7504-4c27-ade5-3001627824c2 tempest-TestInstancesWithCinderVolumes-1072920434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:21 devstack sudo[101519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11 Jun 02 03:31:21 devstack sudo[101519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:22 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72 Jun 02 03:31:22 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:22 devstack sudo[101519]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9005a41e-2ee4-46a3-9984-1f3e62f5d3fe tempest-VolumesExtendTest-265044759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11" returned: 0 in 0.597s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:22 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9005a41e-2ee4-46a3-9984-1f3e62f5d3fe tempest-VolumesExtendTest-265044759 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:31:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9005a41e-2ee4-46a3-9984-1f3e62f5d3fe tempest-VolumesExtendTest-265044759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:31:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c39b4143-8066-441d-89ce-8c6e32ad87c1 tempest-VolumeDependencyTests-1178729307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.779s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:31:22 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-c39b4143-8066-441d-89ce-8c6e32ad87c1 tempest-VolumeDependencyTests-1178729307 None] Creating offline snapshot be7a3fff-4935-4ce1-82ff-e8bd0ece75ad of volume 1e28b3bb-39d8-4208-a9f4-dd3763738207 {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:31:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9005a41e-2ee4-46a3-9984-1f3e62f5d3fe tempest-VolumesExtendTest-265044759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bfa9db5-d664-4b34-b400-e75bbc480981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a011a12-293c-4d90-89ac-25b199a5db11', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9005a41e-2ee4-46a3-9984-1f3e62f5d3fe tempest-VolumesExtendTest-265044759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86149dfe-2f23-469a-a2a5-5bf4546806f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:22 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[df167487-73ba-477a-afe5-f0a6e77dd279]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:31:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c39b4143-8066-441d-89ce-8c6e32ad87c1 tempest-VolumeDependencyTests-1178729307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:22 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-9005a41e-2ee4-46a3-9984-1f3e62f5d3fe tempest-VolumesExtendTest-265044759 None] Volume volume-2a011a12-293c-4d90-89ac-25b199a5db11 (2a011a12-293c-4d90-89ac-25b199a5db11): created successfully Jun 02 03:31:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9005a41e-2ee4-46a3-9984-1f3e62f5d3fe tempest-VolumesExtendTest-265044759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86149dfe-2f23-469a-a2a5-5bf4546806f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9005a41e-2ee4-46a3-9984-1f3e62f5d3fe tempest-VolumesExtendTest-265044759 None] Flow 'volume_create_manager' (9a88834b-c294-41b3-a92b-29fe2bedcb35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:31:22 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-9005a41e-2ee4-46a3-9984-1f3e62f5d3fe tempest-VolumesExtendTest-265044759 None] Created volume successfully. Jun 02 03:31:22 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9c9915c8-7504-4c27-ade5-3001627824c2 tempest-TestInstancesWithCinderVolumes-1072920434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72" returned: 0 in 0.708s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9c9915c8-7504-4c27-ade5-3001627824c2 tempest-TestInstancesWithCinderVolumes-1072920434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:22 devstack sudo[101526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207 Jun 02 03:31:22 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:22 devstack sudo[101527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72 Jun 02 03:31:22 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:23 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c39b4143-8066-441d-89ce-8c6e32ad87c1 tempest-VolumeDependencyTests-1178729307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207" returned: 0 in 0.755s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c39b4143-8066-441d-89ce-8c6e32ad87c1 tempest-VolumeDependencyTests-1178729307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207.be7a3fff-4935-4ce1-82ff-e8bd0ece75ad 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:23 devstack sudo[101538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207.be7a3fff-4935-4ce1-82ff-e8bd0ece75ad 1G Jun 02 03:31:23 devstack sudo[101538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:23 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9c9915c8-7504-4c27-ade5-3001627824c2 tempest-TestInstancesWithCinderVolumes-1072920434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72" returned: 1 in 0.727s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9c9915c8-7504-4c27-ade5-3001627824c2 tempest-TestInstancesWithCinderVolumes-1072920434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:31:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9c9915c8-7504-4c27-ade5-3001627824c2 tempest-TestInstancesWithCinderVolumes-1072920434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:23 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72 Jun 02 03:31:23 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e2068895-e2df-4573-9794-ae78e9fa97f8 tempest-VolumesExtendTest-265044759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:31:24 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9c9915c8-7504-4c27-ade5-3001627824c2 tempest-TestInstancesWithCinderVolumes-1072920434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f25d535b-1ae2-47b0-a4c7-c18036e55a72" returned: 0 in 0.646s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:24 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-9c9915c8-7504-4c27-ade5-3001627824c2 tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "cinder-quobyte-f25d535b-1ae2-47b0-a4c7-c18036e55a72" released by "delete_volume" :: held 2.143s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:31:24 devstack cinder-volume[86431]: WARNING cinder.quota [None req-9c9915c8-7504-4c27-ade5-3001627824c2 tempest-TestInstancesWithCinderVolumes-1072920434 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1891697135-1178367229 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1891697135-1178367229, it is now deprecated. Please use the default quota class for default quota. Jun 02 03:31:24 devstack cinder-volume[86431]: WARNING cinder.quota [None req-9c9915c8-7504-4c27-ade5-3001627824c2 tempest-TestInstancesWithCinderVolumes-1072920434 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1891697135-1178367229 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1891697135-1178367229, it is now deprecated. Please use the default quota class for default quota. Jun 02 03:31:24 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-9c9915c8-7504-4c27-ade5-3001627824c2 tempest-TestInstancesWithCinderVolumes-1072920434 None] Created reservations ['82b1a894-cfd9-4408-9e0e-1308012a015c', 'f63e4816-d4f4-4a14-8462-1a4065f142d5', '46d5b2e1-48bb-4efc-9a3e-d4fc6b0c2630', 'bf773303-cd66-4f3e-867f-169d0557b7fe'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:31:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9c9915c8-7504-4c27-ade5-3001627824c2 tempest-TestInstancesWithCinderVolumes-1072920434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:31:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9c9915c8-7504-4c27-ade5-3001627824c2 tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:31:24 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9c9915c8-7504-4c27-ade5-3001627824c2 tempest-TestInstancesWithCinderVolumes-1072920434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:31:24 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9c9915c8-7504-4c27-ade5-3001627824c2 tempest-TestInstancesWithCinderVolumes-1072920434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:31:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9c9915c8-7504-4c27-ade5-3001627824c2 tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:31:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9c9915c8-7504-4c27-ade5-3001627824c2 tempest-TestInstancesWithCinderVolumes-1072920434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:24 devstack sudo[101538]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c39b4143-8066-441d-89ce-8c6e32ad87c1 tempest-VolumeDependencyTests-1178729307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207.be7a3fff-4935-4ce1-82ff-e8bd0ece75ad 1G" returned: 0 in 0.851s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c39b4143-8066-441d-89ce-8c6e32ad87c1 tempest-VolumeDependencyTests-1178729307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e28b3bb-39d8-4208-a9f4-dd3763738207 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207.be7a3fff-4935-4ce1-82ff-e8bd0ece75ad {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:24 devstack sudo[101547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:31:24 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:24 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e28b3bb-39d8-4208-a9f4-dd3763738207 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207.be7a3fff-4935-4ce1-82ff-e8bd0ece75ad Jun 02 03:31:24 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:24 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9c9915c8-7504-4c27-ade5-3001627824c2 tempest-TestInstancesWithCinderVolumes-1072920434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.608s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:24 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-9c9915c8-7504-4c27-ade5-3001627824c2 tempest-TestInstancesWithCinderVolumes-1072920434 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:31:24 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-9c9915c8-7504-4c27-ade5-3001627824c2 tempest-TestInstancesWithCinderVolumes-1072920434 None] Deleted volume successfully. Jun 02 03:31:24 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-9c9915c8-7504-4c27-ade5-3001627824c2 tempest-TestInstancesWithCinderVolumes-1072920434 None] Lock "cinder-f25d535b-1ae2-47b0-a4c7-c18036e55a72-delete_volume" released by "delete_volume" :: held 2.970s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:31:24 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c39b4143-8066-441d-89ce-8c6e32ad87c1 tempest-VolumeDependencyTests-1178729307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e28b3bb-39d8-4208-a9f4-dd3763738207 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207.be7a3fff-4935-4ce1-82ff-e8bd0ece75ad" returned: 0 in 0.658s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:24 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-c39b4143-8066-441d-89ce-8c6e32ad87c1 tempest-VolumeDependencyTests-1178729307 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207.be7a3fff-4935-4ce1-82ff-e8bd0ece75ad is being set with open permissions: ugo+rw Jun 02 03:31:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c39b4143-8066-441d-89ce-8c6e32ad87c1 tempest-VolumeDependencyTests-1178729307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207.be7a3fff-4935-4ce1-82ff-e8bd0ece75ad {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:24 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207.be7a3fff-4935-4ce1-82ff-e8bd0ece75ad Jun 02 03:31:24 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:25 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c39b4143-8066-441d-89ce-8c6e32ad87c1 tempest-VolumeDependencyTests-1178729307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207.be7a3fff-4935-4ce1-82ff-e8bd0ece75ad" returned: 0 in 0.623s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:25 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=63,cinder:UPDATE=76,cinder:INSERT=20,cinder:DELETE=5 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:31:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c39b4143-8066-441d-89ce-8c6e32ad87c1 tempest-VolumeDependencyTests-1178729307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:25 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207.info Jun 02 03:31:25 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:26 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c39b4143-8066-441d-89ce-8c6e32ad87c1 tempest-VolumeDependencyTests-1178729307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207.info" returned: 0 in 0.648s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:26 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-c39b4143-8066-441d-89ce-8c6e32ad87c1 tempest-VolumeDependencyTests-1178729307 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207.info is being set with open permissions: ugo+rw Jun 02 03:31:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c39b4143-8066-441d-89ce-8c6e32ad87c1 tempest-VolumeDependencyTests-1178729307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:26 devstack sudo[101598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207.info Jun 02 03:31:26 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:26 devstack sudo[101598]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c39b4143-8066-441d-89ce-8c6e32ad87c1 tempest-VolumeDependencyTests-1178729307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207.info" returned: 0 in 0.626s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c39b4143-8066-441d-89ce-8c6e32ad87c1 tempest-VolumeDependencyTests-1178729307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.268s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:31:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e2068895-e2df-4573-9794-ae78e9fa97f8 tempest-VolumesExtendTest-265044759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.848s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:31:26 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-e2068895-e2df-4573-9794-ae78e9fa97f8 tempest-VolumesExtendTest-265044759 None] Creating offline snapshot 11524f18-e4d7-4453-af3a-3eb0256dd2bc of volume 2a011a12-293c-4d90-89ac-25b199a5db11 {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:31:26 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-c39b4143-8066-441d-89ce-8c6e32ad87c1 tempest-VolumeDependencyTests-1178729307 None] Create snapshot completed successfully Jun 02 03:31:26 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddaca42-75b8-4942-989f-98d9907d801d]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:31:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e2068895-e2df-4573-9794-ae78e9fa97f8 tempest-VolumesExtendTest-265044759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:26 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11 Jun 02 03:31:26 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:27 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=72,cinder:UPDATE=58,cinder:INSERT=21,cinder:DELETE=4 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:31:27 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:31:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Flow 'volume_create_manager' (9c4c9f57-e069-494b-b6c5-f2d741e4636c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:31:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e34caa38-61e2-40b6-9c90-f879fd9093bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e34caa38-61e2-40b6-9c90-f879fd9093bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2137175590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13af1159-5863-409f-b430-ec0d733ded38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b0f280d4f064b40aecbb44114dcc85c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=be7a3fff-4935-4ce1-82ff-e8bd0ece75ad,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:31:27Z,use_quota=True,user_id='09b850c133744f23babb840bde9cef6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4543eb7d-51a2-4a57-96b4-d93cc46cf486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4543eb7d-51a2-4a57-96b4-d93cc46cf486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eace8ca2-7695-4753-929e-1387e46a59c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eace8ca2-7695-4753-929e-1387e46a59c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '13af1159-5863-409f-b430-ec0d733ded38', 'volume_name': 'volume-13af1159-5863-409f-b430-ec0d733ded38', 'volume_size': 1, 'snapshot_id': 'be7a3fff-4935-4ce1-82ff-e8bd0ece75ad'}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9410af72-c0f2-4fc9-9152-24edb0132e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:27 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9410af72-c0f2-4fc9-9152-24edb0132e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8d2af1f-c5b1-4d6c-a57c-f658366cf3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:27 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Volume 13af1159-5863-409f-b430-ec0d733ded38: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-13af1159-5863-409f-b430-ec0d733ded38', 'volume_size': 1, 'snapshot_id': 'be7a3fff-4935-4ce1-82ff-e8bd0ece75ad'} Jun 02 03:31:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e2068895-e2df-4573-9794-ae78e9fa97f8 tempest-VolumesExtendTest-265044759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11" returned: 0 in 0.818s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e2068895-e2df-4573-9794-ae78e9fa97f8 tempest-VolumesExtendTest-265044759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11.11524f18-e4d7-4453-af3a-3eb0256dd2bc 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:31:27 devstack sudo[101607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11.11524f18-e4d7-4453-af3a-3eb0256dd2bc 1G Jun 02 03:31:27 devstack sudo[101607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:28 devstack sudo[101607]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e2068895-e2df-4573-9794-ae78e9fa97f8 tempest-VolumesExtendTest-265044759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11.11524f18-e4d7-4453-af3a-3eb0256dd2bc 1G" returned: 0 in 0.873s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e2068895-e2df-4573-9794-ae78e9fa97f8 tempest-VolumesExtendTest-265044759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a011a12-293c-4d90-89ac-25b199a5db11 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11.11524f18-e4d7-4453-af3a-3eb0256dd2bc {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:28 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a011a12-293c-4d90-89ac-25b199a5db11 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11.11524f18-e4d7-4453-af3a-3eb0256dd2bc Jun 02 03:31:28 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:29 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e2068895-e2df-4573-9794-ae78e9fa97f8 tempest-VolumesExtendTest-265044759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a011a12-293c-4d90-89ac-25b199a5db11 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11.11524f18-e4d7-4453-af3a-3eb0256dd2bc" returned: 0 in 0.724s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:29 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-e2068895-e2df-4573-9794-ae78e9fa97f8 tempest-VolumesExtendTest-265044759 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11.11524f18-e4d7-4453-af3a-3eb0256dd2bc is being set with open permissions: ugo+rw Jun 02 03:31:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e2068895-e2df-4573-9794-ae78e9fa97f8 tempest-VolumesExtendTest-265044759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11.11524f18-e4d7-4453-af3a-3eb0256dd2bc {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:29 devstack sudo[101621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11.11524f18-e4d7-4453-af3a-3eb0256dd2bc Jun 02 03:31:29 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:29 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e2068895-e2df-4573-9794-ae78e9fa97f8 tempest-VolumesExtendTest-265044759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11.11524f18-e4d7-4453-af3a-3eb0256dd2bc" returned: 0 in 0.647s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e2068895-e2df-4573-9794-ae78e9fa97f8 tempest-VolumesExtendTest-265044759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:29 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11.info Jun 02 03:31:29 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:30 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e2068895-e2df-4573-9794-ae78e9fa97f8 tempest-VolumesExtendTest-265044759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11.info" returned: 0 in 0.612s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:30 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-e2068895-e2df-4573-9794-ae78e9fa97f8 tempest-VolumesExtendTest-265044759 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11.info is being set with open permissions: ugo+rw Jun 02 03:31:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e2068895-e2df-4573-9794-ae78e9fa97f8 tempest-VolumesExtendTest-265044759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:30 devstack sudo[101634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11.info Jun 02 03:31:30 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:31 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e2068895-e2df-4573-9794-ae78e9fa97f8 tempest-VolumesExtendTest-265044759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11.info" returned: 0 in 0.604s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e2068895-e2df-4573-9794-ae78e9fa97f8 tempest-VolumesExtendTest-265044759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.386s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:31:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.508s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:31:31 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Acquiring lock "cinder-quobyte-be7a3fff-4935-4ce1-82ff-e8bd0ece75ad-13af1159-5863-409f-b430-ec0d733ded38" by "_create_volume_from_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:31:31 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Lock "cinder-quobyte-be7a3fff-4935-4ce1-82ff-e8bd0ece75ad-13af1159-5863-409f-b430-ec0d733ded38" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:31:31 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Creating volume 13af1159-5863-409f-b430-ec0d733ded38 from snapshot be7a3fff-4935-4ce1-82ff-e8bd0ece75ad {{(pid=86431) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 02 03:31:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:31:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:31:31 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:31:31 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:31:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:31:31 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:31:31 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Acquiring lock "cinder-quobyte-13af1159-5863-409f-b430-ec0d733ded38" by "_copy_volume_from_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:31:31 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-e2068895-e2df-4573-9794-ae78e9fa97f8 tempest-VolumesExtendTest-265044759 None] Create snapshot completed successfully Jun 02 03:31:31 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Lock "cinder-quobyte-13af1159-5863-409f-b430-ec0d733ded38" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:31:31 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] snapshot: be7a3fff-4935-4ce1-82ff-e8bd0ece75ad, volume: 13af1159-5863-409f-b430-ec0d733ded38, {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 03:31:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:31:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:31:31 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:31:31 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:31:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:31:31 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebcaace-1a8d-4b92-bfde-e2b82c51e6ae]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:31:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207.be7a3fff-4935-4ce1-82ff-e8bd0ece75ad {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:31 devstack sudo[101637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207.be7a3fff-4935-4ce1-82ff-e8bd0ece75ad Jun 02 03:31:31 devstack sudo[101637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:32 devstack sudo[101637]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207.be7a3fff-4935-4ce1-82ff-e8bd0ece75ad" returned: 0 in 0.773s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:32 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e28b3bb-39d8-4208-a9f4-dd3763738207(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:31:32 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207 {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 03:31:32 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Creating direct copy from snapshot {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 03:31:32 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f459b61-d724-4ee6-b788-1bb3ea56ed54]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:31:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:32 devstack sudo[101642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207 Jun 02 03:31:32 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d10943ec-d49d-42f6-b908-3419d3fa9808 tempest-VolumesExtendTest-265044759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:31:32 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207" returned: 0 in 0.733s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:32 devstack cinder-volume[86431]: DEBUG cinder.utils [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Path /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-13af1159-5863-409f-b430-ec0d733ded38 not found in is_blk_device check {{(pid=86431) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 02 03:31:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-13af1159-5863-409f-b430-ec0d733ded38 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:32 devstack sudo[101648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-13af1159-5863-409f-b430-ec0d733ded38 Jun 02 03:31:32 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:37 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-13af1159-5863-409f-b430-ec0d733ded38" returned: 0 in 5.153s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:37 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5d4b09-1a23-40c3-b4b4-73a3bda46aaf]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:31:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:38 devstack sudo[101662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207 Jun 02 03:31:38 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:38 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207" returned: 0 in 0.936s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:38 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Image conversion details: src /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207, size 1024.00 MB, duration 5.15 sec, destination /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-13af1159-5863-409f-b430-ec0d733ded38 {{(pid=86431) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 02 03:31:38 devstack cinder-volume[86431]: INFO cinder.image.image_utils [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Converted 1024.00 MB image at 198.68 MB/s Jun 02 03:31:38 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-13af1159-5863-409f-b430-ec0d733ded38 is being set with open permissions: ugo+rw Jun 02 03:31:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-13af1159-5863-409f-b430-ec0d733ded38 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:38 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-13af1159-5863-409f-b430-ec0d733ded38 Jun 02 03:31:38 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:39 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-13af1159-5863-409f-b430-ec0d733ded38" returned: 0 in 0.623s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:39 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Lock "cinder-quobyte-13af1159-5863-409f-b430-ec0d733ded38" released by "_copy_volume_from_snapshot" :: held 8.321s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:31:39 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Lock "cinder-quobyte-be7a3fff-4935-4ce1-82ff-e8bd0ece75ad-13af1159-5863-409f-b430-ec0d733ded38" released by "_create_volume_from_snapshot" :: held 8.363s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:31:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.390s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:31:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d10943ec-d49d-42f6-b908-3419d3fa9808 tempest-VolumesExtendTest-265044759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 7.162s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:31:39 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[941a0d0e-addb-4c06-bb30-a732ffda8e19]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:31:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d10943ec-d49d-42f6-b908-3419d3fa9808 tempest-VolumesExtendTest-265044759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8d2af1f-c5b1-4d6c-a57c-f658366cf3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13af1159-5863-409f-b430-ec0d733ded38', 'volume_size': 1, 'snapshot_id': 'be7a3fff-4935-4ce1-82ff-e8bd0ece75ad'}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0871aed4-7e8e-4073-84c2-f0cc7734a224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:39 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Volume volume-13af1159-5863-409f-b430-ec0d733ded38 (13af1159-5863-409f-b430-ec0d733ded38): created successfully Jun 02 03:31:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0871aed4-7e8e-4073-84c2-f0cc7734a224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:39 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Flow 'volume_create_manager' (9c4c9f57-e069-494b-b6c5-f2d741e4636c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:31:39 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-4e4d7c12-c06e-49d6-9a7c-53bb28d9ba15 tempest-VolumeDependencyTests-1178729307 None] Created volume successfully. Jun 02 03:31:39 devstack sudo[101670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11 Jun 02 03:31:39 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:40 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d10943ec-d49d-42f6-b908-3419d3fa9808 tempest-VolumesExtendTest-265044759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11" returned: 0 in 0.753s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d10943ec-d49d-42f6-b908-3419d3fa9808 tempest-VolumesExtendTest-265044759 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11.11524f18-e4d7-4453-af3a-3eb0256dd2bc 2G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d10943ec-d49d-42f6-b908-3419d3fa9808 tempest-VolumesExtendTest-265044759 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11.11524f18-e4d7-4453-af3a-3eb0256dd2bc 2G" returned: 0 in 0.123s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d10943ec-d49d-42f6-b908-3419d3fa9808 tempest-VolumesExtendTest-265044759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.919s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:31:40 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-d10943ec-d49d-42f6-b908-3419d3fa9808 tempest-VolumesExtendTest-265044759 None] Extend volume completed successfully. Jun 02 03:31:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4015c317-9f70-4d3f-a6fe-367394e0aa4a tempest-VolumeDependencyTests-1178729307 None] Acquiring lock "cinder-be7a3fff-4935-4ce1-82ff-e8bd0ece75ad-delete_snapshot" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:31:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4015c317-9f70-4d3f-a6fe-367394e0aa4a tempest-VolumeDependencyTests-1178729307 None] Lock "cinder-be7a3fff-4935-4ce1-82ff-e8bd0ece75ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:31:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4015c317-9f70-4d3f-a6fe-367394e0aa4a tempest-VolumeDependencyTests-1178729307 None] Acquiring lock "cinder-quobyte-1e28b3bb-39d8-4208-a9f4-dd3763738207" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:31:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4015c317-9f70-4d3f-a6fe-367394e0aa4a tempest-VolumeDependencyTests-1178729307 None] Lock "cinder-quobyte-1e28b3bb-39d8-4208-a9f4-dd3763738207" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:31:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4015c317-9f70-4d3f-a6fe-367394e0aa4a tempest-VolumeDependencyTests-1178729307 None] Acquiring lock "cinder-quobyte-be7a3fff-4935-4ce1-82ff-e8bd0ece75ad" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:31:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4015c317-9f70-4d3f-a6fe-367394e0aa4a tempest-VolumeDependencyTests-1178729307 None] Lock "cinder-quobyte-be7a3fff-4935-4ce1-82ff-e8bd0ece75ad" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:31:40 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-4015c317-9f70-4d3f-a6fe-367394e0aa4a tempest-VolumeDependencyTests-1178729307 None] Deleting offline snapshot be7a3fff-4935-4ce1-82ff-e8bd0ece75ad of volume 1e28b3bb-39d8-4208-a9f4-dd3763738207 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:31:40 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-4015c317-9f70-4d3f-a6fe-367394e0aa4a tempest-VolumeDependencyTests-1178729307 None] snapshot_file for this snap is: volume-1e28b3bb-39d8-4208-a9f4-dd3763738207.be7a3fff-4935-4ce1-82ff-e8bd0ece75ad {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:31:40 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d474f0-90b4-4e36-a988-db1c04feec0b]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:31:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4015c317-9f70-4d3f-a6fe-367394e0aa4a tempest-VolumeDependencyTests-1178729307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207.be7a3fff-4935-4ce1-82ff-e8bd0ece75ad {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:41 devstack sudo[101680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207.be7a3fff-4935-4ce1-82ff-e8bd0ece75ad Jun 02 03:31:41 devstack sudo[101680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:41 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-965f287c-2279-4720-a086-945666174dc5 tempest-VolumesExtendTest-265044759 None] Acquiring lock "cinder-11524f18-e4d7-4453-af3a-3eb0256dd2bc-delete_snapshot" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:31:41 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-965f287c-2279-4720-a086-945666174dc5 tempest-VolumesExtendTest-265044759 None] Lock "cinder-11524f18-e4d7-4453-af3a-3eb0256dd2bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:31:41 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-965f287c-2279-4720-a086-945666174dc5 tempest-VolumesExtendTest-265044759 None] Acquiring lock "cinder-quobyte-2a011a12-293c-4d90-89ac-25b199a5db11" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:31:41 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-965f287c-2279-4720-a086-945666174dc5 tempest-VolumesExtendTest-265044759 None] Lock "cinder-quobyte-2a011a12-293c-4d90-89ac-25b199a5db11" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:31:41 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-965f287c-2279-4720-a086-945666174dc5 tempest-VolumesExtendTest-265044759 None] Acquiring lock "cinder-quobyte-11524f18-e4d7-4453-af3a-3eb0256dd2bc" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:31:41 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-965f287c-2279-4720-a086-945666174dc5 tempest-VolumesExtendTest-265044759 None] Lock "cinder-quobyte-11524f18-e4d7-4453-af3a-3eb0256dd2bc" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:31:41 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-965f287c-2279-4720-a086-945666174dc5 tempest-VolumesExtendTest-265044759 None] Deleting offline snapshot 11524f18-e4d7-4453-af3a-3eb0256dd2bc of volume 2a011a12-293c-4d90-89ac-25b199a5db11 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:31:41 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-965f287c-2279-4720-a086-945666174dc5 tempest-VolumesExtendTest-265044759 None] snapshot_file for this snap is: volume-2a011a12-293c-4d90-89ac-25b199a5db11.11524f18-e4d7-4453-af3a-3eb0256dd2bc {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:31:41 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8382d8-a940-4ce2-a05a-59b63a4613f8]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:31:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-965f287c-2279-4720-a086-945666174dc5 tempest-VolumesExtendTest-265044759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11.11524f18-e4d7-4453-af3a-3eb0256dd2bc {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:41 devstack sudo[101683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11.11524f18-e4d7-4453-af3a-3eb0256dd2bc Jun 02 03:31:41 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:41 devstack sudo[101680]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4015c317-9f70-4d3f-a6fe-367394e0aa4a tempest-VolumeDependencyTests-1178729307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207.be7a3fff-4935-4ce1-82ff-e8bd0ece75ad" returned: 0 in 0.734s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:41 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-4015c317-9f70-4d3f-a6fe-367394e0aa4a tempest-VolumeDependencyTests-1178729307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e28b3bb-39d8-4208-a9f4-dd3763738207(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:31:41 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9491fc-4dd0-488e-a2d7-a04b1c55b409]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:31:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4015c317-9f70-4d3f-a6fe-367394e0aa4a tempest-VolumeDependencyTests-1178729307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:41 devstack sudo[101687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207 Jun 02 03:31:41 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:42 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-965f287c-2279-4720-a086-945666174dc5 tempest-VolumesExtendTest-265044759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11.11524f18-e4d7-4453-af3a-3eb0256dd2bc" returned: 0 in 0.729s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:42 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-965f287c-2279-4720-a086-945666174dc5 tempest-VolumesExtendTest-265044759 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a011a12-293c-4d90-89ac-25b199a5db11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:31:42 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[128779d2-0e14-4b46-909d-a342c3ddcdaf]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:31:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-965f287c-2279-4720-a086-945666174dc5 tempest-VolumesExtendTest-265044759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:42 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4015c317-9f70-4d3f-a6fe-367394e0aa4a tempest-VolumeDependencyTests-1178729307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207" returned: 0 in 0.707s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4015c317-9f70-4d3f-a6fe-367394e0aa4a tempest-VolumeDependencyTests-1178729307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207.be7a3fff-4935-4ce1-82ff-e8bd0ece75ad {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:42 devstack sudo[101695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11 Jun 02 03:31:42 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:42 devstack sudo[101696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207.be7a3fff-4935-4ce1-82ff-e8bd0ece75ad Jun 02 03:31:42 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:43 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4015c317-9f70-4d3f-a6fe-367394e0aa4a tempest-VolumeDependencyTests-1178729307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207.be7a3fff-4935-4ce1-82ff-e8bd0ece75ad" returned: 0 in 0.858s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4015c317-9f70-4d3f-a6fe-367394e0aa4a tempest-VolumeDependencyTests-1178729307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207.be7a3fff-4935-4ce1-82ff-e8bd0ece75ad {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:43 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-965f287c-2279-4720-a086-945666174dc5 tempest-VolumesExtendTest-265044759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11" returned: 0 in 0.989s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-965f287c-2279-4720-a086-945666174dc5 tempest-VolumesExtendTest-265044759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11.11524f18-e4d7-4453-af3a-3eb0256dd2bc {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:43 devstack sudo[101707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207.be7a3fff-4935-4ce1-82ff-e8bd0ece75ad Jun 02 03:31:43 devstack sudo[101707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:43 devstack sudo[101708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11.11524f18-e4d7-4453-af3a-3eb0256dd2bc Jun 02 03:31:43 devstack sudo[101708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:43 devstack sudo[101707]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4015c317-9f70-4d3f-a6fe-367394e0aa4a tempest-VolumeDependencyTests-1178729307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207.be7a3fff-4935-4ce1-82ff-e8bd0ece75ad" returned: 0 in 0.692s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:44 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4015c317-9f70-4d3f-a6fe-367394e0aa4a tempest-VolumeDependencyTests-1178729307 None] Lock "cinder-quobyte-be7a3fff-4935-4ce1-82ff-e8bd0ece75ad" released by "_delete_snapshot" :: held 3.122s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:31:44 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4015c317-9f70-4d3f-a6fe-367394e0aa4a tempest-VolumeDependencyTests-1178729307 None] Lock "cinder-quobyte-1e28b3bb-39d8-4208-a9f4-dd3763738207" released by "delete_snapshot" :: held 3.150s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:31:44 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-4015c317-9f70-4d3f-a6fe-367394e0aa4a tempest-VolumeDependencyTests-1178729307 None] Created reservations ['90477eca-d8f0-4fb3-b929-5b4f2b3e3ebd', 'e410d552-e96f-4e85-8da5-93fdd205a3c6', '740543ee-9d6a-4027-be90-7fd20c91fe4a', '2a3d0068-304e-46b6-bbcd-55f3f63075b8'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:31:44 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-4015c317-9f70-4d3f-a6fe-367394e0aa4a tempest-VolumeDependencyTests-1178729307 None] Delete snapshot completed successfully. Jun 02 03:31:44 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4015c317-9f70-4d3f-a6fe-367394e0aa4a tempest-VolumeDependencyTests-1178729307 None] Lock "cinder-be7a3fff-4935-4ce1-82ff-e8bd0ece75ad-delete_snapshot" released by "delete_snapshot" :: held 3.309s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:31:44 devstack sudo[101708]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-965f287c-2279-4720-a086-945666174dc5 tempest-VolumesExtendTest-265044759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11.11524f18-e4d7-4453-af3a-3eb0256dd2bc" returned: 0 in 0.906s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-965f287c-2279-4720-a086-945666174dc5 tempest-VolumesExtendTest-265044759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11.11524f18-e4d7-4453-af3a-3eb0256dd2bc {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:44 devstack sudo[101716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11.11524f18-e4d7-4453-af3a-3eb0256dd2bc Jun 02 03:31:44 devstack sudo[101716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:44 devstack sudo[101716]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-965f287c-2279-4720-a086-945666174dc5 tempest-VolumesExtendTest-265044759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11.11524f18-e4d7-4453-af3a-3eb0256dd2bc" returned: 0 in 0.596s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:44 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-965f287c-2279-4720-a086-945666174dc5 tempest-VolumesExtendTest-265044759 None] Lock "cinder-quobyte-11524f18-e4d7-4453-af3a-3eb0256dd2bc" released by "_delete_snapshot" :: held 3.340s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:31:44 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-965f287c-2279-4720-a086-945666174dc5 tempest-VolumesExtendTest-265044759 None] Lock "cinder-quobyte-2a011a12-293c-4d90-89ac-25b199a5db11" released by "delete_snapshot" :: held 3.366s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:31:44 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-965f287c-2279-4720-a086-945666174dc5 tempest-VolumesExtendTest-265044759 None] Created reservations ['13ae05ca-19fe-4ad3-8d7c-c979fc4fd60e', '317b5705-2b3e-4849-a3ea-8b957b229046', 'f0b21021-8758-459d-8dd0-9d6ce1189e5c', 'fbac14b6-a149-43d6-8757-77b37b079ec9'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:31:44 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-965f287c-2279-4720-a086-945666174dc5 tempest-VolumesExtendTest-265044759 None] Delete snapshot completed successfully. Jun 02 03:31:44 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-965f287c-2279-4720-a086-945666174dc5 tempest-VolumesExtendTest-265044759 None] Lock "cinder-11524f18-e4d7-4453-af3a-3eb0256dd2bc-delete_snapshot" released by "delete_snapshot" :: held 3.509s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:31:45 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-a9fdde85-430a-4fdc-a1b7-8b8a80231ab9 tempest-VolumeDependencyTests-1178729307 None] Acquiring lock "cinder-1e28b3bb-39d8-4208-a9f4-dd3763738207-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:31:45 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-a9fdde85-430a-4fdc-a1b7-8b8a80231ab9 tempest-VolumeDependencyTests-1178729307 None] Lock "cinder-1e28b3bb-39d8-4208-a9f4-dd3763738207-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:31:45 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-a9fdde85-430a-4fdc-a1b7-8b8a80231ab9 tempest-VolumeDependencyTests-1178729307 None] Acquiring lock "cinder-quobyte-1e28b3bb-39d8-4208-a9f4-dd3763738207" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:31:45 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-a9fdde85-430a-4fdc-a1b7-8b8a80231ab9 tempest-VolumeDependencyTests-1178729307 None] Lock "cinder-quobyte-1e28b3bb-39d8-4208-a9f4-dd3763738207" acquired by "delete_volume" :: waited 0.023s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:31:45 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64ed991-f3ec-4208-b613-46b101b8b198]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:31:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a9fdde85-430a-4fdc-a1b7-8b8a80231ab9 tempest-VolumeDependencyTests-1178729307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:45 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207 Jun 02 03:31:45 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:45 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6db45a16-fa70-4ab6-bccb-4a21653c470d tempest-VolumesExtendTest-265044759 None] Acquiring lock "cinder-2a011a12-293c-4d90-89ac-25b199a5db11-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:31:45 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6db45a16-fa70-4ab6-bccb-4a21653c470d tempest-VolumesExtendTest-265044759 None] Lock "cinder-2a011a12-293c-4d90-89ac-25b199a5db11-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:31:45 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6db45a16-fa70-4ab6-bccb-4a21653c470d tempest-VolumesExtendTest-265044759 None] Acquiring lock "cinder-quobyte-2a011a12-293c-4d90-89ac-25b199a5db11" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:31:45 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6db45a16-fa70-4ab6-bccb-4a21653c470d tempest-VolumesExtendTest-265044759 None] Lock "cinder-quobyte-2a011a12-293c-4d90-89ac-25b199a5db11" acquired by "delete_volume" :: waited 0.017s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:31:45 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[585840a3-8526-4fd0-86af-2f019124e131]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:31:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6db45a16-fa70-4ab6-bccb-4a21653c470d tempest-VolumesExtendTest-265044759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:46 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a9fdde85-430a-4fdc-a1b7-8b8a80231ab9 tempest-VolumeDependencyTests-1178729307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207" returned: 0 in 0.809s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:46 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11 Jun 02 03:31:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a9fdde85-430a-4fdc-a1b7-8b8a80231ab9 tempest-VolumeDependencyTests-1178729307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:46 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:46 devstack sudo[101727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207 Jun 02 03:31:46 devstack sudo[101727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:46 devstack sudo[101727]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a9fdde85-430a-4fdc-a1b7-8b8a80231ab9 tempest-VolumeDependencyTests-1178729307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1e28b3bb-39d8-4208-a9f4-dd3763738207" returned: 0 in 0.656s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:46 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6db45a16-fa70-4ab6-bccb-4a21653c470d tempest-VolumesExtendTest-265044759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11" returned: 0 in 0.795s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6db45a16-fa70-4ab6-bccb-4a21653c470d tempest-VolumesExtendTest-265044759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:46 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-a9fdde85-430a-4fdc-a1b7-8b8a80231ab9 tempest-VolumeDependencyTests-1178729307 None] Lock "cinder-quobyte-1e28b3bb-39d8-4208-a9f4-dd3763738207" released by "delete_volume" :: held 1.544s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:31:46 devstack sudo[101733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11 Jun 02 03:31:46 devstack sudo[101733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:46 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-a9fdde85-430a-4fdc-a1b7-8b8a80231ab9 tempest-VolumeDependencyTests-1178729307 None] Created reservations ['4264bca0-1faa-423b-a701-5b6cb4d73d8d', '417ab7db-4e85-492b-8279-4911e8980c35', 'a7f468b6-688b-4c48-b6fe-bbef1bc5fdb1', '190f3c61-a2d9-4b28-8ce1-87bd919ccf4d'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:31:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a9fdde85-430a-4fdc-a1b7-8b8a80231ab9 tempest-VolumeDependencyTests-1178729307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:31:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a9fdde85-430a-4fdc-a1b7-8b8a80231ab9 tempest-VolumeDependencyTests-1178729307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:31:46 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a9fdde85-430a-4fdc-a1b7-8b8a80231ab9 tempest-VolumeDependencyTests-1178729307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:31:46 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a9fdde85-430a-4fdc-a1b7-8b8a80231ab9 tempest-VolumeDependencyTests-1178729307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:31:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a9fdde85-430a-4fdc-a1b7-8b8a80231ab9 tempest-VolumeDependencyTests-1178729307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:31:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a9fdde85-430a-4fdc-a1b7-8b8a80231ab9 tempest-VolumeDependencyTests-1178729307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:47 devstack sudo[101735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:31:47 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:47 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6d753feb-9108-4763-9d25-aec763d4044f tempest-VolumeDependencyTests-1178729307 None] Acquiring lock "cinder-13af1159-5863-409f-b430-ec0d733ded38-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:31:47 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6d753feb-9108-4763-9d25-aec763d4044f tempest-VolumeDependencyTests-1178729307 None] Lock "cinder-13af1159-5863-409f-b430-ec0d733ded38-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:31:47 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6d753feb-9108-4763-9d25-aec763d4044f tempest-VolumeDependencyTests-1178729307 None] Acquiring lock "cinder-quobyte-13af1159-5863-409f-b430-ec0d733ded38" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:31:47 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6d753feb-9108-4763-9d25-aec763d4044f tempest-VolumeDependencyTests-1178729307 None] Lock "cinder-quobyte-13af1159-5863-409f-b430-ec0d733ded38" acquired by "delete_volume" :: waited 0.025s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:31:47 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a2f2b8-4e22-4f5c-bba4-62e6c1c701d6]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:31:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d753feb-9108-4763-9d25-aec763d4044f tempest-VolumeDependencyTests-1178729307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-13af1159-5863-409f-b430-ec0d733ded38 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:47 devstack sudo[101733]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6db45a16-fa70-4ab6-bccb-4a21653c470d tempest-VolumesExtendTest-265044759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2a011a12-293c-4d90-89ac-25b199a5db11" returned: 0 in 0.913s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:47 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6db45a16-fa70-4ab6-bccb-4a21653c470d tempest-VolumesExtendTest-265044759 None] Lock "cinder-quobyte-2a011a12-293c-4d90-89ac-25b199a5db11" released by "delete_volume" :: held 1.808s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:31:47 devstack sudo[101739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-13af1159-5863-409f-b430-ec0d733ded38 Jun 02 03:31:47 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:47 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-6db45a16-fa70-4ab6-bccb-4a21653c470d tempest-VolumesExtendTest-265044759 None] Created reservations ['eb0d91b6-f6d0-430d-a299-ddb30fd9e011', 'ccc7896f-1782-4dce-bc6f-cd9c683b0ab3', 'eee5411b-7cc1-4eab-aed2-9ebb0f3b9bd0', '117e44f6-65b5-43d5-9080-8655d2c100d1'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:31:47 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a9fdde85-430a-4fdc-a1b7-8b8a80231ab9 tempest-VolumeDependencyTests-1178729307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.933s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:47 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-a9fdde85-430a-4fdc-a1b7-8b8a80231ab9 tempest-VolumeDependencyTests-1178729307 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:31:47 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-a9fdde85-430a-4fdc-a1b7-8b8a80231ab9 tempest-VolumeDependencyTests-1178729307 None] Deleted volume successfully. Jun 02 03:31:47 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-a9fdde85-430a-4fdc-a1b7-8b8a80231ab9 tempest-VolumeDependencyTests-1178729307 None] Lock "cinder-1e28b3bb-39d8-4208-a9f4-dd3763738207-delete_volume" released by "delete_volume" :: held 2.775s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:31:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6db45a16-fa70-4ab6-bccb-4a21653c470d tempest-VolumesExtendTest-265044759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:31:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6db45a16-fa70-4ab6-bccb-4a21653c470d tempest-VolumesExtendTest-265044759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:31:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6db45a16-fa70-4ab6-bccb-4a21653c470d tempest-VolumesExtendTest-265044759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:31:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6db45a16-fa70-4ab6-bccb-4a21653c470d tempest-VolumesExtendTest-265044759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:31:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6db45a16-fa70-4ab6-bccb-4a21653c470d tempest-VolumesExtendTest-265044759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:31:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6db45a16-fa70-4ab6-bccb-4a21653c470d tempest-VolumesExtendTest-265044759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:48 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:31:48 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:48 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d753feb-9108-4763-9d25-aec763d4044f tempest-VolumeDependencyTests-1178729307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-13af1159-5863-409f-b430-ec0d733ded38" returned: 0 in 1.047s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d753feb-9108-4763-9d25-aec763d4044f tempest-VolumeDependencyTests-1178729307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-13af1159-5863-409f-b430-ec0d733ded38 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:48 devstack sudo[101747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-13af1159-5863-409f-b430-ec0d733ded38 Jun 02 03:31:48 devstack sudo[101747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:48 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6db45a16-fa70-4ab6-bccb-4a21653c470d tempest-VolumesExtendTest-265044759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.898s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:48 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-6db45a16-fa70-4ab6-bccb-4a21653c470d tempest-VolumesExtendTest-265044759 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:31:48 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-6db45a16-fa70-4ab6-bccb-4a21653c470d tempest-VolumesExtendTest-265044759 None] Deleted volume successfully. Jun 02 03:31:48 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6db45a16-fa70-4ab6-bccb-4a21653c470d tempest-VolumesExtendTest-265044759 None] Lock "cinder-2a011a12-293c-4d90-89ac-25b199a5db11-delete_volume" released by "delete_volume" :: held 3.100s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:31:49 devstack sudo[101747]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d753feb-9108-4763-9d25-aec763d4044f tempest-VolumeDependencyTests-1178729307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-13af1159-5863-409f-b430-ec0d733ded38" returned: 0 in 0.738s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:49 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6d753feb-9108-4763-9d25-aec763d4044f tempest-VolumeDependencyTests-1178729307 None] Lock "cinder-quobyte-13af1159-5863-409f-b430-ec0d733ded38" released by "delete_volume" :: held 1.869s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:31:49 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-6d753feb-9108-4763-9d25-aec763d4044f tempest-VolumeDependencyTests-1178729307 None] Created reservations ['67cd21f8-1849-4918-b555-f946b1aba525', '39d14a7f-c3b4-4248-b287-828aa3cccd48', 'cdeab551-1c7c-402c-a548-6abd85523993', '54e03b23-4447-43a1-bdc6-57250fade34a'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:31:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6d753feb-9108-4763-9d25-aec763d4044f tempest-VolumeDependencyTests-1178729307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:31:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6d753feb-9108-4763-9d25-aec763d4044f tempest-VolumeDependencyTests-1178729307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:31:49 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6d753feb-9108-4763-9d25-aec763d4044f tempest-VolumeDependencyTests-1178729307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:31:49 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6d753feb-9108-4763-9d25-aec763d4044f tempest-VolumeDependencyTests-1178729307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:31:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6d753feb-9108-4763-9d25-aec763d4044f tempest-VolumeDependencyTests-1178729307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:31:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d753feb-9108-4763-9d25-aec763d4044f tempest-VolumeDependencyTests-1178729307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:49 devstack sudo[101751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:31:49 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:50 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d753feb-9108-4763-9d25-aec763d4044f tempest-VolumeDependencyTests-1178729307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.798s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:50 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-6d753feb-9108-4763-9d25-aec763d4044f tempest-VolumeDependencyTests-1178729307 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:31:50 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-6d753feb-9108-4763-9d25-aec763d4044f tempest-VolumeDependencyTests-1178729307 None] Deleted volume successfully. Jun 02 03:31:50 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6d753feb-9108-4763-9d25-aec763d4044f tempest-VolumeDependencyTests-1178729307 None] Lock "cinder-13af1159-5863-409f-b430-ec0d733ded38-delete_volume" released by "delete_volume" :: held 2.944s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:31:51 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-08d73ef5-8e65-42c8-b839-0d28e35cfae8 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:31:51 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-08d73ef5-8e65-42c8-b839-0d28e35cfae8 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Flow 'volume_create_manager' (3f4efc72-bc1f-469e-9f27-99f4788e4f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:31:51 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-08d73ef5-8e65-42c8-b839-0d28e35cfae8 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c531a89-1ca4-440b-8f5c-7a25ae0967f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:51 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-08d73ef5-8e65-42c8-b839-0d28e35cfae8 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c531a89-1ca4-440b-8f5c-7a25ae0967f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:31:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1532654517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb233c9a-61f8-4bcc-938b-d861d9727f96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec58b09721f94117886acc079adec549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:31:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:31:52Z,use_quota=True,user_id='06283ec4dac34be9a9b159b5a6b639bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:51 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-08d73ef5-8e65-42c8-b839-0d28e35cfae8 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db249c60-6419-4796-aa15-51d79d9cff71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:51 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-08d73ef5-8e65-42c8-b839-0d28e35cfae8 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db249c60-6419-4796-aa15-51d79d9cff71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:51 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-08d73ef5-8e65-42c8-b839-0d28e35cfae8 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b6dfff-5591-4cc7-83ca-f7202271adf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:51 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-08d73ef5-8e65-42c8-b839-0d28e35cfae8 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b6dfff-5591-4cc7-83ca-f7202271adf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb233c9a-61f8-4bcc-938b-d861d9727f96', 'volume_name': 'volume-bb233c9a-61f8-4bcc-938b-d861d9727f96', 'volume_size': 2}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:51 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-08d73ef5-8e65-42c8-b839-0d28e35cfae8 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f76d624-6ce4-4ea1-a054-82598db20f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:51 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-08d73ef5-8e65-42c8-b839-0d28e35cfae8 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f76d624-6ce4-4ea1-a054-82598db20f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:51 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-08d73ef5-8e65-42c8-b839-0d28e35cfae8 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (530120e0-1d5f-4d4d-9dc6-a550afad706a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:51 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-08d73ef5-8e65-42c8-b839-0d28e35cfae8 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Volume bb233c9a-61f8-4bcc-938b-d861d9727f96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb233c9a-61f8-4bcc-938b-d861d9727f96', 'volume_size': 2} Jun 02 03:31:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-08d73ef5-8e65-42c8-b839-0d28e35cfae8 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:31:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-08d73ef5-8e65-42c8-b839-0d28e35cfae8 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:31:51 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-08d73ef5-8e65-42c8-b839-0d28e35cfae8 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:31:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1532654517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb233c9a-61f8-4bcc-938b-d861d9727f96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec58b09721f94117886acc079adec549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:31:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:31:52Z,use_quota=True,user_id='06283ec4dac34be9a9b159b5a6b639bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:31:51 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-08d73ef5-8e65-42c8-b839-0d28e35cfae8 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Creating volume bb233c9a-61f8-4bcc-938b-d861d9727f96 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:31:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-08d73ef5-8e65-42c8-b839-0d28e35cfae8 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:31:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-08d73ef5-8e65-42c8-b839-0d28e35cfae8 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:31:51 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-08d73ef5-8e65-42c8-b839-0d28e35cfae8 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:31:51 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-08d73ef5-8e65-42c8-b839-0d28e35cfae8 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:31:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-08d73ef5-8e65-42c8-b839-0d28e35cfae8 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:31:51 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-08d73ef5-8e65-42c8-b839-0d28e35cfae8 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:31:51 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-08d73ef5-8e65-42c8-b839-0d28e35cfae8 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:31:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-08d73ef5-8e65-42c8-b839-0d28e35cfae8 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96 2147483648 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:52 devstack sudo[101754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96 2147483648 Jun 02 03:31:52 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:52 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-08d73ef5-8e65-42c8-b839-0d28e35cfae8 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96 2147483648" returned: 0 in 0.995s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-08d73ef5-8e65-42c8-b839-0d28e35cfae8 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:53 devstack sudo[101761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96 Jun 02 03:31:53 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:53 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ee02358-bb30-4f79-90dc-e65851467afd tempest-CinderUnicodeTest-1273615205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:31:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1ee02358-bb30-4f79-90dc-e65851467afd tempest-CinderUnicodeTest-1273615205 None] Flow 'volume_create_manager' (a97b52fc-d246-46b0-8bcc-d727de5a46ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:31:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1ee02358-bb30-4f79-90dc-e65851467afd tempest-CinderUnicodeTest-1273615205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6c50027-e79d-4ad9-8e4a-fbbb7d975217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1ee02358-bb30-4f79-90dc-e65851467afd tempest-CinderUnicodeTest-1273615205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6c50027-e79d-4ad9-8e4a-fbbb7d975217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f16ac5a9-3742-43b9-8d4f-69ddb255db7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83d32e93274f4a2689c7fc1703a45250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:31:53Z,use_quota=True,user_id='6c6141d1e7554920b589ab6d2089e2ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1ee02358-bb30-4f79-90dc-e65851467afd tempest-CinderUnicodeTest-1273615205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ab40488-8d27-4cf7-9fe4-e47f8f7e0d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1ee02358-bb30-4f79-90dc-e65851467afd tempest-CinderUnicodeTest-1273615205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ab40488-8d27-4cf7-9fe4-e47f8f7e0d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1ee02358-bb30-4f79-90dc-e65851467afd tempest-CinderUnicodeTest-1273615205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (623a64e0-0cd6-468b-b823-c4c437e9f7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1ee02358-bb30-4f79-90dc-e65851467afd tempest-CinderUnicodeTest-1273615205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (623a64e0-0cd6-468b-b823-c4c437e9f7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f16ac5a9-3742-43b9-8d4f-69ddb255db7b', 'volume_name': 'volume-f16ac5a9-3742-43b9-8d4f-69ddb255db7b', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1ee02358-bb30-4f79-90dc-e65851467afd tempest-CinderUnicodeTest-1273615205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (389f28e1-e73b-410b-be92-e932484664e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1ee02358-bb30-4f79-90dc-e65851467afd tempest-CinderUnicodeTest-1273615205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (389f28e1-e73b-410b-be92-e932484664e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1ee02358-bb30-4f79-90dc-e65851467afd tempest-CinderUnicodeTest-1273615205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd511f42-dbbd-41a9-8597-5d76b9d76e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:53 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-1ee02358-bb30-4f79-90dc-e65851467afd tempest-CinderUnicodeTest-1273615205 None] Volume f16ac5a9-3742-43b9-8d4f-69ddb255db7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f16ac5a9-3742-43b9-8d4f-69ddb255db7b', 'volume_size': 1} Jun 02 03:31:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1ee02358-bb30-4f79-90dc-e65851467afd tempest-CinderUnicodeTest-1273615205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:31:53 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-08d73ef5-8e65-42c8-b839-0d28e35cfae8 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96" returned: 0 in 0.639s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:53 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-08d73ef5-8e65-42c8-b839-0d28e35cfae8 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:31:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-08d73ef5-8e65-42c8-b839-0d28e35cfae8 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:31:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1ee02358-bb30-4f79-90dc-e65851467afd tempest-CinderUnicodeTest-1273615205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.195s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:31:53 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-1ee02358-bb30-4f79-90dc-e65851467afd tempest-CinderUnicodeTest-1273615205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f16ac5a9-3742-43b9-8d4f-69ddb255db7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83d32e93274f4a2689c7fc1703a45250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:31:53Z,use_quota=True,user_id='6c6141d1e7554920b589ab6d2089e2ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:31:53 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-1ee02358-bb30-4f79-90dc-e65851467afd tempest-CinderUnicodeTest-1273615205 None] Creating volume f16ac5a9-3742-43b9-8d4f-69ddb255db7b {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:31:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1ee02358-bb30-4f79-90dc-e65851467afd tempest-CinderUnicodeTest-1273615205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:31:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1ee02358-bb30-4f79-90dc-e65851467afd tempest-CinderUnicodeTest-1273615205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:31:53 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-1ee02358-bb30-4f79-90dc-e65851467afd tempest-CinderUnicodeTest-1273615205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:31:53 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-1ee02358-bb30-4f79-90dc-e65851467afd tempest-CinderUnicodeTest-1273615205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:31:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1ee02358-bb30-4f79-90dc-e65851467afd tempest-CinderUnicodeTest-1273615205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:31:53 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-1ee02358-bb30-4f79-90dc-e65851467afd tempest-CinderUnicodeTest-1273615205 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:31:53 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-1ee02358-bb30-4f79-90dc-e65851467afd tempest-CinderUnicodeTest-1273615205 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:31:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1ee02358-bb30-4f79-90dc-e65851467afd tempest-CinderUnicodeTest-1273615205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f16ac5a9-3742-43b9-8d4f-69ddb255db7b 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-08d73ef5-8e65-42c8-b839-0d28e35cfae8 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (530120e0-1d5f-4d4d-9dc6-a550afad706a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb233c9a-61f8-4bcc-938b-d861d9727f96', 'volume_size': 2}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:53 devstack sudo[101764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f16ac5a9-3742-43b9-8d4f-69ddb255db7b 1073741824 Jun 02 03:31:53 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-08d73ef5-8e65-42c8-b839-0d28e35cfae8 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a19f2ba0-247e-46e8-bdf5-abe2cd436bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:53 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-08d73ef5-8e65-42c8-b839-0d28e35cfae8 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Volume volume-bb233c9a-61f8-4bcc-938b-d861d9727f96 (bb233c9a-61f8-4bcc-938b-d861d9727f96): created successfully Jun 02 03:31:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-08d73ef5-8e65-42c8-b839-0d28e35cfae8 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a19f2ba0-247e-46e8-bdf5-abe2cd436bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:53 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-08d73ef5-8e65-42c8-b839-0d28e35cfae8 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Flow 'volume_create_manager' (3f4efc72-bc1f-469e-9f27-99f4788e4f41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:31:53 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-08d73ef5-8e65-42c8-b839-0d28e35cfae8 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Created volume successfully. Jun 02 03:31:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-44af9053-5cf0-4ad4-b64e-c032226a2fe6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:31:54 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1ee02358-bb30-4f79-90dc-e65851467afd tempest-CinderUnicodeTest-1273615205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f16ac5a9-3742-43b9-8d4f-69ddb255db7b 1073741824" returned: 0 in 0.917s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1ee02358-bb30-4f79-90dc-e65851467afd tempest-CinderUnicodeTest-1273615205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f16ac5a9-3742-43b9-8d4f-69ddb255db7b {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:54 devstack sudo[101770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f16ac5a9-3742-43b9-8d4f-69ddb255db7b Jun 02 03:31:54 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:55 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1ee02358-bb30-4f79-90dc-e65851467afd tempest-CinderUnicodeTest-1273615205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f16ac5a9-3742-43b9-8d4f-69ddb255db7b" returned: 0 in 0.628s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:55 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-1ee02358-bb30-4f79-90dc-e65851467afd tempest-CinderUnicodeTest-1273615205 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:31:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1ee02358-bb30-4f79-90dc-e65851467afd tempest-CinderUnicodeTest-1273615205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:31:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-44af9053-5cf0-4ad4-b64e-c032226a2fe6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.983s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:31:55 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1ee02358-bb30-4f79-90dc-e65851467afd tempest-CinderUnicodeTest-1273615205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd511f42-dbbd-41a9-8597-5d76b9d76e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f16ac5a9-3742-43b9-8d4f-69ddb255db7b', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:55 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1ee02358-bb30-4f79-90dc-e65851467afd tempest-CinderUnicodeTest-1273615205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9fed385-d459-4ed3-8864-a58c346a7cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:55 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-44af9053-5cf0-4ad4-b64e-c032226a2fe6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Creating offline snapshot 8be12cc4-ffcc-4a78-a328-19dd4240920a of volume bb233c9a-61f8-4bcc-938b-d861d9727f96 {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:31:55 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-1ee02358-bb30-4f79-90dc-e65851467afd tempest-CinderUnicodeTest-1273615205 None] Volume volume-f16ac5a9-3742-43b9-8d4f-69ddb255db7b (f16ac5a9-3742-43b9-8d4f-69ddb255db7b): created successfully Jun 02 03:31:55 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1ee02358-bb30-4f79-90dc-e65851467afd tempest-CinderUnicodeTest-1273615205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9fed385-d459-4ed3-8864-a58c346a7cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:55 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1ee02358-bb30-4f79-90dc-e65851467afd tempest-CinderUnicodeTest-1273615205 None] Flow 'volume_create_manager' (a97b52fc-d246-46b0-8bcc-d727de5a46ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:31:55 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[7500f7a8-23f8-4816-8dc6-6e48eb515a19]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:31:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-44af9053-5cf0-4ad4-b64e-c032226a2fe6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:55 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-1ee02358-bb30-4f79-90dc-e65851467afd tempest-CinderUnicodeTest-1273615205 None] Created volume successfully. Jun 02 03:31:55 devstack sudo[101773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96 Jun 02 03:31:55 devstack sudo[101773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:56 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-06dcca35-e78d-4bd8-8ac0-b052cb6ec1df tempest-CinderUnicodeTest-1273615205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:31:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-06dcca35-e78d-4bd8-8ac0-b052cb6ec1df tempest-CinderUnicodeTest-1273615205 None] Flow 'volume_create_manager' (f6efce76-4a5e-4415-98cd-b0be3db5037d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:31:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-06dcca35-e78d-4bd8-8ac0-b052cb6ec1df tempest-CinderUnicodeTest-1273615205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd994e4-b1ed-42e3-9026-efcdb225d3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-06dcca35-e78d-4bd8-8ac0-b052cb6ec1df tempest-CinderUnicodeTest-1273615205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd994e4-b1ed-42e3-9026-efcdb225d3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:31:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-283008181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=468d1da2-6e08-4e0b-a409-4dd0551dd8e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83d32e93274f4a2689c7fc1703a45250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:31:56Z,use_quota=True,user_id='6c6141d1e7554920b589ab6d2089e2ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-06dcca35-e78d-4bd8-8ac0-b052cb6ec1df tempest-CinderUnicodeTest-1273615205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1f4586-91f9-4931-8288-599c757f7a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-06dcca35-e78d-4bd8-8ac0-b052cb6ec1df tempest-CinderUnicodeTest-1273615205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1f4586-91f9-4931-8288-599c757f7a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-06dcca35-e78d-4bd8-8ac0-b052cb6ec1df tempest-CinderUnicodeTest-1273615205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (483dffd0-2269-4eaf-81ce-a7831b2f310e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-06dcca35-e78d-4bd8-8ac0-b052cb6ec1df tempest-CinderUnicodeTest-1273615205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (483dffd0-2269-4eaf-81ce-a7831b2f310e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '468d1da2-6e08-4e0b-a409-4dd0551dd8e2', 'volume_name': 'volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:56 devstack sudo[101773]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-06dcca35-e78d-4bd8-8ac0-b052cb6ec1df tempest-CinderUnicodeTest-1273615205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c215c5e5-c5c5-4122-b141-211d0c9058a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-06dcca35-e78d-4bd8-8ac0-b052cb6ec1df tempest-CinderUnicodeTest-1273615205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c215c5e5-c5c5-4122-b141-211d0c9058a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:31:56 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-06dcca35-e78d-4bd8-8ac0-b052cb6ec1df tempest-CinderUnicodeTest-1273615205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a96acf2-04dc-4e79-b2ca-8d97b49bcc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:31:56 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-06dcca35-e78d-4bd8-8ac0-b052cb6ec1df tempest-CinderUnicodeTest-1273615205 None] Volume 468d1da2-6e08-4e0b-a409-4dd0551dd8e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2', 'volume_size': 1} Jun 02 03:31:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-06dcca35-e78d-4bd8-8ac0-b052cb6ec1df tempest-CinderUnicodeTest-1273615205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:31:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-44af9053-5cf0-4ad4-b64e-c032226a2fe6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96" returned: 0 in 1.007s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-44af9053-5cf0-4ad4-b64e-c032226a2fe6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96.8be12cc4-ffcc-4a78-a328-19dd4240920a 2G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:56 devstack sudo[101779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96.8be12cc4-ffcc-4a78-a328-19dd4240920a 2G Jun 02 03:31:56 devstack sudo[101779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:57 devstack sudo[101779]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-44af9053-5cf0-4ad4-b64e-c032226a2fe6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96.8be12cc4-ffcc-4a78-a328-19dd4240920a 2G" returned: 0 in 0.878s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-44af9053-5cf0-4ad4-b64e-c032226a2fe6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb233c9a-61f8-4bcc-938b-d861d9727f96 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96.8be12cc4-ffcc-4a78-a328-19dd4240920a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:57 devstack sudo[101785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb233c9a-61f8-4bcc-938b-d861d9727f96 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96.8be12cc4-ffcc-4a78-a328-19dd4240920a Jun 02 03:31:57 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:57 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-44af9053-5cf0-4ad4-b64e-c032226a2fe6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb233c9a-61f8-4bcc-938b-d861d9727f96 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96.8be12cc4-ffcc-4a78-a328-19dd4240920a" returned: 0 in 0.700s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:57 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-44af9053-5cf0-4ad4-b64e-c032226a2fe6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96.8be12cc4-ffcc-4a78-a328-19dd4240920a is being set with open permissions: ugo+rw Jun 02 03:31:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-44af9053-5cf0-4ad4-b64e-c032226a2fe6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96.8be12cc4-ffcc-4a78-a328-19dd4240920a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:57 devstack sudo[101790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96.8be12cc4-ffcc-4a78-a328-19dd4240920a Jun 02 03:31:57 devstack sudo[101790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:58 devstack sudo[101790]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-44af9053-5cf0-4ad4-b64e-c032226a2fe6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96.8be12cc4-ffcc-4a78-a328-19dd4240920a" returned: 0 in 0.662s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-44af9053-5cf0-4ad4-b64e-c032226a2fe6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:58 devstack sudo[101793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96.info Jun 02 03:31:58 devstack sudo[101793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:59 devstack sudo[101793]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-44af9053-5cf0-4ad4-b64e-c032226a2fe6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96.info" returned: 0 in 0.670s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:59 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-44af9053-5cf0-4ad4-b64e-c032226a2fe6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96.info is being set with open permissions: ugo+rw Jun 02 03:31:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-44af9053-5cf0-4ad4-b64e-c032226a2fe6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:31:59 devstack sudo[101796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96.info Jun 02 03:31:59 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:31:59 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root Jun 02 03:31:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-44af9053-5cf0-4ad4-b64e-c032226a2fe6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96.info" returned: 0 in 0.670s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:31:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-44af9053-5cf0-4ad4-b64e-c032226a2fe6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.730s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:32:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-06dcca35-e78d-4bd8-8ac0-b052cb6ec1df tempest-CinderUnicodeTest-1273615205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.660s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:32:00 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-06dcca35-e78d-4bd8-8ac0-b052cb6ec1df tempest-CinderUnicodeTest-1273615205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:31:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-283008181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=468d1da2-6e08-4e0b-a409-4dd0551dd8e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83d32e93274f4a2689c7fc1703a45250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:31:56Z,use_quota=True,user_id='6c6141d1e7554920b589ab6d2089e2ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:32:00 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-06dcca35-e78d-4bd8-8ac0-b052cb6ec1df tempest-CinderUnicodeTest-1273615205 None] Creating volume 468d1da2-6e08-4e0b-a409-4dd0551dd8e2 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:32:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-06dcca35-e78d-4bd8-8ac0-b052cb6ec1df tempest-CinderUnicodeTest-1273615205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:32:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-06dcca35-e78d-4bd8-8ac0-b052cb6ec1df tempest-CinderUnicodeTest-1273615205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:32:00 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-06dcca35-e78d-4bd8-8ac0-b052cb6ec1df tempest-CinderUnicodeTest-1273615205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:32:00 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-06dcca35-e78d-4bd8-8ac0-b052cb6ec1df tempest-CinderUnicodeTest-1273615205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:32:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-06dcca35-e78d-4bd8-8ac0-b052cb6ec1df tempest-CinderUnicodeTest-1273615205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:32:00 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-06dcca35-e78d-4bd8-8ac0-b052cb6ec1df tempest-CinderUnicodeTest-1273615205 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:32:00 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-06dcca35-e78d-4bd8-8ac0-b052cb6ec1df tempest-CinderUnicodeTest-1273615205 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:32:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-06dcca35-e78d-4bd8-8ac0-b052cb6ec1df tempest-CinderUnicodeTest-1273615205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:00 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2 1073741824 Jun 02 03:32:00 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:32:00 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-44af9053-5cf0-4ad4-b64e-c032226a2fe6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Create snapshot completed successfully Jun 02 03:32:00 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-78c35787-4081-42c6-ab41-078303508551 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Acquiring lock "cinder-8be12cc4-ffcc-4a78-a328-19dd4240920a-delete_snapshot" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:32:00 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-78c35787-4081-42c6-ab41-078303508551 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Lock "cinder-8be12cc4-ffcc-4a78-a328-19dd4240920a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:32:00 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-78c35787-4081-42c6-ab41-078303508551 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Acquiring lock "cinder-quobyte-bb233c9a-61f8-4bcc-938b-d861d9727f96" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:32:00 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-78c35787-4081-42c6-ab41-078303508551 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Lock "cinder-quobyte-bb233c9a-61f8-4bcc-938b-d861d9727f96" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:32:00 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-78c35787-4081-42c6-ab41-078303508551 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Acquiring lock "cinder-quobyte-8be12cc4-ffcc-4a78-a328-19dd4240920a" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:32:00 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-78c35787-4081-42c6-ab41-078303508551 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Lock "cinder-quobyte-8be12cc4-ffcc-4a78-a328-19dd4240920a" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:32:00 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-78c35787-4081-42c6-ab41-078303508551 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Deleting offline snapshot 8be12cc4-ffcc-4a78-a328-19dd4240920a of volume bb233c9a-61f8-4bcc-938b-d861d9727f96 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:32:00 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-78c35787-4081-42c6-ab41-078303508551 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] snapshot_file for this snap is: volume-bb233c9a-61f8-4bcc-938b-d861d9727f96.8be12cc4-ffcc-4a78-a328-19dd4240920a {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:32:00 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fda054e-064b-4d5e-adf1-f4b63b2de948]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:32:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-78c35787-4081-42c6-ab41-078303508551 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96.8be12cc4-ffcc-4a78-a328-19dd4240920a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:00 devstack sudo[101805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96.8be12cc4-ffcc-4a78-a328-19dd4240920a Jun 02 03:32:00 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:32:00 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Jun 02 03:32:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-06dcca35-e78d-4bd8-8ac0-b052cb6ec1df tempest-CinderUnicodeTest-1273615205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2 1073741824" returned: 0 in 0.934s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:32:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-06dcca35-e78d-4bd8-8ac0-b052cb6ec1df tempest-CinderUnicodeTest-1273615205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:01 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2 Jun 02 03:32:01 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:32:01 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aeb91e5-8575-4ee6-bed4-e568ad52f895 tempest-TestStampPattern-785899133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:32:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9aeb91e5-8575-4ee6-bed4-e568ad52f895 tempest-TestStampPattern-785899133 None] Flow 'volume_create_manager' (b333ceb1-332e-4ceb-be93-2d37d2c29e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:32:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9aeb91e5-8575-4ee6-bed4-e568ad52f895 tempest-TestStampPattern-785899133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca2512e-db39-42b9-87c2-219c17345f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:32:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9aeb91e5-8575-4ee6-bed4-e568ad52f895 tempest-TestStampPattern-785899133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca2512e-db39-42b9-87c2-219c17345f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1606250167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aae93d99-49d6-4814-84d1-43c086aff423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173698ba3a2849c1b9a2bd151a8779ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:32:01Z,use_quota=True,user_id='c2437528c3b7468286b899f14d99d031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:32:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9aeb91e5-8575-4ee6-bed4-e568ad52f895 tempest-TestStampPattern-785899133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d20a05-c1d7-4d1c-8a99-e028bb528c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:32:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9aeb91e5-8575-4ee6-bed4-e568ad52f895 tempest-TestStampPattern-785899133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d20a05-c1d7-4d1c-8a99-e028bb528c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:32:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9aeb91e5-8575-4ee6-bed4-e568ad52f895 tempest-TestStampPattern-785899133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc1a4df-3774-48a2-8f89-0de4d9d2035a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:32:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9aeb91e5-8575-4ee6-bed4-e568ad52f895 tempest-TestStampPattern-785899133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc1a4df-3774-48a2-8f89-0de4d9d2035a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aae93d99-49d6-4814-84d1-43c086aff423', 'volume_name': 'volume-aae93d99-49d6-4814-84d1-43c086aff423', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:32:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9aeb91e5-8575-4ee6-bed4-e568ad52f895 tempest-TestStampPattern-785899133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dade864b-485f-482d-9832-a5358e103fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:32:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9aeb91e5-8575-4ee6-bed4-e568ad52f895 tempest-TestStampPattern-785899133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dade864b-485f-482d-9832-a5358e103fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:32:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9aeb91e5-8575-4ee6-bed4-e568ad52f895 tempest-TestStampPattern-785899133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5afcadcb-4f60-4a9f-b9a0-cee9db86630a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:32:01 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-9aeb91e5-8575-4ee6-bed4-e568ad52f895 tempest-TestStampPattern-785899133 None] Volume aae93d99-49d6-4814-84d1-43c086aff423: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aae93d99-49d6-4814-84d1-43c086aff423', 'volume_size': 1} Jun 02 03:32:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9aeb91e5-8575-4ee6-bed4-e568ad52f895 tempest-TestStampPattern-785899133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:32:01 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root Jun 02 03:32:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-78c35787-4081-42c6-ab41-078303508551 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96.8be12cc4-ffcc-4a78-a328-19dd4240920a" returned: 0 in 0.785s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:32:01 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-78c35787-4081-42c6-ab41-078303508551 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb233c9a-61f8-4bcc-938b-d861d9727f96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:32:01 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c73b0b9-1763-4a2b-97bd-96b0d7beae31]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:32:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-78c35787-4081-42c6-ab41-078303508551 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:01 devstack sudo[101812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96 Jun 02 03:32:01 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:32:01 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Jun 02 03:32:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-06dcca35-e78d-4bd8-8ac0-b052cb6ec1df tempest-CinderUnicodeTest-1273615205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2" returned: 0 in 0.794s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:32:01 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-06dcca35-e78d-4bd8-8ac0-b052cb6ec1df tempest-CinderUnicodeTest-1273615205 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:32:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-06dcca35-e78d-4bd8-8ac0-b052cb6ec1df tempest-CinderUnicodeTest-1273615205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:32:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9aeb91e5-8575-4ee6-bed4-e568ad52f895 tempest-TestStampPattern-785899133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.307s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:32:01 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9aeb91e5-8575-4ee6-bed4-e568ad52f895 tempest-TestStampPattern-785899133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1606250167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aae93d99-49d6-4814-84d1-43c086aff423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173698ba3a2849c1b9a2bd151a8779ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:32:01Z,use_quota=True,user_id='c2437528c3b7468286b899f14d99d031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:32:01 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-9aeb91e5-8575-4ee6-bed4-e568ad52f895 tempest-TestStampPattern-785899133 None] Creating volume aae93d99-49d6-4814-84d1-43c086aff423 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:32:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9aeb91e5-8575-4ee6-bed4-e568ad52f895 tempest-TestStampPattern-785899133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:32:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9aeb91e5-8575-4ee6-bed4-e568ad52f895 tempest-TestStampPattern-785899133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:32:01 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9aeb91e5-8575-4ee6-bed4-e568ad52f895 tempest-TestStampPattern-785899133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:32:01 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9aeb91e5-8575-4ee6-bed4-e568ad52f895 tempest-TestStampPattern-785899133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:32:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9aeb91e5-8575-4ee6-bed4-e568ad52f895 tempest-TestStampPattern-785899133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:32:01 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9aeb91e5-8575-4ee6-bed4-e568ad52f895 tempest-TestStampPattern-785899133 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:32:01 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-9aeb91e5-8575-4ee6-bed4-e568ad52f895 tempest-TestStampPattern-785899133 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:32:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9aeb91e5-8575-4ee6-bed4-e568ad52f895 tempest-TestStampPattern-785899133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:01 devstack sudo[101815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423 1073741824 Jun 02 03:32:01 devstack sudo[101815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:32:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-06dcca35-e78d-4bd8-8ac0-b052cb6ec1df tempest-CinderUnicodeTest-1273615205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a96acf2-04dc-4e79-b2ca-8d97b49bcc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:32:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-06dcca35-e78d-4bd8-8ac0-b052cb6ec1df tempest-CinderUnicodeTest-1273615205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff329639-d24e-44c1-bfb2-2e6e100f45dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:32:01 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-06dcca35-e78d-4bd8-8ac0-b052cb6ec1df tempest-CinderUnicodeTest-1273615205 None] Volume volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2 (468d1da2-6e08-4e0b-a409-4dd0551dd8e2): created successfully Jun 02 03:32:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-06dcca35-e78d-4bd8-8ac0-b052cb6ec1df tempest-CinderUnicodeTest-1273615205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff329639-d24e-44c1-bfb2-2e6e100f45dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:32:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-06dcca35-e78d-4bd8-8ac0-b052cb6ec1df tempest-CinderUnicodeTest-1273615205 None] Flow 'volume_create_manager' (f6efce76-4a5e-4415-98cd-b0be3db5037d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:32:01 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-06dcca35-e78d-4bd8-8ac0-b052cb6ec1df tempest-CinderUnicodeTest-1273615205 None] Created volume successfully. Jun 02 03:32:02 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root Jun 02 03:32:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-78c35787-4081-42c6-ab41-078303508551 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96" returned: 0 in 0.796s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:32:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-78c35787-4081-42c6-ab41-078303508551 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96.8be12cc4-ffcc-4a78-a328-19dd4240920a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:02 devstack sudo[101824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96.8be12cc4-ffcc-4a78-a328-19dd4240920a Jun 02 03:32:02 devstack sudo[101824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:32:02 devstack sudo[101815]: pam_unix(sudo:session): session closed for user root Jun 02 03:32:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9aeb91e5-8575-4ee6-bed4-e568ad52f895 tempest-TestStampPattern-785899133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423 1073741824" returned: 0 in 0.930s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:32:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9aeb91e5-8575-4ee6-bed4-e568ad52f895 tempest-TestStampPattern-785899133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:02 devstack sudo[101829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423 Jun 02 03:32:02 devstack sudo[101829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:32:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2b1ba5a7-c157-4a16-9f54-e679b84ba491 tempest-CinderUnicodeTest-1273615205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:32:03 devstack sudo[101824]: pam_unix(sudo:session): session closed for user root Jun 02 03:32:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-78c35787-4081-42c6-ab41-078303508551 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96.8be12cc4-ffcc-4a78-a328-19dd4240920a" returned: 0 in 0.814s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:32:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-78c35787-4081-42c6-ab41-078303508551 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96.8be12cc4-ffcc-4a78-a328-19dd4240920a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:03 devstack sudo[101836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96.8be12cc4-ffcc-4a78-a328-19dd4240920a Jun 02 03:32:03 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:32:03 devstack sudo[101829]: pam_unix(sudo:session): session closed for user root Jun 02 03:32:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9aeb91e5-8575-4ee6-bed4-e568ad52f895 tempest-TestStampPattern-785899133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423" returned: 0 in 0.688s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:32:03 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9aeb91e5-8575-4ee6-bed4-e568ad52f895 tempest-TestStampPattern-785899133 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:32:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9aeb91e5-8575-4ee6-bed4-e568ad52f895 tempest-TestStampPattern-785899133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:32:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2b1ba5a7-c157-4a16-9f54-e679b84ba491 tempest-CinderUnicodeTest-1273615205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.439s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:32:03 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9aeb91e5-8575-4ee6-bed4-e568ad52f895 tempest-TestStampPattern-785899133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5afcadcb-4f60-4a9f-b9a0-cee9db86630a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aae93d99-49d6-4814-84d1-43c086aff423', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:32:03 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9aeb91e5-8575-4ee6-bed4-e568ad52f895 tempest-TestStampPattern-785899133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95058a06-85ea-435b-84d6-31cc3a269795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:32:03 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-2b1ba5a7-c157-4a16-9f54-e679b84ba491 tempest-CinderUnicodeTest-1273615205 None] Creating offline snapshot 3d5a701f-9f03-4cc1-a0d7-26783274cc78 of volume 468d1da2-6e08-4e0b-a409-4dd0551dd8e2 {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:32:03 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-9aeb91e5-8575-4ee6-bed4-e568ad52f895 tempest-TestStampPattern-785899133 None] Volume volume-aae93d99-49d6-4814-84d1-43c086aff423 (aae93d99-49d6-4814-84d1-43c086aff423): created successfully Jun 02 03:32:03 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9aeb91e5-8575-4ee6-bed4-e568ad52f895 tempest-TestStampPattern-785899133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95058a06-85ea-435b-84d6-31cc3a269795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:32:03 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9aeb91e5-8575-4ee6-bed4-e568ad52f895 tempest-TestStampPattern-785899133 None] Flow 'volume_create_manager' (b333ceb1-332e-4ceb-be93-2d37d2c29e53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:32:03 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[c981351c-0fde-47d3-beac-57e630d89afd]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:32:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2b1ba5a7-c157-4a16-9f54-e679b84ba491 tempest-CinderUnicodeTest-1273615205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:03 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-9aeb91e5-8575-4ee6-bed4-e568ad52f895 tempest-TestStampPattern-785899133 None] Created volume successfully. Jun 02 03:32:03 devstack sudo[101839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2 Jun 02 03:32:03 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:32:03 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root Jun 02 03:32:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-78c35787-4081-42c6-ab41-078303508551 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96.8be12cc4-ffcc-4a78-a328-19dd4240920a" returned: 0 in 0.647s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:32:03 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-78c35787-4081-42c6-ab41-078303508551 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Lock "cinder-quobyte-8be12cc4-ffcc-4a78-a328-19dd4240920a" released by "_delete_snapshot" :: held 3.156s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:32:03 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-78c35787-4081-42c6-ab41-078303508551 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Lock "cinder-quobyte-bb233c9a-61f8-4bcc-938b-d861d9727f96" released by "delete_snapshot" :: held 3.193s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:32:03 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-78c35787-4081-42c6-ab41-078303508551 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Created reservations ['2b2f1632-e18d-494a-aff4-623d2ea778f5', '30e0b8a1-6a26-4590-950c-500ce70ff5b4', '3a834dbf-3749-4143-a3f2-75cdc8116788', 'd6dd960b-1c67-4280-a9e8-1fc9bcda1858'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:32:04 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-78c35787-4081-42c6-ab41-078303508551 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Delete snapshot completed successfully. Jun 02 03:32:04 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-78c35787-4081-42c6-ab41-078303508551 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Lock "cinder-8be12cc4-ffcc-4a78-a328-19dd4240920a-delete_snapshot" released by "delete_snapshot" :: held 3.335s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:32:04 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root Jun 02 03:32:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2b1ba5a7-c157-4a16-9f54-e679b84ba491 tempest-CinderUnicodeTest-1273615205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2" returned: 0 in 0.778s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:32:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2b1ba5a7-c157-4a16-9f54-e679b84ba491 tempest-CinderUnicodeTest-1273615205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2.3d5a701f-9f03-4cc1-a0d7-26783274cc78 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:04 devstack sudo[101846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2.3d5a701f-9f03-4cc1-a0d7-26783274cc78 1G Jun 02 03:32:04 devstack sudo[101846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:32:05 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ac5eb940-f568-4d2b-bfed-a0d45d4a9fa6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Acquiring lock "cinder-bb233c9a-61f8-4bcc-938b-d861d9727f96-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:32:05 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ac5eb940-f568-4d2b-bfed-a0d45d4a9fa6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Lock "cinder-bb233c9a-61f8-4bcc-938b-d861d9727f96-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:32:05 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ac5eb940-f568-4d2b-bfed-a0d45d4a9fa6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Acquiring lock "cinder-quobyte-bb233c9a-61f8-4bcc-938b-d861d9727f96" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:32:05 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ac5eb940-f568-4d2b-bfed-a0d45d4a9fa6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Lock "cinder-quobyte-bb233c9a-61f8-4bcc-938b-d861d9727f96" acquired by "delete_volume" :: waited 0.014s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:32:05 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[06699ae2-b065-4fdb-9d58-cd5c905815a5]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:32:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ac5eb940-f568-4d2b-bfed-a0d45d4a9fa6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:05 devstack sudo[101846]: pam_unix(sudo:session): session closed for user root Jun 02 03:32:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2b1ba5a7-c157-4a16-9f54-e679b84ba491 tempest-CinderUnicodeTest-1273615205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2.3d5a701f-9f03-4cc1-a0d7-26783274cc78 1G" returned: 0 in 0.851s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:32:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2b1ba5a7-c157-4a16-9f54-e679b84ba491 tempest-CinderUnicodeTest-1273615205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2.3d5a701f-9f03-4cc1-a0d7-26783274cc78 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:05 devstack sudo[101852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2.3d5a701f-9f03-4cc1-a0d7-26783274cc78 Jun 02 03:32:05 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:32:05 devstack sudo[101851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96 Jun 02 03:32:05 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:32:05 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root Jun 02 03:32:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2b1ba5a7-c157-4a16-9f54-e679b84ba491 tempest-CinderUnicodeTest-1273615205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2.3d5a701f-9f03-4cc1-a0d7-26783274cc78" returned: 0 in 0.657s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:32:05 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-2b1ba5a7-c157-4a16-9f54-e679b84ba491 tempest-CinderUnicodeTest-1273615205 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2.3d5a701f-9f03-4cc1-a0d7-26783274cc78 is being set with open permissions: ugo+rw Jun 02 03:32:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2b1ba5a7-c157-4a16-9f54-e679b84ba491 tempest-CinderUnicodeTest-1273615205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2.3d5a701f-9f03-4cc1-a0d7-26783274cc78 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:05 devstack sudo[101861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2.3d5a701f-9f03-4cc1-a0d7-26783274cc78 Jun 02 03:32:05 devstack sudo[101861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:32:05 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root Jun 02 03:32:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ac5eb940-f568-4d2b-bfed-a0d45d4a9fa6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96" returned: 0 in 0.717s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:32:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ac5eb940-f568-4d2b-bfed-a0d45d4a9fa6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:05 devstack sudo[101863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96 Jun 02 03:32:05 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:32:06 devstack sudo[101861]: pam_unix(sudo:session): session closed for user root Jun 02 03:32:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2b1ba5a7-c157-4a16-9f54-e679b84ba491 tempest-CinderUnicodeTest-1273615205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2.3d5a701f-9f03-4cc1-a0d7-26783274cc78" returned: 0 in 0.598s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:32:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2b1ba5a7-c157-4a16-9f54-e679b84ba491 tempest-CinderUnicodeTest-1273615205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:06 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root Jun 02 03:32:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ac5eb940-f568-4d2b-bfed-a0d45d4a9fa6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bb233c9a-61f8-4bcc-938b-d861d9727f96" returned: 0 in 0.606s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:32:06 devstack sudo[101867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2.info Jun 02 03:32:06 devstack sudo[101867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:32:06 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ac5eb940-f568-4d2b-bfed-a0d45d4a9fa6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Lock "cinder-quobyte-bb233c9a-61f8-4bcc-938b-d861d9727f96" released by "delete_volume" :: held 1.398s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:32:06 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-ac5eb940-f568-4d2b-bfed-a0d45d4a9fa6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Created reservations ['c3772ef9-7bf2-4df6-b6e3-dfaf6f838915', '57498b7d-14d8-4f2a-9aaa-5e55b77a0227', 'cdfe8806-0600-4d03-8eb1-0b90cf0cf147', 'a31cab87-80fa-4cbb-9e97-41f697445c64'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:32:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ac5eb940-f568-4d2b-bfed-a0d45d4a9fa6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:32:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ac5eb940-f568-4d2b-bfed-a0d45d4a9fa6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:32:06 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ac5eb940-f568-4d2b-bfed-a0d45d4a9fa6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:32:06 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ac5eb940-f568-4d2b-bfed-a0d45d4a9fa6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:32:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ac5eb940-f568-4d2b-bfed-a0d45d4a9fa6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:32:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ac5eb940-f568-4d2b-bfed-a0d45d4a9fa6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:06 devstack sudo[101869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:32:06 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:32:07 devstack sudo[101867]: pam_unix(sudo:session): session closed for user root Jun 02 03:32:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2b1ba5a7-c157-4a16-9f54-e679b84ba491 tempest-CinderUnicodeTest-1273615205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2.info" returned: 0 in 0.605s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:32:07 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-2b1ba5a7-c157-4a16-9f54-e679b84ba491 tempest-CinderUnicodeTest-1273615205 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2.info is being set with open permissions: ugo+rw Jun 02 03:32:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2b1ba5a7-c157-4a16-9f54-e679b84ba491 tempest-CinderUnicodeTest-1273615205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:07 devstack sudo[101872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2.info Jun 02 03:32:07 devstack sudo[101872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:32:07 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root Jun 02 03:32:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ac5eb940-f568-4d2b-bfed-a0d45d4a9fa6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.704s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:32:07 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-ac5eb940-f568-4d2b-bfed-a0d45d4a9fa6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:32:07 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-ac5eb940-f568-4d2b-bfed-a0d45d4a9fa6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Deleted volume successfully. Jun 02 03:32:07 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ac5eb940-f568-4d2b-bfed-a0d45d4a9fa6 tempest-VolumesSnapshotNegativeTestJSON-353044417 None] Lock "cinder-bb233c9a-61f8-4bcc-938b-d861d9727f96-delete_volume" released by "delete_volume" :: held 2.341s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:32:07 devstack sudo[101872]: pam_unix(sudo:session): session closed for user root Jun 02 03:32:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2b1ba5a7-c157-4a16-9f54-e679b84ba491 tempest-CinderUnicodeTest-1273615205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2.info" returned: 0 in 0.798s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:32:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2b1ba5a7-c157-4a16-9f54-e679b84ba491 tempest-CinderUnicodeTest-1273615205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.415s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:32:07 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-2b1ba5a7-c157-4a16-9f54-e679b84ba491 tempest-CinderUnicodeTest-1273615205 None] Create snapshot completed successfully Jun 02 03:32:08 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-14521e84-06fd-4018-9cc9-8da955d14bb3 tempest-CinderUnicodeTest-1273615205 None] Acquiring lock "cinder-3d5a701f-9f03-4cc1-a0d7-26783274cc78-delete_snapshot" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:32:08 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-14521e84-06fd-4018-9cc9-8da955d14bb3 tempest-CinderUnicodeTest-1273615205 None] Lock "cinder-3d5a701f-9f03-4cc1-a0d7-26783274cc78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:32:08 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-14521e84-06fd-4018-9cc9-8da955d14bb3 tempest-CinderUnicodeTest-1273615205 None] Acquiring lock "cinder-quobyte-468d1da2-6e08-4e0b-a409-4dd0551dd8e2" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:32:08 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-14521e84-06fd-4018-9cc9-8da955d14bb3 tempest-CinderUnicodeTest-1273615205 None] Lock "cinder-quobyte-468d1da2-6e08-4e0b-a409-4dd0551dd8e2" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:32:08 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-14521e84-06fd-4018-9cc9-8da955d14bb3 tempest-CinderUnicodeTest-1273615205 None] Acquiring lock "cinder-quobyte-3d5a701f-9f03-4cc1-a0d7-26783274cc78" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:32:08 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-14521e84-06fd-4018-9cc9-8da955d14bb3 tempest-CinderUnicodeTest-1273615205 None] Lock "cinder-quobyte-3d5a701f-9f03-4cc1-a0d7-26783274cc78" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:32:08 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-14521e84-06fd-4018-9cc9-8da955d14bb3 tempest-CinderUnicodeTest-1273615205 None] Deleting offline snapshot 3d5a701f-9f03-4cc1-a0d7-26783274cc78 of volume 468d1da2-6e08-4e0b-a409-4dd0551dd8e2 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:32:08 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-14521e84-06fd-4018-9cc9-8da955d14bb3 tempest-CinderUnicodeTest-1273615205 None] snapshot_file for this snap is: volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2.3d5a701f-9f03-4cc1-a0d7-26783274cc78 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:32:08 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c31a99-122a-4414-86e1-5dad8b0fc60b]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:32:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-14521e84-06fd-4018-9cc9-8da955d14bb3 tempest-CinderUnicodeTest-1273615205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2.3d5a701f-9f03-4cc1-a0d7-26783274cc78 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:08 devstack sudo[101876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2.3d5a701f-9f03-4cc1-a0d7-26783274cc78 Jun 02 03:32:08 devstack sudo[101876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:32:09 devstack sudo[101876]: pam_unix(sudo:session): session closed for user root Jun 02 03:32:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-14521e84-06fd-4018-9cc9-8da955d14bb3 tempest-CinderUnicodeTest-1273615205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2.3d5a701f-9f03-4cc1-a0d7-26783274cc78" returned: 0 in 0.826s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:32:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-14521e84-06fd-4018-9cc9-8da955d14bb3 tempest-CinderUnicodeTest-1273615205 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:32:09 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[b847348e-dc54-4903-b977-c51dc2b5717e]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:32:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-14521e84-06fd-4018-9cc9-8da955d14bb3 tempest-CinderUnicodeTest-1273615205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:09 devstack sudo[101894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2 Jun 02 03:32:09 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:32:09 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:32:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:32:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:32:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:32:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:32:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:32:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:09 devstack sudo[101901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:32:09 devstack sudo[101901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:32:10 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root Jun 02 03:32:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-14521e84-06fd-4018-9cc9-8da955d14bb3 tempest-CinderUnicodeTest-1273615205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2" returned: 0 in 0.848s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:32:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-14521e84-06fd-4018-9cc9-8da955d14bb3 tempest-CinderUnicodeTest-1273615205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2.3d5a701f-9f03-4cc1-a0d7-26783274cc78 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:10 devstack sudo[101907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2.3d5a701f-9f03-4cc1-a0d7-26783274cc78 Jun 02 03:32:10 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:32:10 devstack sudo[101901]: pam_unix(sudo:session): session closed for user root Jun 02 03:32:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.688s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:32:10 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:32:10 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager._thread_info {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:32:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread count: 28 {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 02 03:32:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread info: [<_MainThread(MainThread, started 138618128814208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 02 03:32:10 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root Jun 02 03:32:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-14521e84-06fd-4018-9cc9-8da955d14bb3 tempest-CinderUnicodeTest-1273615205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2.3d5a701f-9f03-4cc1-a0d7-26783274cc78" returned: 0 in 0.745s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:32:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-14521e84-06fd-4018-9cc9-8da955d14bb3 tempest-CinderUnicodeTest-1273615205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2.3d5a701f-9f03-4cc1-a0d7-26783274cc78 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:10 devstack sudo[101912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2.3d5a701f-9f03-4cc1-a0d7-26783274cc78 Jun 02 03:32:10 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:32:11 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root Jun 02 03:32:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-14521e84-06fd-4018-9cc9-8da955d14bb3 tempest-CinderUnicodeTest-1273615205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2.3d5a701f-9f03-4cc1-a0d7-26783274cc78" returned: 0 in 0.669s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:32:11 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-14521e84-06fd-4018-9cc9-8da955d14bb3 tempest-CinderUnicodeTest-1273615205 None] Lock "cinder-quobyte-3d5a701f-9f03-4cc1-a0d7-26783274cc78" released by "_delete_snapshot" :: held 3.228s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:32:11 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-14521e84-06fd-4018-9cc9-8da955d14bb3 tempest-CinderUnicodeTest-1273615205 None] Lock "cinder-quobyte-468d1da2-6e08-4e0b-a409-4dd0551dd8e2" released by "delete_snapshot" :: held 3.257s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:32:11 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-14521e84-06fd-4018-9cc9-8da955d14bb3 tempest-CinderUnicodeTest-1273615205 None] Created reservations ['b6b822c3-6e45-4769-a1e8-663039256b86', '33886918-64ef-4e30-aa98-38d9b24a994a', '6376c5af-b0e2-40c0-920e-71391901e4a3', 'f0b3f9cc-e133-4a3d-8a32-1870609e3fa7'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:32:11 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-14521e84-06fd-4018-9cc9-8da955d14bb3 tempest-CinderUnicodeTest-1273615205 None] Delete snapshot completed successfully. Jun 02 03:32:11 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-14521e84-06fd-4018-9cc9-8da955d14bb3 tempest-CinderUnicodeTest-1273615205 None] Lock "cinder-3d5a701f-9f03-4cc1-a0d7-26783274cc78-delete_snapshot" released by "delete_snapshot" :: held 3.430s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:32:12 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f6fd7b6c-6d77-4607-8cf9-bb5e3fc5f1f2 tempest-CinderUnicodeTest-1273615205 None] Acquiring lock "cinder-468d1da2-6e08-4e0b-a409-4dd0551dd8e2-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:32:12 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f6fd7b6c-6d77-4607-8cf9-bb5e3fc5f1f2 tempest-CinderUnicodeTest-1273615205 None] Lock "cinder-468d1da2-6e08-4e0b-a409-4dd0551dd8e2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:32:12 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f6fd7b6c-6d77-4607-8cf9-bb5e3fc5f1f2 tempest-CinderUnicodeTest-1273615205 None] Acquiring lock "cinder-quobyte-468d1da2-6e08-4e0b-a409-4dd0551dd8e2" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:32:12 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f6fd7b6c-6d77-4607-8cf9-bb5e3fc5f1f2 tempest-CinderUnicodeTest-1273615205 None] Lock "cinder-quobyte-468d1da2-6e08-4e0b-a409-4dd0551dd8e2" acquired by "delete_volume" :: waited 0.026s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:32:12 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[66925f62-0bae-467c-9e64-780f98e3871f]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:32:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f6fd7b6c-6d77-4607-8cf9-bb5e3fc5f1f2 tempest-CinderUnicodeTest-1273615205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:12 devstack sudo[101919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2 Jun 02 03:32:12 devstack sudo[101919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:32:13 devstack sudo[101919]: pam_unix(sudo:session): session closed for user root Jun 02 03:32:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f6fd7b6c-6d77-4607-8cf9-bb5e3fc5f1f2 tempest-CinderUnicodeTest-1273615205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2" returned: 0 in 0.755s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:32:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f6fd7b6c-6d77-4607-8cf9-bb5e3fc5f1f2 tempest-CinderUnicodeTest-1273615205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:13 devstack sudo[101925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2 Jun 02 03:32:13 devstack sudo[101925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:32:14 devstack sudo[101925]: pam_unix(sudo:session): session closed for user root Jun 02 03:32:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f6fd7b6c-6d77-4607-8cf9-bb5e3fc5f1f2 tempest-CinderUnicodeTest-1273615205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-468d1da2-6e08-4e0b-a409-4dd0551dd8e2" returned: 0 in 0.727s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:32:14 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f6fd7b6c-6d77-4607-8cf9-bb5e3fc5f1f2 tempest-CinderUnicodeTest-1273615205 None] Lock "cinder-quobyte-468d1da2-6e08-4e0b-a409-4dd0551dd8e2" released by "delete_volume" :: held 1.576s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:32:14 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-f6fd7b6c-6d77-4607-8cf9-bb5e3fc5f1f2 tempest-CinderUnicodeTest-1273615205 None] Created reservations ['9a90a80d-0607-45fb-886a-4307b8372dbf', 'd22414f2-de01-4f8b-8bc9-b4c19b99915f', 'e04c1b1f-2f4e-44f0-826e-80591a07dfa6', '8080d3b6-9947-492a-8a4c-fb5e5c01bcee'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:32:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-f6fd7b6c-6d77-4607-8cf9-bb5e3fc5f1f2 tempest-CinderUnicodeTest-1273615205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:32:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-f6fd7b6c-6d77-4607-8cf9-bb5e3fc5f1f2 tempest-CinderUnicodeTest-1273615205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:32:14 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-f6fd7b6c-6d77-4607-8cf9-bb5e3fc5f1f2 tempest-CinderUnicodeTest-1273615205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:32:14 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-f6fd7b6c-6d77-4607-8cf9-bb5e3fc5f1f2 tempest-CinderUnicodeTest-1273615205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:32:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-f6fd7b6c-6d77-4607-8cf9-bb5e3fc5f1f2 tempest-CinderUnicodeTest-1273615205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:32:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f6fd7b6c-6d77-4607-8cf9-bb5e3fc5f1f2 tempest-CinderUnicodeTest-1273615205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:14 devstack sudo[101976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:32:14 devstack sudo[101976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:32:14 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6cb7116d-fbff-45e1-973a-8c8e653c8411 tempest-CinderUnicodeTest-1273615205 None] Acquiring lock "cinder-f16ac5a9-3742-43b9-8d4f-69ddb255db7b-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:32:14 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6cb7116d-fbff-45e1-973a-8c8e653c8411 tempest-CinderUnicodeTest-1273615205 None] Lock "cinder-f16ac5a9-3742-43b9-8d4f-69ddb255db7b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:32:15 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6cb7116d-fbff-45e1-973a-8c8e653c8411 tempest-CinderUnicodeTest-1273615205 None] Acquiring lock "cinder-quobyte-f16ac5a9-3742-43b9-8d4f-69ddb255db7b" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:32:15 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6cb7116d-fbff-45e1-973a-8c8e653c8411 tempest-CinderUnicodeTest-1273615205 None] Lock "cinder-quobyte-f16ac5a9-3742-43b9-8d4f-69ddb255db7b" acquired by "delete_volume" :: waited 0.027s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:32:15 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d491edf-aa44-4661-ae83-acde241126e5]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:32:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6cb7116d-fbff-45e1-973a-8c8e653c8411 tempest-CinderUnicodeTest-1273615205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f16ac5a9-3742-43b9-8d4f-69ddb255db7b {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:15 devstack sudo[101990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f16ac5a9-3742-43b9-8d4f-69ddb255db7b Jun 02 03:32:15 devstack sudo[101990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:32:15 devstack sudo[101976]: pam_unix(sudo:session): session closed for user root Jun 02 03:32:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f6fd7b6c-6d77-4607-8cf9-bb5e3fc5f1f2 tempest-CinderUnicodeTest-1273615205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 1.263s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:32:15 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-f6fd7b6c-6d77-4607-8cf9-bb5e3fc5f1f2 tempest-CinderUnicodeTest-1273615205 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:32:15 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-f6fd7b6c-6d77-4607-8cf9-bb5e3fc5f1f2 tempest-CinderUnicodeTest-1273615205 None] Deleted volume successfully. Jun 02 03:32:15 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f6fd7b6c-6d77-4607-8cf9-bb5e3fc5f1f2 tempest-CinderUnicodeTest-1273615205 None] Lock "cinder-468d1da2-6e08-4e0b-a409-4dd0551dd8e2-delete_volume" released by "delete_volume" :: held 3.185s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:32:16 devstack sudo[101990]: pam_unix(sudo:session): session closed for user root Jun 02 03:32:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6cb7116d-fbff-45e1-973a-8c8e653c8411 tempest-CinderUnicodeTest-1273615205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f16ac5a9-3742-43b9-8d4f-69ddb255db7b" returned: 0 in 1.287s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:32:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6cb7116d-fbff-45e1-973a-8c8e653c8411 tempest-CinderUnicodeTest-1273615205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f16ac5a9-3742-43b9-8d4f-69ddb255db7b {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:16 devstack sudo[102003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f16ac5a9-3742-43b9-8d4f-69ddb255db7b Jun 02 03:32:16 devstack sudo[102003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:32:17 devstack sudo[102003]: pam_unix(sudo:session): session closed for user root Jun 02 03:32:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6cb7116d-fbff-45e1-973a-8c8e653c8411 tempest-CinderUnicodeTest-1273615205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f16ac5a9-3742-43b9-8d4f-69ddb255db7b" returned: 0 in 1.238s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:32:17 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6cb7116d-fbff-45e1-973a-8c8e653c8411 tempest-CinderUnicodeTest-1273615205 None] Lock "cinder-quobyte-f16ac5a9-3742-43b9-8d4f-69ddb255db7b" released by "delete_volume" :: held 2.615s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:32:17 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-6cb7116d-fbff-45e1-973a-8c8e653c8411 tempest-CinderUnicodeTest-1273615205 None] Created reservations ['102231f5-50f3-46a4-b1b5-a2a3fae9e457', '38e3373d-464b-4994-bb47-0f9e47cca3c6', '68e461c1-145d-4e6c-b20e-790c7ed70636', '643a6777-e1ee-40e6-a63e-f568f1d22495'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:32:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6cb7116d-fbff-45e1-973a-8c8e653c8411 tempest-CinderUnicodeTest-1273615205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:32:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6cb7116d-fbff-45e1-973a-8c8e653c8411 tempest-CinderUnicodeTest-1273615205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:32:17 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6cb7116d-fbff-45e1-973a-8c8e653c8411 tempest-CinderUnicodeTest-1273615205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:32:17 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6cb7116d-fbff-45e1-973a-8c8e653c8411 tempest-CinderUnicodeTest-1273615205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:32:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6cb7116d-fbff-45e1-973a-8c8e653c8411 tempest-CinderUnicodeTest-1273615205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:32:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6cb7116d-fbff-45e1-973a-8c8e653c8411 tempest-CinderUnicodeTest-1273615205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:17 devstack sudo[102010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:32:17 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:32:18 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root Jun 02 03:32:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6cb7116d-fbff-45e1-973a-8c8e653c8411 tempest-CinderUnicodeTest-1273615205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.994s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:32:18 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-6cb7116d-fbff-45e1-973a-8c8e653c8411 tempest-CinderUnicodeTest-1273615205 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:32:18 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-6cb7116d-fbff-45e1-973a-8c8e653c8411 tempest-CinderUnicodeTest-1273615205 None] Deleted volume successfully. Jun 02 03:32:18 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6cb7116d-fbff-45e1-973a-8c8e653c8411 tempest-CinderUnicodeTest-1273615205 None] Lock "cinder-f16ac5a9-3742-43b9-8d4f-69ddb255db7b-delete_volume" released by "delete_volume" :: held 3.978s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:32:27 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=80,cinder:UPDATE=89,cinder:DELETE=9,cinder:INSERT=21 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:32:28 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=67,cinder:DELETE=6,cinder:UPDATE=93,cinder:INSERT=26 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:32:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-33957856-0500-4f94-8151-03ff0280937e req-2ee0b845-1d42-4e86-9b8e-75c9672a4fc8 tempest-TestStampPattern-785899133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:32:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-33957856-0500-4f94-8151-03ff0280937e req-2ee0b845-1d42-4e86-9b8e-75c9672a4fc8 tempest-TestStampPattern-785899133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:32:45 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01a76c6-3eeb-49bd-83fc-f5d2a5e60093]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:32:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-33957856-0500-4f94-8151-03ff0280937e req-2ee0b845-1d42-4e86-9b8e-75c9672a4fc8 tempest-TestStampPattern-785899133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:45 devstack sudo[102142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423 Jun 02 03:32:45 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:32:45 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root Jun 02 03:32:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-33957856-0500-4f94-8151-03ff0280937e req-2ee0b845-1d42-4e86-9b8e-75c9672a4fc8 tempest-TestStampPattern-785899133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423" returned: 0 in 0.718s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:32:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-33957856-0500-4f94-8151-03ff0280937e req-2ee0b845-1d42-4e86-9b8e-75c9672a4fc8 tempest-TestStampPattern-785899133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.737s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:32:45 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-33957856-0500-4f94-8151-03ff0280937e req-2ee0b845-1d42-4e86-9b8e-75c9672a4fc8 tempest-TestStampPattern-785899133 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1', 'name': 'volume-aae93d99-49d6-4814-84d1-43c086aff423', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f44d2e9d-5b52-4565-ae6c-ef366dbd6737', 'enforce_multipath': True} {{(pid=86431) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 02 03:32:45 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-33957856-0500-4f94-8151-03ff0280937e req-2ee0b845-1d42-4e86-9b8e-75c9672a4fc8 tempest-TestStampPattern-785899133 None] attachment_update completed successfully. Jun 02 03:32:50 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-2df5988b-0b91-46a2-87c2-042bcd81aeff tempest-TestMinimumBasicScenario-1780701285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:32:51 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2df5988b-0b91-46a2-87c2-042bcd81aeff tempest-TestMinimumBasicScenario-1780701285 None] Flow 'volume_create_manager' (0083a59e-32d7-4c50-bb80-94358f3dad16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:32:51 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2df5988b-0b91-46a2-87c2-042bcd81aeff tempest-TestMinimumBasicScenario-1780701285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e17d7de6-8341-411c-921e-6904836ae924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:32:51 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2df5988b-0b91-46a2-87c2-042bcd81aeff tempest-TestMinimumBasicScenario-1780701285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e17d7de6-8341-411c-921e-6904836ae924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-970585444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=090d30e5-8f91-4b12-ba49-51457fd7e85a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05151eac1a7d4ae7950b8109738742ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:32:51Z,use_quota=True,user_id='e85b89180b634199a13a1635c94a97da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:32:51 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2df5988b-0b91-46a2-87c2-042bcd81aeff tempest-TestMinimumBasicScenario-1780701285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1f0756a-34fa-46f4-8953-ab502b55c6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:32:51 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2df5988b-0b91-46a2-87c2-042bcd81aeff tempest-TestMinimumBasicScenario-1780701285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1f0756a-34fa-46f4-8953-ab502b55c6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:32:51 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2df5988b-0b91-46a2-87c2-042bcd81aeff tempest-TestMinimumBasicScenario-1780701285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e874cabb-1a47-4359-ad9f-c973086e0a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:32:51 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2df5988b-0b91-46a2-87c2-042bcd81aeff tempest-TestMinimumBasicScenario-1780701285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e874cabb-1a47-4359-ad9f-c973086e0a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '090d30e5-8f91-4b12-ba49-51457fd7e85a', 'volume_name': 'volume-090d30e5-8f91-4b12-ba49-51457fd7e85a', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:32:51 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2df5988b-0b91-46a2-87c2-042bcd81aeff tempest-TestMinimumBasicScenario-1780701285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51f75903-f354-4a4f-9d86-dc6910d4d648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:32:51 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2df5988b-0b91-46a2-87c2-042bcd81aeff tempest-TestMinimumBasicScenario-1780701285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51f75903-f354-4a4f-9d86-dc6910d4d648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:32:51 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2df5988b-0b91-46a2-87c2-042bcd81aeff tempest-TestMinimumBasicScenario-1780701285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c32218fe-0363-420f-8e91-027b0e290886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:32:51 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-2df5988b-0b91-46a2-87c2-042bcd81aeff tempest-TestMinimumBasicScenario-1780701285 None] Volume 090d30e5-8f91-4b12-ba49-51457fd7e85a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-090d30e5-8f91-4b12-ba49-51457fd7e85a', 'volume_size': 1} Jun 02 03:32:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2df5988b-0b91-46a2-87c2-042bcd81aeff tempest-TestMinimumBasicScenario-1780701285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:32:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2df5988b-0b91-46a2-87c2-042bcd81aeff tempest-TestMinimumBasicScenario-1780701285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:32:51 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-2df5988b-0b91-46a2-87c2-042bcd81aeff tempest-TestMinimumBasicScenario-1780701285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-970585444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=090d30e5-8f91-4b12-ba49-51457fd7e85a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05151eac1a7d4ae7950b8109738742ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:32:51Z,use_quota=True,user_id='e85b89180b634199a13a1635c94a97da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:32:51 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-2df5988b-0b91-46a2-87c2-042bcd81aeff tempest-TestMinimumBasicScenario-1780701285 None] Creating volume 090d30e5-8f91-4b12-ba49-51457fd7e85a {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:32:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2df5988b-0b91-46a2-87c2-042bcd81aeff tempest-TestMinimumBasicScenario-1780701285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:32:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2df5988b-0b91-46a2-87c2-042bcd81aeff tempest-TestMinimumBasicScenario-1780701285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:32:51 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-2df5988b-0b91-46a2-87c2-042bcd81aeff tempest-TestMinimumBasicScenario-1780701285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:32:51 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-2df5988b-0b91-46a2-87c2-042bcd81aeff tempest-TestMinimumBasicScenario-1780701285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:32:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2df5988b-0b91-46a2-87c2-042bcd81aeff tempest-TestMinimumBasicScenario-1780701285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:32:51 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-2df5988b-0b91-46a2-87c2-042bcd81aeff tempest-TestMinimumBasicScenario-1780701285 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:32:51 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-2df5988b-0b91-46a2-87c2-042bcd81aeff tempest-TestMinimumBasicScenario-1780701285 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:32:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2df5988b-0b91-46a2-87c2-042bcd81aeff tempest-TestMinimumBasicScenario-1780701285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-090d30e5-8f91-4b12-ba49-51457fd7e85a 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:51 devstack sudo[102601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-090d30e5-8f91-4b12-ba49-51457fd7e85a 1073741824 Jun 02 03:32:51 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:32:51 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root Jun 02 03:32:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2df5988b-0b91-46a2-87c2-042bcd81aeff tempest-TestMinimumBasicScenario-1780701285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-090d30e5-8f91-4b12-ba49-51457fd7e85a 1073741824" returned: 0 in 0.855s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:32:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2df5988b-0b91-46a2-87c2-042bcd81aeff tempest-TestMinimumBasicScenario-1780701285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-090d30e5-8f91-4b12-ba49-51457fd7e85a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:52 devstack sudo[102607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-090d30e5-8f91-4b12-ba49-51457fd7e85a Jun 02 03:32:52 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:32:52 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root Jun 02 03:32:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2df5988b-0b91-46a2-87c2-042bcd81aeff tempest-TestMinimumBasicScenario-1780701285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-090d30e5-8f91-4b12-ba49-51457fd7e85a" returned: 0 in 0.652s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:32:52 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-2df5988b-0b91-46a2-87c2-042bcd81aeff tempest-TestMinimumBasicScenario-1780701285 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:32:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2df5988b-0b91-46a2-87c2-042bcd81aeff tempest-TestMinimumBasicScenario-1780701285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:32:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2df5988b-0b91-46a2-87c2-042bcd81aeff tempest-TestMinimumBasicScenario-1780701285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c32218fe-0363-420f-8e91-027b0e290886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-090d30e5-8f91-4b12-ba49-51457fd7e85a', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:32:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2df5988b-0b91-46a2-87c2-042bcd81aeff tempest-TestMinimumBasicScenario-1780701285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c982e18-b3ce-4fd7-ab34-5b74226facdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:32:52 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-2df5988b-0b91-46a2-87c2-042bcd81aeff tempest-TestMinimumBasicScenario-1780701285 None] Volume volume-090d30e5-8f91-4b12-ba49-51457fd7e85a (090d30e5-8f91-4b12-ba49-51457fd7e85a): created successfully Jun 02 03:32:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2df5988b-0b91-46a2-87c2-042bcd81aeff tempest-TestMinimumBasicScenario-1780701285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c982e18-b3ce-4fd7-ab34-5b74226facdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:32:52 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2df5988b-0b91-46a2-87c2-042bcd81aeff tempest-TestMinimumBasicScenario-1780701285 None] Flow 'volume_create_manager' (0083a59e-32d7-4c50-bb80-94358f3dad16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:32:52 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-2df5988b-0b91-46a2-87c2-042bcd81aeff tempest-TestMinimumBasicScenario-1780701285 None] Created volume successfully. Jun 02 03:32:54 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-b46877cc-e911-495d-922b-268aa68280c7 req-7772fea1-d505-4f98-ba89-d90ba4cf86c6 tempest-TestStampPattern-785899133 None] Terminate volume connection completed successfully. Jun 02 03:32:54 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-b46877cc-e911-495d-922b-268aa68280c7 req-7772fea1-d505-4f98-ba89-d90ba4cf86c6 tempest-TestStampPattern-785899133 None] Deleting attachment f44d2e9d-5b52-4565-ae6c-ef366dbd6737. {{(pid=86431) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 02 03:32:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-9118b98e-54a3-41f6-8afb-b3bd82526593 req-7522285a-62cd-4da0-8d38-83c316321898 tempest-TestMinimumBasicScenario-1780701285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:32:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-9118b98e-54a3-41f6-8afb-b3bd82526593 req-7522285a-62cd-4da0-8d38-83c316321898 tempest-TestMinimumBasicScenario-1780701285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:32:56 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1247e96-3ccb-48a7-b3ee-3d9e3a12d85a]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:32:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-9118b98e-54a3-41f6-8afb-b3bd82526593 req-7522285a-62cd-4da0-8d38-83c316321898 tempest-TestMinimumBasicScenario-1780701285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-090d30e5-8f91-4b12-ba49-51457fd7e85a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:56 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-090d30e5-8f91-4b12-ba49-51457fd7e85a Jun 02 03:32:56 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:32:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fbb67ca7-b057-40e1-98b2-343054c3b090 tempest-TestStampPattern-785899133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:32:57 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Jun 02 03:32:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-9118b98e-54a3-41f6-8afb-b3bd82526593 req-7522285a-62cd-4da0-8d38-83c316321898 tempest-TestMinimumBasicScenario-1780701285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-090d30e5-8f91-4b12-ba49-51457fd7e85a" returned: 0 in 0.809s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:32:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-9118b98e-54a3-41f6-8afb-b3bd82526593 req-7522285a-62cd-4da0-8d38-83c316321898 tempest-TestMinimumBasicScenario-1780701285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.834s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:32:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fbb67ca7-b057-40e1-98b2-343054c3b090 tempest-TestStampPattern-785899133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.327s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:32:57 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-fbb67ca7-b057-40e1-98b2-343054c3b090 tempest-TestStampPattern-785899133 None] Creating offline snapshot 500e47ef-1e8f-4c19-a93d-91c50a39ff80 of volume aae93d99-49d6-4814-84d1-43c086aff423 {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:32:57 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[c208af36-15b8-42ad-83a0-cf7791c95538]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:32:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fbb67ca7-b057-40e1-98b2-343054c3b090 tempest-TestStampPattern-785899133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:57 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-9118b98e-54a3-41f6-8afb-b3bd82526593 req-7522285a-62cd-4da0-8d38-83c316321898 tempest-TestMinimumBasicScenario-1780701285 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1', 'name': 'volume-090d30e5-8f91-4b12-ba49-51457fd7e85a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a7f9c969-cad8-45bd-ad44-9da59fd08b45', 'enforce_multipath': True} {{(pid=86431) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 02 03:32:57 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-9118b98e-54a3-41f6-8afb-b3bd82526593 req-7522285a-62cd-4da0-8d38-83c316321898 tempest-TestMinimumBasicScenario-1780701285 None] attachment_update completed successfully. Jun 02 03:32:57 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423 Jun 02 03:32:57 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:32:57 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Jun 02 03:32:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fbb67ca7-b057-40e1-98b2-343054c3b090 tempest-TestStampPattern-785899133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423" returned: 0 in 0.781s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:32:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fbb67ca7-b057-40e1-98b2-343054c3b090 tempest-TestStampPattern-785899133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423.500e47ef-1e8f-4c19-a93d-91c50a39ff80 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:58 devstack sudo[102735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423.500e47ef-1e8f-4c19-a93d-91c50a39ff80 1G Jun 02 03:32:58 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:32:58 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root Jun 02 03:32:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fbb67ca7-b057-40e1-98b2-343054c3b090 tempest-TestStampPattern-785899133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423.500e47ef-1e8f-4c19-a93d-91c50a39ff80 1G" returned: 0 in 0.782s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:32:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fbb67ca7-b057-40e1-98b2-343054c3b090 tempest-TestStampPattern-785899133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aae93d99-49d6-4814-84d1-43c086aff423 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423.500e47ef-1e8f-4c19-a93d-91c50a39ff80 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:58 devstack sudo[103055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aae93d99-49d6-4814-84d1-43c086aff423 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423.500e47ef-1e8f-4c19-a93d-91c50a39ff80 Jun 02 03:32:58 devstack sudo[103055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:32:59 devstack sudo[103055]: pam_unix(sudo:session): session closed for user root Jun 02 03:32:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fbb67ca7-b057-40e1-98b2-343054c3b090 tempest-TestStampPattern-785899133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aae93d99-49d6-4814-84d1-43c086aff423 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423.500e47ef-1e8f-4c19-a93d-91c50a39ff80" returned: 0 in 0.654s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:32:59 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-fbb67ca7-b057-40e1-98b2-343054c3b090 tempest-TestStampPattern-785899133 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423.500e47ef-1e8f-4c19-a93d-91c50a39ff80 is being set with open permissions: ugo+rw Jun 02 03:32:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fbb67ca7-b057-40e1-98b2-343054c3b090 tempest-TestStampPattern-785899133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423.500e47ef-1e8f-4c19-a93d-91c50a39ff80 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:32:59 devstack sudo[103060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423.500e47ef-1e8f-4c19-a93d-91c50a39ff80 Jun 02 03:32:59 devstack sudo[103060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:33:00 devstack sudo[103060]: pam_unix(sudo:session): session closed for user root Jun 02 03:33:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fbb67ca7-b057-40e1-98b2-343054c3b090 tempest-TestStampPattern-785899133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423.500e47ef-1e8f-4c19-a93d-91c50a39ff80" returned: 0 in 0.629s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:33:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fbb67ca7-b057-40e1-98b2-343054c3b090 tempest-TestStampPattern-785899133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:33:00 devstack sudo[103085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423.info Jun 02 03:33:00 devstack sudo[103085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:33:00 devstack sudo[103085]: pam_unix(sudo:session): session closed for user root Jun 02 03:33:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fbb67ca7-b057-40e1-98b2-343054c3b090 tempest-TestStampPattern-785899133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423.info" returned: 0 in 0.613s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:33:00 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-fbb67ca7-b057-40e1-98b2-343054c3b090 tempest-TestStampPattern-785899133 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423.info is being set with open permissions: ugo+rw Jun 02 03:33:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fbb67ca7-b057-40e1-98b2-343054c3b090 tempest-TestStampPattern-785899133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:33:00 devstack sudo[103088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423.info Jun 02 03:33:00 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:33:01 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root Jun 02 03:33:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fbb67ca7-b057-40e1-98b2-343054c3b090 tempest-TestStampPattern-785899133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423.info" returned: 0 in 0.582s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:33:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fbb67ca7-b057-40e1-98b2-343054c3b090 tempest-TestStampPattern-785899133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.133s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:33:01 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-fbb67ca7-b057-40e1-98b2-343054c3b090 tempest-TestStampPattern-785899133 None] Create snapshot completed successfully Jun 02 03:33:09 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:33:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:33:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:33:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:33:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:33:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:33:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:33:09 devstack sudo[103129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:33:09 devstack sudo[103129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:33:10 devstack sudo[103129]: pam_unix(sudo:session): session closed for user root Jun 02 03:33:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.627s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:33:10 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:33:10 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager._thread_info {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:33:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread count: 28 {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 02 03:33:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread info: [<_MainThread(MainThread, started 138618128814208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 02 03:33:11 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=20,cinder:UPDATE=9 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:33:11 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=16,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=2 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:33:11 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:33:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Flow 'volume_create_manager' (5915cbaa-2954-4bb9-8538-32988e4c9580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:33:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20bd9bca-4370-48e9-a293-522a908ee5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:33:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20bd9bca-4370-48e9-a293-522a908ee5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-647078901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b8b2073-eab4-4c19-a39b-4100a509e3a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173698ba3a2849c1b9a2bd151a8779ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=500e47ef-1e8f-4c19-a93d-91c50a39ff80,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:33:12Z,use_quota=True,user_id='c2437528c3b7468286b899f14d99d031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:33:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c8cb794-7f84-4239-86da-88a55241edc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:33:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c8cb794-7f84-4239-86da-88a55241edc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:33:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (365af508-de3e-4449-aea5-155ff5b85458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:33:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (365af508-de3e-4449-aea5-155ff5b85458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2b8b2073-eab4-4c19-a39b-4100a509e3a8', 'volume_name': 'volume-2b8b2073-eab4-4c19-a39b-4100a509e3a8', 'volume_size': 1, 'snapshot_id': '500e47ef-1e8f-4c19-a93d-91c50a39ff80'}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:33:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f162a28-2afc-4dad-ab83-a9aecfa042e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:33:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f162a28-2afc-4dad-ab83-a9aecfa042e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:33:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe7b52b-27fe-4b6d-a83a-bca7da840768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:33:11 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Volume 2b8b2073-eab4-4c19-a39b-4100a509e3a8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2b8b2073-eab4-4c19-a39b-4100a509e3a8', 'volume_size': 1, 'snapshot_id': '500e47ef-1e8f-4c19-a93d-91c50a39ff80'} Jun 02 03:33:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:33:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:33:11 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Acquiring lock "cinder-quobyte-500e47ef-1e8f-4c19-a93d-91c50a39ff80-2b8b2073-eab4-4c19-a39b-4100a509e3a8" by "_create_volume_from_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:33:11 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Lock "cinder-quobyte-500e47ef-1e8f-4c19-a93d-91c50a39ff80-2b8b2073-eab4-4c19-a39b-4100a509e3a8" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:33:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Creating volume 2b8b2073-eab4-4c19-a39b-4100a509e3a8 from snapshot 500e47ef-1e8f-4c19-a93d-91c50a39ff80 {{(pid=86431) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 02 03:33:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:33:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:33:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:33:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:33:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:33:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:33:11 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Acquiring lock "cinder-quobyte-2b8b2073-eab4-4c19-a39b-4100a509e3a8" by "_copy_volume_from_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:33:11 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Lock "cinder-quobyte-2b8b2073-eab4-4c19-a39b-4100a509e3a8" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:33:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] snapshot: 500e47ef-1e8f-4c19-a93d-91c50a39ff80, volume: 2b8b2073-eab4-4c19-a39b-4100a509e3a8, {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 03:33:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:33:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:33:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:33:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:33:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:33:11 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[c465e0df-8e5b-4d36-b791-830eff5c999c]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:33:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423.500e47ef-1e8f-4c19-a93d-91c50a39ff80 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:33:12 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423.500e47ef-1e8f-4c19-a93d-91c50a39ff80 Jun 02 03:33:12 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:33:12 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Jun 02 03:33:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423.500e47ef-1e8f-4c19-a93d-91c50a39ff80" returned: 0 in 0.817s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:33:12 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aae93d99-49d6-4814-84d1-43c086aff423(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:33:12 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423 {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 03:33:12 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Creating direct copy from snapshot {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 03:33:12 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb9d82e-ada4-4c69-8ec3-ab74ffc79515]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:33:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:33:12 devstack sudo[103142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423 Jun 02 03:33:12 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:33:13 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root Jun 02 03:33:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423" returned: 0 in 0.729s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:33:13 devstack cinder-volume[86431]: DEBUG cinder.utils [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Path /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2b8b2073-eab4-4c19-a39b-4100a509e3a8 not found in is_blk_device check {{(pid=86431) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 02 03:33:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2b8b2073-eab4-4c19-a39b-4100a509e3a8 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:33:13 devstack sudo[103148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2b8b2073-eab4-4c19-a39b-4100a509e3a8 Jun 02 03:33:13 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:33:20 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root Jun 02 03:33:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2b8b2073-eab4-4c19-a39b-4100a509e3a8" returned: 0 in 6.546s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:33:20 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[652f5cfb-5c4f-4651-92b1-6c9a367bcab2]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:33:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:33:20 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423 Jun 02 03:33:20 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:33:21 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Jun 02 03:33:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423" returned: 0 in 1.305s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:33:21 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Image conversion details: src /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423, size 1024.00 MB, duration 6.55 sec, destination /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2b8b2073-eab4-4c19-a39b-4100a509e3a8 {{(pid=86431) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 02 03:33:21 devstack cinder-volume[86431]: INFO cinder.image.image_utils [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Converted 1024.00 MB image at 156.40 MB/s Jun 02 03:33:21 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2b8b2073-eab4-4c19-a39b-4100a509e3a8 is being set with open permissions: ugo+rw Jun 02 03:33:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2b8b2073-eab4-4c19-a39b-4100a509e3a8 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:33:21 devstack sudo[103309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2b8b2073-eab4-4c19-a39b-4100a509e3a8 Jun 02 03:33:21 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:33:21 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=2 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:33:21 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:UPDATE=1,cinder:SELECT=2 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:33:22 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root Jun 02 03:33:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2b8b2073-eab4-4c19-a39b-4100a509e3a8" returned: 0 in 1.137s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:33:22 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Lock "cinder-quobyte-2b8b2073-eab4-4c19-a39b-4100a509e3a8" released by "_copy_volume_from_snapshot" :: held 10.673s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:33:22 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Lock "cinder-quobyte-500e47ef-1e8f-4c19-a93d-91c50a39ff80-2b8b2073-eab4-4c19-a39b-4100a509e3a8" released by "_create_volume_from_snapshot" :: held 10.732s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:33:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.755s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:33:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe7b52b-27fe-4b6d-a83a-bca7da840768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b8b2073-eab4-4c19-a39b-4100a509e3a8', 'volume_size': 1, 'snapshot_id': '500e47ef-1e8f-4c19-a93d-91c50a39ff80'}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:33:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d4f661a-59fd-4ae6-a622-f37f25296b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:33:22 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Volume volume-2b8b2073-eab4-4c19-a39b-4100a509e3a8 (2b8b2073-eab4-4c19-a39b-4100a509e3a8): created successfully Jun 02 03:33:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d4f661a-59fd-4ae6-a622-f37f25296b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:33:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Flow 'volume_create_manager' (5915cbaa-2954-4bb9-8538-32988e4c9580) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:33:22 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-d385f4f2-158d-4b20-b836-45f2743e48b9 tempest-TestStampPattern-785899133 None] Created volume successfully. Jun 02 03:33:32 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:UPDATE=3 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:33:32 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=1,cinder:DELETE=1 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:33:47 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-08f2d6f6-d39c-46eb-a574-fef34d62dc6b req-f60a109e-c397-4691-92a2-92ec9ec3941c tempest-TestMinimumBasicScenario-1780701285 None] Terminate volume connection completed successfully. Jun 02 03:33:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-08f2d6f6-d39c-46eb-a574-fef34d62dc6b req-f60a109e-c397-4691-92a2-92ec9ec3941c tempest-TestMinimumBasicScenario-1780701285 None] Deleting attachment a7f9c969-cad8-45bd-ad44-9da59fd08b45. {{(pid=86431) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 02 03:33:49 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-88b75573-ccca-4808-959d-4dbc510c5dfa tempest-TestMinimumBasicScenario-1780701285 None] Acquiring lock "cinder-090d30e5-8f91-4b12-ba49-51457fd7e85a-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:33:49 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-88b75573-ccca-4808-959d-4dbc510c5dfa tempest-TestMinimumBasicScenario-1780701285 None] Lock "cinder-090d30e5-8f91-4b12-ba49-51457fd7e85a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:33:49 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-88b75573-ccca-4808-959d-4dbc510c5dfa tempest-TestMinimumBasicScenario-1780701285 None] Acquiring lock "cinder-quobyte-090d30e5-8f91-4b12-ba49-51457fd7e85a" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:33:49 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-88b75573-ccca-4808-959d-4dbc510c5dfa tempest-TestMinimumBasicScenario-1780701285 None] Lock "cinder-quobyte-090d30e5-8f91-4b12-ba49-51457fd7e85a" acquired by "delete_volume" :: waited 0.016s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:33:49 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c0d9c3-a308-4e6e-a456-da36a7fd5e18]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:33:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-88b75573-ccca-4808-959d-4dbc510c5dfa tempest-TestMinimumBasicScenario-1780701285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-090d30e5-8f91-4b12-ba49-51457fd7e85a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:33:49 devstack sudo[103462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-090d30e5-8f91-4b12-ba49-51457fd7e85a Jun 02 03:33:49 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:33:49 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root Jun 02 03:33:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-88b75573-ccca-4808-959d-4dbc510c5dfa tempest-TestMinimumBasicScenario-1780701285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-090d30e5-8f91-4b12-ba49-51457fd7e85a" returned: 0 in 0.696s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:33:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-88b75573-ccca-4808-959d-4dbc510c5dfa tempest-TestMinimumBasicScenario-1780701285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-090d30e5-8f91-4b12-ba49-51457fd7e85a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:33:49 devstack sudo[103467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-090d30e5-8f91-4b12-ba49-51457fd7e85a Jun 02 03:33:49 devstack sudo[103467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:33:50 devstack sudo[103467]: pam_unix(sudo:session): session closed for user root Jun 02 03:33:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-88b75573-ccca-4808-959d-4dbc510c5dfa tempest-TestMinimumBasicScenario-1780701285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-090d30e5-8f91-4b12-ba49-51457fd7e85a" returned: 0 in 0.583s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:33:50 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-88b75573-ccca-4808-959d-4dbc510c5dfa tempest-TestMinimumBasicScenario-1780701285 None] Lock "cinder-quobyte-090d30e5-8f91-4b12-ba49-51457fd7e85a" released by "delete_volume" :: held 1.319s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:33:50 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-88b75573-ccca-4808-959d-4dbc510c5dfa tempest-TestMinimumBasicScenario-1780701285 None] Created reservations ['f023af8b-1132-4fb7-bf53-3b7bb3326c2e', 'e835c337-3467-4168-9954-24569d0deeba', '24cb3b70-bd5d-45a9-9527-5cfaac67d3ec', 'aecd7ed3-30ff-4cc2-9995-c9032288f8e5'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:33:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-88b75573-ccca-4808-959d-4dbc510c5dfa tempest-TestMinimumBasicScenario-1780701285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:33:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-88b75573-ccca-4808-959d-4dbc510c5dfa tempest-TestMinimumBasicScenario-1780701285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:33:50 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-88b75573-ccca-4808-959d-4dbc510c5dfa tempest-TestMinimumBasicScenario-1780701285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:33:50 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-88b75573-ccca-4808-959d-4dbc510c5dfa tempest-TestMinimumBasicScenario-1780701285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:33:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-88b75573-ccca-4808-959d-4dbc510c5dfa tempest-TestMinimumBasicScenario-1780701285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:33:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-88b75573-ccca-4808-959d-4dbc510c5dfa tempest-TestMinimumBasicScenario-1780701285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:33:50 devstack sudo[103470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:33:50 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:33:51 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root Jun 02 03:33:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-88b75573-ccca-4808-959d-4dbc510c5dfa tempest-TestMinimumBasicScenario-1780701285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.579s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:33:51 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-88b75573-ccca-4808-959d-4dbc510c5dfa tempest-TestMinimumBasicScenario-1780701285 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:33:51 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-88b75573-ccca-4808-959d-4dbc510c5dfa tempest-TestMinimumBasicScenario-1780701285 None] Deleted volume successfully. Jun 02 03:33:51 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-88b75573-ccca-4808-959d-4dbc510c5dfa tempest-TestMinimumBasicScenario-1780701285 None] Lock "cinder-090d30e5-8f91-4b12-ba49-51457fd7e85a-delete_volume" released by "delete_volume" :: held 2.076s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:34:00 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=6 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:34:01 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=5,cinder:UPDATE=10,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:34:09 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:34:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:34:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:34:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:34:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:34:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:34:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:34:09 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:34:09 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:34:10 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Jun 02 03:34:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.627s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:34:10 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:34:10 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager._thread_info {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:34:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread count: 28 {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 02 03:34:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread info: [<_MainThread(MainThread, started 138618128814208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 02 03:34:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-4167415f-f799-42c5-a3e4-897be1e79937 req-5fa7d356-69d4-4416-859e-4fe480de13d5 tempest-TestStampPattern-785899133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:34:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-4167415f-f799-42c5-a3e4-897be1e79937 req-5fa7d356-69d4-4416-859e-4fe480de13d5 tempest-TestStampPattern-785899133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:34:12 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d05126f-12f6-4b60-b831-b5e9f9c20349]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:34:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-4167415f-f799-42c5-a3e4-897be1e79937 req-5fa7d356-69d4-4416-859e-4fe480de13d5 tempest-TestStampPattern-785899133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2b8b2073-eab4-4c19-a39b-4100a509e3a8 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:34:12 devstack sudo[103536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2b8b2073-eab4-4c19-a39b-4100a509e3a8 Jun 02 03:34:12 devstack sudo[103536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:34:13 devstack sudo[103536]: pam_unix(sudo:session): session closed for user root Jun 02 03:34:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-4167415f-f799-42c5-a3e4-897be1e79937 req-5fa7d356-69d4-4416-859e-4fe480de13d5 tempest-TestStampPattern-785899133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2b8b2073-eab4-4c19-a39b-4100a509e3a8" returned: 0 in 0.842s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:34:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-4167415f-f799-42c5-a3e4-897be1e79937 req-5fa7d356-69d4-4416-859e-4fe480de13d5 tempest-TestStampPattern-785899133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.873s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:34:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-4167415f-f799-42c5-a3e4-897be1e79937 req-5fa7d356-69d4-4416-859e-4fe480de13d5 tempest-TestStampPattern-785899133 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1', 'name': 'volume-2b8b2073-eab4-4c19-a39b-4100a509e3a8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dd046241-8385-4107-9afa-d18ecb1de8ea', 'enforce_multipath': True} {{(pid=86431) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 02 03:34:13 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-4167415f-f799-42c5-a3e4-897be1e79937 req-5fa7d356-69d4-4416-859e-4fe480de13d5 tempest-TestStampPattern-785899133 None] attachment_update completed successfully. Jun 02 03:34:20 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-35bbba77-906a-416c-975b-6e6b486afe6d req-5686faa0-1932-428d-ad87-316467d98eaa tempest-TestStampPattern-785899133 None] Terminate volume connection completed successfully. Jun 02 03:34:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-35bbba77-906a-416c-975b-6e6b486afe6d req-5686faa0-1932-428d-ad87-316467d98eaa tempest-TestStampPattern-785899133 None] Deleting attachment dd046241-8385-4107-9afa-d18ecb1de8ea. {{(pid=86431) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 02 03:34:30 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0dff8afb-3bc1-46ab-9b30-d2b21febae43 tempest-TestStampPattern-785899133 None] Acquiring lock "cinder-2b8b2073-eab4-4c19-a39b-4100a509e3a8-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:34:30 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0dff8afb-3bc1-46ab-9b30-d2b21febae43 tempest-TestStampPattern-785899133 None] Lock "cinder-2b8b2073-eab4-4c19-a39b-4100a509e3a8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:34:30 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0dff8afb-3bc1-46ab-9b30-d2b21febae43 tempest-TestStampPattern-785899133 None] Acquiring lock "cinder-quobyte-2b8b2073-eab4-4c19-a39b-4100a509e3a8" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:34:30 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0dff8afb-3bc1-46ab-9b30-d2b21febae43 tempest-TestStampPattern-785899133 None] Lock "cinder-quobyte-2b8b2073-eab4-4c19-a39b-4100a509e3a8" acquired by "delete_volume" :: waited 0.014s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:34:30 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[423a575d-9447-467f-9257-54bce3b36514]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:34:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0dff8afb-3bc1-46ab-9b30-d2b21febae43 tempest-TestStampPattern-785899133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2b8b2073-eab4-4c19-a39b-4100a509e3a8 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:34:30 devstack sudo[104063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2b8b2073-eab4-4c19-a39b-4100a509e3a8 Jun 02 03:34:30 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:34:31 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root Jun 02 03:34:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0dff8afb-3bc1-46ab-9b30-d2b21febae43 tempest-TestStampPattern-785899133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2b8b2073-eab4-4c19-a39b-4100a509e3a8" returned: 0 in 0.734s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:34:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0dff8afb-3bc1-46ab-9b30-d2b21febae43 tempest-TestStampPattern-785899133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2b8b2073-eab4-4c19-a39b-4100a509e3a8 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:34:31 devstack sudo[104068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2b8b2073-eab4-4c19-a39b-4100a509e3a8 Jun 02 03:34:31 devstack sudo[104068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:34:31 devstack sudo[104068]: pam_unix(sudo:session): session closed for user root Jun 02 03:34:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0dff8afb-3bc1-46ab-9b30-d2b21febae43 tempest-TestStampPattern-785899133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2b8b2073-eab4-4c19-a39b-4100a509e3a8" returned: 0 in 0.591s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:34:31 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0dff8afb-3bc1-46ab-9b30-d2b21febae43 tempest-TestStampPattern-785899133 None] Lock "cinder-quobyte-2b8b2073-eab4-4c19-a39b-4100a509e3a8" released by "delete_volume" :: held 1.369s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:34:32 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-0dff8afb-3bc1-46ab-9b30-d2b21febae43 tempest-TestStampPattern-785899133 None] Created reservations ['718125eb-0cbd-491f-b114-6d00cc3b2b24', 'cdd12f75-4576-416f-b2e8-b1081fd2a85d', 'c4fbd9b6-ef3f-4fa5-aedf-6d14feaff90d', 'cb69f12b-31a7-4197-8987-d3ba65823862'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:34:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0dff8afb-3bc1-46ab-9b30-d2b21febae43 tempest-TestStampPattern-785899133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:34:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0dff8afb-3bc1-46ab-9b30-d2b21febae43 tempest-TestStampPattern-785899133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:34:32 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0dff8afb-3bc1-46ab-9b30-d2b21febae43 tempest-TestStampPattern-785899133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:34:32 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0dff8afb-3bc1-46ab-9b30-d2b21febae43 tempest-TestStampPattern-785899133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:34:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0dff8afb-3bc1-46ab-9b30-d2b21febae43 tempest-TestStampPattern-785899133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:34:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0dff8afb-3bc1-46ab-9b30-d2b21febae43 tempest-TestStampPattern-785899133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:34:32 devstack sudo[104071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:34:32 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:34:32 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root Jun 02 03:34:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0dff8afb-3bc1-46ab-9b30-d2b21febae43 tempest-TestStampPattern-785899133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.612s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:34:32 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-0dff8afb-3bc1-46ab-9b30-d2b21febae43 tempest-TestStampPattern-785899133 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:34:32 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-0dff8afb-3bc1-46ab-9b30-d2b21febae43 tempest-TestStampPattern-785899133 None] Deleted volume successfully. Jun 02 03:34:32 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0dff8afb-3bc1-46ab-9b30-d2b21febae43 tempest-TestStampPattern-785899133 None] Lock "cinder-2b8b2073-eab4-4c19-a39b-4100a509e3a8-delete_volume" released by "delete_volume" :: held 2.172s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:34:33 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d3738060-c27b-41b1-99e0-ad98c5dbad52 tempest-TestStampPattern-785899133 None] Acquiring lock "cinder-500e47ef-1e8f-4c19-a93d-91c50a39ff80-delete_snapshot" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:34:33 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d3738060-c27b-41b1-99e0-ad98c5dbad52 tempest-TestStampPattern-785899133 None] Lock "cinder-500e47ef-1e8f-4c19-a93d-91c50a39ff80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:34:33 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d3738060-c27b-41b1-99e0-ad98c5dbad52 tempest-TestStampPattern-785899133 None] Acquiring lock "cinder-quobyte-aae93d99-49d6-4814-84d1-43c086aff423" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:34:33 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d3738060-c27b-41b1-99e0-ad98c5dbad52 tempest-TestStampPattern-785899133 None] Lock "cinder-quobyte-aae93d99-49d6-4814-84d1-43c086aff423" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:34:33 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d3738060-c27b-41b1-99e0-ad98c5dbad52 tempest-TestStampPattern-785899133 None] Acquiring lock "cinder-quobyte-500e47ef-1e8f-4c19-a93d-91c50a39ff80" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:34:33 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d3738060-c27b-41b1-99e0-ad98c5dbad52 tempest-TestStampPattern-785899133 None] Lock "cinder-quobyte-500e47ef-1e8f-4c19-a93d-91c50a39ff80" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:34:33 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-d3738060-c27b-41b1-99e0-ad98c5dbad52 tempest-TestStampPattern-785899133 None] Deleting offline snapshot 500e47ef-1e8f-4c19-a93d-91c50a39ff80 of volume aae93d99-49d6-4814-84d1-43c086aff423 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:34:33 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-d3738060-c27b-41b1-99e0-ad98c5dbad52 tempest-TestStampPattern-785899133 None] snapshot_file for this snap is: volume-aae93d99-49d6-4814-84d1-43c086aff423.500e47ef-1e8f-4c19-a93d-91c50a39ff80 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:34:33 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[198ef4a1-0d34-4847-9ab0-9fde5dc337fc]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:34:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d3738060-c27b-41b1-99e0-ad98c5dbad52 tempest-TestStampPattern-785899133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423.500e47ef-1e8f-4c19-a93d-91c50a39ff80 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:34:33 devstack sudo[104075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423.500e47ef-1e8f-4c19-a93d-91c50a39ff80 Jun 02 03:34:33 devstack sudo[104075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:34:33 devstack sudo[104075]: pam_unix(sudo:session): session closed for user root Jun 02 03:34:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d3738060-c27b-41b1-99e0-ad98c5dbad52 tempest-TestStampPattern-785899133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423.500e47ef-1e8f-4c19-a93d-91c50a39ff80" returned: 0 in 0.703s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:34:33 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-d3738060-c27b-41b1-99e0-ad98c5dbad52 tempest-TestStampPattern-785899133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aae93d99-49d6-4814-84d1-43c086aff423(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:34:33 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4dc06a-1d44-4315-873e-0b15bb32e35f]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:34:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d3738060-c27b-41b1-99e0-ad98c5dbad52 tempest-TestStampPattern-785899133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:34:33 devstack sudo[104080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423 Jun 02 03:34:33 devstack sudo[104080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:34:34 devstack sudo[104080]: pam_unix(sudo:session): session closed for user root Jun 02 03:34:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d3738060-c27b-41b1-99e0-ad98c5dbad52 tempest-TestStampPattern-785899133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423" returned: 0 in 0.697s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:34:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d3738060-c27b-41b1-99e0-ad98c5dbad52 tempest-TestStampPattern-785899133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423.500e47ef-1e8f-4c19-a93d-91c50a39ff80 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:34:34 devstack sudo[104085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423.500e47ef-1e8f-4c19-a93d-91c50a39ff80 Jun 02 03:34:34 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:34:35 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root Jun 02 03:34:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d3738060-c27b-41b1-99e0-ad98c5dbad52 tempest-TestStampPattern-785899133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423.500e47ef-1e8f-4c19-a93d-91c50a39ff80" returned: 0 in 0.732s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:34:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d3738060-c27b-41b1-99e0-ad98c5dbad52 tempest-TestStampPattern-785899133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423.500e47ef-1e8f-4c19-a93d-91c50a39ff80 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:34:35 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423.500e47ef-1e8f-4c19-a93d-91c50a39ff80 Jun 02 03:34:35 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:34:35 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Jun 02 03:34:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d3738060-c27b-41b1-99e0-ad98c5dbad52 tempest-TestStampPattern-785899133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423.500e47ef-1e8f-4c19-a93d-91c50a39ff80" returned: 0 in 0.651s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:34:35 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d3738060-c27b-41b1-99e0-ad98c5dbad52 tempest-TestStampPattern-785899133 None] Lock "cinder-quobyte-500e47ef-1e8f-4c19-a93d-91c50a39ff80" released by "_delete_snapshot" :: held 2.903s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:34:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d3738060-c27b-41b1-99e0-ad98c5dbad52 tempest-TestStampPattern-785899133 None] Lock "cinder-quobyte-aae93d99-49d6-4814-84d1-43c086aff423" released by "delete_snapshot" :: held 2.931s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:34:36 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-d3738060-c27b-41b1-99e0-ad98c5dbad52 tempest-TestStampPattern-785899133 None] Created reservations ['598b1d62-73ad-4f07-bc98-5c91d8aedd8c', '46c94fff-3e18-4612-b978-02afc159a56d', 'ec142e6f-4a2e-404f-93d3-40427dc03eeb', '012e16d5-c047-4c65-ad46-696b7b1d1d6d'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:34:36 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-d3738060-c27b-41b1-99e0-ad98c5dbad52 tempest-TestStampPattern-785899133 None] Delete snapshot completed successfully. Jun 02 03:34:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d3738060-c27b-41b1-99e0-ad98c5dbad52 tempest-TestStampPattern-785899133 None] Lock "cinder-500e47ef-1e8f-4c19-a93d-91c50a39ff80-delete_snapshot" released by "delete_snapshot" :: held 3.102s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:34:43 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5ae1598a-712e-4667-95b8-00a8dd4d16a0 tempest-TestStampPattern-785899133 None] Acquiring lock "cinder-aae93d99-49d6-4814-84d1-43c086aff423-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:34:43 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5ae1598a-712e-4667-95b8-00a8dd4d16a0 tempest-TestStampPattern-785899133 None] Lock "cinder-aae93d99-49d6-4814-84d1-43c086aff423-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:34:43 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5ae1598a-712e-4667-95b8-00a8dd4d16a0 tempest-TestStampPattern-785899133 None] Acquiring lock "cinder-quobyte-aae93d99-49d6-4814-84d1-43c086aff423" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:34:43 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5ae1598a-712e-4667-95b8-00a8dd4d16a0 tempest-TestStampPattern-785899133 None] Lock "cinder-quobyte-aae93d99-49d6-4814-84d1-43c086aff423" acquired by "delete_volume" :: waited 0.027s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:34:43 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d0bc2e-820f-4aa1-8e41-1d5c15ef207f]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:34:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5ae1598a-712e-4667-95b8-00a8dd4d16a0 tempest-TestStampPattern-785899133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:34:43 devstack sudo[104223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423 Jun 02 03:34:43 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:34:44 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root Jun 02 03:34:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5ae1598a-712e-4667-95b8-00a8dd4d16a0 tempest-TestStampPattern-785899133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423" returned: 0 in 0.757s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:34:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5ae1598a-712e-4667-95b8-00a8dd4d16a0 tempest-TestStampPattern-785899133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:34:44 devstack sudo[104229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423 Jun 02 03:34:44 devstack sudo[104229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:34:45 devstack sudo[104229]: pam_unix(sudo:session): session closed for user root Jun 02 03:34:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5ae1598a-712e-4667-95b8-00a8dd4d16a0 tempest-TestStampPattern-785899133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-aae93d99-49d6-4814-84d1-43c086aff423" returned: 0 in 0.639s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:34:45 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5ae1598a-712e-4667-95b8-00a8dd4d16a0 tempest-TestStampPattern-785899133 None] Lock "cinder-quobyte-aae93d99-49d6-4814-84d1-43c086aff423" released by "delete_volume" :: held 1.507s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:34:45 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-5ae1598a-712e-4667-95b8-00a8dd4d16a0 tempest-TestStampPattern-785899133 None] Created reservations ['1c3f8a24-a91e-4686-b65d-aff3ac6a8980', '3e5d583c-c36d-4626-aeaa-6fdb222c2c28', '9b7b0913-eee1-412d-b7a2-1ccde59bf037', 'b5e1d5f6-a84d-4cc5-a4c0-c8c5de86efc0'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:34:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5ae1598a-712e-4667-95b8-00a8dd4d16a0 tempest-TestStampPattern-785899133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:34:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5ae1598a-712e-4667-95b8-00a8dd4d16a0 tempest-TestStampPattern-785899133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:34:45 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-5ae1598a-712e-4667-95b8-00a8dd4d16a0 tempest-TestStampPattern-785899133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:34:45 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-5ae1598a-712e-4667-95b8-00a8dd4d16a0 tempest-TestStampPattern-785899133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:34:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5ae1598a-712e-4667-95b8-00a8dd4d16a0 tempest-TestStampPattern-785899133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:34:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5ae1598a-712e-4667-95b8-00a8dd4d16a0 tempest-TestStampPattern-785899133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:34:45 devstack sudo[104232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:34:45 devstack sudo[104232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:34:45 devstack sudo[104232]: pam_unix(sudo:session): session closed for user root Jun 02 03:34:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5ae1598a-712e-4667-95b8-00a8dd4d16a0 tempest-TestStampPattern-785899133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.615s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:34:45 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-5ae1598a-712e-4667-95b8-00a8dd4d16a0 tempest-TestStampPattern-785899133 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:34:45 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-5ae1598a-712e-4667-95b8-00a8dd4d16a0 tempest-TestStampPattern-785899133 None] Deleted volume successfully. Jun 02 03:34:46 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5ae1598a-712e-4667-95b8-00a8dd4d16a0 tempest-TestStampPattern-785899133 None] Lock "cinder-aae93d99-49d6-4814-84d1-43c086aff423-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:34:55 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=25,cinder:UPDATE=25,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:34:59 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:34:59 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Flow 'volume_create_manager' (01dc8c11-c7d6-429f-a15b-cafbbcc8c4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:34:59 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d293c3b1-0237-40c8-a922-48b03f966545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:34:59 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d293c3b1-0237-40c8-a922-48b03f966545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09cf32db-c439-4803-bade-6b2040c40b83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ff67236b4464e669fa42c6e6a3d85da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:35:00Z,use_quota=True,user_id='83347de22abc4d228e22fc9807b19e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3bb6046-f387-44ae-873e-259070a4b3be),volume_type_id=c3bb6046-f387-44ae-873e-259070a4b3be)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:34:59 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4261ca15-5d0d-42de-9959-1813fb25635d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:34:59 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4261ca15-5d0d-42de-9959-1813fb25635d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:34:59 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (702c66ab-3ec7-4990-9e85-62f3b882df23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:34:59 devstack cinder-volume[86431]: DEBUG cinder.image.glance [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Creating Keystone auth plugin from conf {{(pid=86431) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 02 03:34:59 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (702c66ab-3ec7-4990-9e85-62f3b882df23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '09cf32db-c439-4803-bade-6b2040c40b83', 'volume_name': 'volume-09cf32db-c439-4803-bade-6b2040c40b83', 'volume_size': 1, 'image_id': '4e0d209a-87b9-416d-a036-a3f3ed380b68', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e0d209a-87b9-416d-a036-a3f3ed380b68', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a4e94c776bd378e7b7afc5dc49613f3e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0ff67236b4464e669fa42c6e6a3d85da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6be82edd9f748b317ed2acb36a9fd55a0024dd81ce8d5fc3d316f162ff235cda536f840aaabb2975c727227a8ad971b3e6b19e6ff844dfcdcbc30ecde28762e4', 'id': '4e0d209a-87b9-416d-a036-a3f3ed380b68', 'created_at': datetime.datetime(2026, 6, 2, 1, 34, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 1, 34, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e0d209a-87b9-416d-a036-a3f3ed380b68/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:34:59 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f2ef61-1f32-47f5-ae01-1ab20a398378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:34:59 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f2ef61-1f32-47f5-ae01-1ab20a398378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:34:59 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb21523-59d9-4887-b809-ee45d652dd30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:34:59 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Volume 09cf32db-c439-4803-bade-6b2040c40b83: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-09cf32db-c439-4803-bade-6b2040c40b83', 'volume_size': 1, 'image_id': '4e0d209a-87b9-416d-a036-a3f3ed380b68', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e0d209a-87b9-416d-a036-a3f3ed380b68', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a4e94c776bd378e7b7afc5dc49613f3e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0ff67236b4464e669fa42c6e6a3d85da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6be82edd9f748b317ed2acb36a9fd55a0024dd81ce8d5fc3d316f162ff235cda536f840aaabb2975c727227a8ad971b3e6b19e6ff844dfcdcbc30ecde28762e4', 'id': '4e0d209a-87b9-416d-a036-a3f3ed380b68', 'created_at': datetime.datetime(2026, 6, 2, 1, 34, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 1, 34, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e0d209a-87b9-416d-a036-a3f3ed380b68/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 02 03:34:59 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Trying to clone 09cf32db-c439-4803-bade-6b2040c40b83 from image 4e0d209a-87b9-416d-a036-a3f3ed380b68 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4e0d209a-87b9-416d-a036-a3f3ed380b68', 'metadata': {}}]). {{(pid=86431) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 02 03:35:00 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4e0d209a-87b9-416d-a036-a3f3ed380b68_8fjk1jd8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86431) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 02 03:35:00 devstack cinder-volume[86431]: INFO cinder.image.image_utils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Image download 0.00 MB at 0.00 MB/s Jun 02 03:35:00 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a5ad8b-7122-46db-8a2d-d07b055ccda9]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:35:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0d209a-87b9-416d-a036-a3f3ed380b68_8fjk1jd8devstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:00 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0d209a-87b9-416d-a036-a3f3ed380b68_8fjk1jd8devstack@QuobyteHD Jun 02 03:35:00 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:00 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0d209a-87b9-416d-a036-a3f3ed380b68_8fjk1jd8devstack@QuobyteHD" returned: 0 in 0.665s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0d209a-87b9-416d-a036-a3f3ed380b68_8fjk1jd8devstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:00 devstack sudo[104267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0d209a-87b9-416d-a036-a3f3ed380b68_8fjk1jd8devstack@QuobyteHD Jun 02 03:35:00 devstack sudo[104267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:01 devstack sudo[104267]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0d209a-87b9-416d-a036-a3f3ed380b68_8fjk1jd8devstack@QuobyteHD" returned: 1 in 0.651s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0d209a-87b9-416d-a036-a3f3ed380b68_8fjk1jd8devstack@QuobyteHD' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:35:01 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Temporary image 4e0d209a-87b9-416d-a036-a3f3ed380b68 is fetched for user 83347de22abc4d228e22fc9807b19e05. {{(pid=86431) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 02 03:35:01 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b610634-56b2-471a-9e51-6a08ef52c209]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:35:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0d209a-87b9-416d-a036-a3f3ed380b68_8fjk1jd8devstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:01 devstack sudo[104275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0d209a-87b9-416d-a036-a3f3ed380b68_8fjk1jd8devstack@QuobyteHD Jun 02 03:35:01 devstack sudo[104275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:02 devstack sudo[104275]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0d209a-87b9-416d-a036-a3f3ed380b68_8fjk1jd8devstack@QuobyteHD" returned: 0 in 0.689s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0d209a-87b9-416d-a036-a3f3ed380b68_8fjk1jd8devstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:02 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0d209a-87b9-416d-a036-a3f3ed380b68_8fjk1jd8devstack@QuobyteHD Jun 02 03:35:02 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:02 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0d209a-87b9-416d-a036-a3f3ed380b68_8fjk1jd8devstack@QuobyteHD" returned: 1 in 0.694s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0d209a-87b9-416d-a036-a3f3ed380b68_8fjk1jd8devstack@QuobyteHD' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:35:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:02 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09cf32db-c439-4803-bade-6b2040c40b83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ff67236b4464e669fa42c6e6a3d85da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:35:00Z,use_quota=True,user_id='83347de22abc4d228e22fc9807b19e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3bb6046-f387-44ae-873e-259070a4b3be),volume_type_id=c3bb6046-f387-44ae-873e-259070a4b3be)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:35:02 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Creating volume 09cf32db-c439-4803-bade-6b2040c40b83 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:35:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:02 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:35:02 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:35:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:02 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:35:02 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:35:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-09cf32db-c439-4803-bade-6b2040c40b83 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:02 devstack sudo[104284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-09cf32db-c439-4803-bade-6b2040c40b83 1073741824 Jun 02 03:35:02 devstack sudo[104284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:03 devstack sudo[104284]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-09cf32db-c439-4803-bade-6b2040c40b83 1073741824" returned: 0 in 0.756s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-09cf32db-c439-4803-bade-6b2040c40b83 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:03 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-09cf32db-c439-4803-bade-6b2040c40b83 Jun 02 03:35:03 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:04 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-09cf32db-c439-4803-bade-6b2040c40b83" returned: 0 in 0.597s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:04 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:35:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.399s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:04 devstack cinder-volume[86431]: DEBUG cinder.volume.volume_utils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Attempting download of 4e0d209a-87b9-416d-a036-a3f3ed380b68 ((None, [{'url': 'file:///opt/stack/data/glance/images/4e0d209a-87b9-416d-a036-a3f3ed380b68', 'metadata': {}}])) to volume 09cf32db-c439-4803-bade-6b2040c40b83. {{(pid=86431) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 02 03:35:04 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb638817-0f53-4683-986d-fd92636434bf]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:35:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e0d209a-87b9-416d-a036-a3f3ed380b68_u3nl8_ce {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:04 devstack sudo[104293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e0d209a-87b9-416d-a036-a3f3ed380b68_u3nl8_ce Jun 02 03:35:04 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:04 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e0d209a-87b9-416d-a036-a3f3ed380b68_u3nl8_ce" returned: 0 in 0.676s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e0d209a-87b9-416d-a036-a3f3ed380b68_u3nl8_ce {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:05 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e0d209a-87b9-416d-a036-a3f3ed380b68_u3nl8_ce Jun 02 03:35:05 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:05 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e0d209a-87b9-416d-a036-a3f3ed380b68_u3nl8_ce" returned: 1 in 0.662s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e0d209a-87b9-416d-a036-a3f3ed380b68_u3nl8_ce' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:35:05 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[96078ecd-6e23-48d8-9326-e1d7c7551872]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:35:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0d209a-87b9-416d-a036-a3f3ed380b68_8fjk1jd8devstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:05 devstack sudo[104301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0d209a-87b9-416d-a036-a3f3ed380b68_8fjk1jd8devstack@QuobyteHD Jun 02 03:35:05 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:06 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0d209a-87b9-416d-a036-a3f3ed380b68_8fjk1jd8devstack@QuobyteHD" returned: 0 in 0.673s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0d209a-87b9-416d-a036-a3f3ed380b68_8fjk1jd8devstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:06 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0d209a-87b9-416d-a036-a3f3ed380b68_8fjk1jd8devstack@QuobyteHD Jun 02 03:35:06 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:06 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-d388435d-b31d-4a4a-97d0-3a8948a9dec4 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:35:06 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d388435d-b31d-4a4a-97d0-3a8948a9dec4 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Flow 'volume_create_manager' (fc5ad668-0c55-4d39-aec1-6285aecaee4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:35:06 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d388435d-b31d-4a4a-97d0-3a8948a9dec4 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb13978-53d6-41f9-a25a-2f9a756cbbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:06 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d388435d-b31d-4a4a-97d0-3a8948a9dec4 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb13978-53d6-41f9-a25a-2f9a756cbbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1087655669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9b7008e-835f-4c9e-b922-0b0fd89ff866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37de657815684bd29233bbfe4355b465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:35:07Z,use_quota=True,user_id='fea007dcc6ee458baa4a39acd57dd2e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:07 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:07 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d388435d-b31d-4a4a-97d0-3a8948a9dec4 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8dfaf0e-d9ef-492a-aa5a-29a98bbafb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:07 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d388435d-b31d-4a4a-97d0-3a8948a9dec4 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8dfaf0e-d9ef-492a-aa5a-29a98bbafb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:07 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d388435d-b31d-4a4a-97d0-3a8948a9dec4 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed9555da-a692-49a5-b62f-d17ae035e182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:07 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d388435d-b31d-4a4a-97d0-3a8948a9dec4 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed9555da-a692-49a5-b62f-d17ae035e182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9b7008e-835f-4c9e-b922-0b0fd89ff866', 'volume_name': 'volume-b9b7008e-835f-4c9e-b922-0b0fd89ff866', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:07 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d388435d-b31d-4a4a-97d0-3a8948a9dec4 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f93e7a60-3bf6-47dd-bb82-f32f424ca607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:07 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d388435d-b31d-4a4a-97d0-3a8948a9dec4 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f93e7a60-3bf6-47dd-bb82-f32f424ca607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:07 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d388435d-b31d-4a4a-97d0-3a8948a9dec4 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4583d50-3c6e-43a8-8461-e5f2340a325f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:07 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-d388435d-b31d-4a4a-97d0-3a8948a9dec4 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Volume b9b7008e-835f-4c9e-b922-0b0fd89ff866: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9b7008e-835f-4c9e-b922-0b0fd89ff866', 'volume_size': 1} Jun 02 03:35:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d388435d-b31d-4a4a-97d0-3a8948a9dec4 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d388435d-b31d-4a4a-97d0-3a8948a9dec4 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:07 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-d388435d-b31d-4a4a-97d0-3a8948a9dec4 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1087655669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9b7008e-835f-4c9e-b922-0b0fd89ff866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37de657815684bd29233bbfe4355b465',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:35:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:35:07Z,use_quota=True,user_id='fea007dcc6ee458baa4a39acd57dd2e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:35:07 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-d388435d-b31d-4a4a-97d0-3a8948a9dec4 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Creating volume b9b7008e-835f-4c9e-b922-0b0fd89ff866 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:35:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d388435d-b31d-4a4a-97d0-3a8948a9dec4 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d388435d-b31d-4a4a-97d0-3a8948a9dec4 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:07 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-d388435d-b31d-4a4a-97d0-3a8948a9dec4 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:35:07 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-d388435d-b31d-4a4a-97d0-3a8948a9dec4 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:35:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d388435d-b31d-4a4a-97d0-3a8948a9dec4 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:07 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-d388435d-b31d-4a4a-97d0-3a8948a9dec4 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:35:07 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-d388435d-b31d-4a4a-97d0-3a8948a9dec4 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:35:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d388435d-b31d-4a4a-97d0-3a8948a9dec4 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b9b7008e-835f-4c9e-b922-0b0fd89ff866 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0d209a-87b9-416d-a036-a3f3ed380b68_8fjk1jd8devstack@QuobyteHD" returned: 1 in 0.743s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0d209a-87b9-416d-a036-a3f3ed380b68_8fjk1jd8devstack@QuobyteHD' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:35:07 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] 4e0d209a-87b9-416d-a036-a3f3ed380b68 was raw, converting to raw {{(pid=86431) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 02 03:35:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4e0d209a-87b9-416d-a036-a3f3ed380b68_8fjk1jd8devstack@QuobyteHD /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-09cf32db-c439-4803-bade-6b2040c40b83 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:07 devstack sudo[104312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b9b7008e-835f-4c9e-b922-0b0fd89ff866 1073741824 Jun 02 03:35:07 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:07 devstack sudo[104314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4e0d209a-87b9-416d-a036-a3f3ed380b68_8fjk1jd8devstack@QuobyteHD /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-09cf32db-c439-4803-bade-6b2040c40b83 Jun 02 03:35:07 devstack sudo[104314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:07 devstack sudo[104314]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4e0d209a-87b9-416d-a036-a3f3ed380b68_8fjk1jd8devstack@QuobyteHD /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-09cf32db-c439-4803-bade-6b2040c40b83" returned: 0 in 0.706s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:07 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4e0d209a-87b9-416d-a036-a3f3ed380b68_8fjk1jd8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-09cf32db-c439-4803-bade-6b2040c40b83 {{(pid=86431) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 02 03:35:07 devstack cinder-volume[86431]: INFO cinder.image.image_utils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Converted 0.00 MB image at 0.00 MB/s Jun 02 03:35:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-09cf32db-c439-4803-bade-6b2040c40b83 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:07 devstack sudo[104322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-09cf32db-c439-4803-bade-6b2040c40b83 1G Jun 02 03:35:07 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:07 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d388435d-b31d-4a4a-97d0-3a8948a9dec4 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b9b7008e-835f-4c9e-b922-0b0fd89ff866 1073741824" returned: 0 in 0.764s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d388435d-b31d-4a4a-97d0-3a8948a9dec4 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b9b7008e-835f-4c9e-b922-0b0fd89ff866 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:07 devstack sudo[104324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b9b7008e-835f-4c9e-b922-0b0fd89ff866 Jun 02 03:35:07 devstack sudo[104324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:08 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-09cf32db-c439-4803-bade-6b2040c40b83 1G" returned: 0 in 0.630s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:08 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece264a8-0e94-4362-acdc-a5218b20d616]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:35:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-09cf32db-c439-4803-bade-6b2040c40b83 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:08 devstack sudo[104324]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d388435d-b31d-4a4a-97d0-3a8948a9dec4 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b9b7008e-835f-4c9e-b922-0b0fd89ff866" returned: 0 in 0.629s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:08 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-d388435d-b31d-4a4a-97d0-3a8948a9dec4 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:35:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d388435d-b31d-4a4a-97d0-3a8948a9dec4 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d388435d-b31d-4a4a-97d0-3a8948a9dec4 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4583d50-3c6e-43a8-8461-e5f2340a325f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9b7008e-835f-4c9e-b922-0b0fd89ff866', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d388435d-b31d-4a4a-97d0-3a8948a9dec4 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44789858-14fd-4a05-b890-3474947f5720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:08 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-d388435d-b31d-4a4a-97d0-3a8948a9dec4 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Volume volume-b9b7008e-835f-4c9e-b922-0b0fd89ff866 (b9b7008e-835f-4c9e-b922-0b0fd89ff866): created successfully Jun 02 03:35:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d388435d-b31d-4a4a-97d0-3a8948a9dec4 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44789858-14fd-4a05-b890-3474947f5720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d388435d-b31d-4a4a-97d0-3a8948a9dec4 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Flow 'volume_create_manager' (fc5ad668-0c55-4d39-aec1-6285aecaee4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:35:08 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-d388435d-b31d-4a4a-97d0-3a8948a9dec4 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Created volume successfully. Jun 02 03:35:08 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-09cf32db-c439-4803-bade-6b2040c40b83 Jun 02 03:35:08 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:09 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-09cf32db-c439-4803-bade-6b2040c40b83" returned: 0 in 0.699s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-09cf32db-c439-4803-bade-6b2040c40b83 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:09 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-09cf32db-c439-4803-bade-6b2040c40b83 Jun 02 03:35:09 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:09 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:35:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:35:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:35:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:09 devstack sudo[104336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:35:09 devstack sudo[104336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:09 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-09cf32db-c439-4803-bade-6b2040c40b83" returned: 1 in 0.719s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-09cf32db-c439-4803-bade-6b2040c40b83' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:35:09 devstack cinder-volume[86431]: DEBUG cinder.volume.volume_utils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Downloaded image 4e0d209a-87b9-416d-a036-a3f3ed380b68 ((None, [{'url': 'file:///opt/stack/data/glance/images/4e0d209a-87b9-416d-a036-a3f3ed380b68', 'metadata': {}}])) to volume 09cf32db-c439-4803-bade-6b2040c40b83 successfully. {{(pid=86431) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 02 03:35:09 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Temporary image 4e0d209a-87b9-416d-a036-a3f3ed380b68 for user 83347de22abc4d228e22fc9807b19e05 is deleted. {{(pid=86431) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 02 03:35:09 devstack cinder-volume[86431]: DEBUG cinder.volume.volume_utils [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Marking volume 09cf32db-c439-4803-bade-6b2040c40b83 as bootable. {{(pid=86431) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 02 03:35:09 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Copying metadata from image 4e0d209a-87b9-416d-a036-a3f3ed380b68 to 09cf32db-c439-4803-bade-6b2040c40b83. {{(pid=86431) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 02 03:35:09 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Creating volume glance metadata for volume 09cf32db-c439-4803-bade-6b2040c40b83 backed by image 4e0d209a-87b9-416d-a036-a3f3ed380b68 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '4e0d209a-87b9-416d-a036-a3f3ed380b68', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a4e94c776bd378e7b7afc5dc49613f3e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86431) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 02 03:35:09 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb21523-59d9-4887-b809-ee45d652dd30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09cf32db-c439-4803-bade-6b2040c40b83', 'volume_size': 1, 'image_id': '4e0d209a-87b9-416d-a036-a3f3ed380b68', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e0d209a-87b9-416d-a036-a3f3ed380b68', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a4e94c776bd378e7b7afc5dc49613f3e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0ff67236b4464e669fa42c6e6a3d85da', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6be82edd9f748b317ed2acb36a9fd55a0024dd81ce8d5fc3d316f162ff235cda536f840aaabb2975c727227a8ad971b3e6b19e6ff844dfcdcbc30ecde28762e4', 'id': '4e0d209a-87b9-416d-a036-a3f3ed380b68', 'created_at': datetime.datetime(2026, 6, 2, 1, 34, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 1, 34, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e0d209a-87b9-416d-a036-a3f3ed380b68/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:09 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f9af71e-bb49-407a-8e08-122abe8306f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:09 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Volume volume-09cf32db-c439-4803-bade-6b2040c40b83 (09cf32db-c439-4803-bade-6b2040c40b83): created successfully Jun 02 03:35:09 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f9af71e-bb49-407a-8e08-122abe8306f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:09 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Flow 'volume_create_manager' (01dc8c11-c7d6-429f-a15b-cafbbcc8c4cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:35:09 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-e8fafb61-50cf-4fb7-91d6-4efaf8767b6f tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Created volume successfully. Jun 02 03:35:10 devstack sudo[104336]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.600s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:10 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:35:10 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager._thread_info {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:35:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread count: 28 {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 02 03:35:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread info: [<_MainThread(MainThread, started 138618128814208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 02 03:35:10 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-242de80d-f2c5-4c9d-b302-893741b2b6c8 tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Acquiring lock "cinder-09cf32db-c439-4803-bade-6b2040c40b83-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:35:10 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-242de80d-f2c5-4c9d-b302-893741b2b6c8 tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Lock "cinder-09cf32db-c439-4803-bade-6b2040c40b83-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:35:10 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-242de80d-f2c5-4c9d-b302-893741b2b6c8 tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Acquiring lock "cinder-quobyte-09cf32db-c439-4803-bade-6b2040c40b83" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:35:10 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-242de80d-f2c5-4c9d-b302-893741b2b6c8 tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Lock "cinder-quobyte-09cf32db-c439-4803-bade-6b2040c40b83" acquired by "delete_volume" :: waited 0.014s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:35:10 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0d395b-cfa8-43f3-827b-fe0b52293f44]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:35:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-242de80d-f2c5-4c9d-b302-893741b2b6c8 tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-09cf32db-c439-4803-bade-6b2040c40b83 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:10 devstack sudo[104342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-09cf32db-c439-4803-bade-6b2040c40b83 Jun 02 03:35:10 devstack sudo[104342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:11 devstack sudo[104342]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-242de80d-f2c5-4c9d-b302-893741b2b6c8 tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-09cf32db-c439-4803-bade-6b2040c40b83" returned: 0 in 0.695s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-242de80d-f2c5-4c9d-b302-893741b2b6c8 tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-09cf32db-c439-4803-bade-6b2040c40b83 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:11 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-09cf32db-c439-4803-bade-6b2040c40b83 Jun 02 03:35:11 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:11 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-242de80d-f2c5-4c9d-b302-893741b2b6c8 tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-09cf32db-c439-4803-bade-6b2040c40b83" returned: 1 in 0.691s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-242de80d-f2c5-4c9d-b302-893741b2b6c8 tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-09cf32db-c439-4803-bade-6b2040c40b83' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:35:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-242de80d-f2c5-4c9d-b302-893741b2b6c8 tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-09cf32db-c439-4803-bade-6b2040c40b83 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:11 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-09cf32db-c439-4803-bade-6b2040c40b83 Jun 02 03:35:11 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:12 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=30,cinder:UPDATE=29,cinder:INSERT=12,cinder:DELETE=2 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:35:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-b99bbe97-bd8b-46d3-a3a2-2de6fb83f8c6 req-fca6c439-1994-43a2-b936-c2a03041591d tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-b99bbe97-bd8b-46d3-a3a2-2de6fb83f8c6 req-fca6c439-1994-43a2-b936-c2a03041591d tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:12 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec9663e-25c8-4e4f-9273-42b151026474]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:35:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-b99bbe97-bd8b-46d3-a3a2-2de6fb83f8c6 req-fca6c439-1994-43a2-b936-c2a03041591d tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b9b7008e-835f-4c9e-b922-0b0fd89ff866 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:12 devstack sudo[104361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b9b7008e-835f-4c9e-b922-0b0fd89ff866 Jun 02 03:35:12 devstack sudo[104361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:12 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-242de80d-f2c5-4c9d-b302-893741b2b6c8 tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-09cf32db-c439-4803-bade-6b2040c40b83" returned: 0 in 0.590s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:12 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-242de80d-f2c5-4c9d-b302-893741b2b6c8 tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Lock "cinder-quobyte-09cf32db-c439-4803-bade-6b2040c40b83" released by "delete_volume" :: held 2.037s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:35:12 devstack cinder-volume[86431]: WARNING cinder.quota [None req-242de80d-f2c5-4c9d-b302-893741b2b6c8 tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 02 03:35:12 devstack cinder-volume[86431]: WARNING cinder.quota [None req-242de80d-f2c5-4c9d-b302-893741b2b6c8 tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 02 03:35:12 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-242de80d-f2c5-4c9d-b302-893741b2b6c8 tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Created reservations ['3d0e3995-d64f-4115-aeb3-c572e714980d', '78bf3261-ee37-4755-9bee-e05003c62a7c', '1b4ec2d2-ed8e-43b2-bfca-3deaa48c1f88', '3f7fdbda-ae76-4181-89e4-e33041fe367d'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:35:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-242de80d-f2c5-4c9d-b302-893741b2b6c8 tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-242de80d-f2c5-4c9d-b302-893741b2b6c8 tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:12 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-242de80d-f2c5-4c9d-b302-893741b2b6c8 tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:35:12 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-242de80d-f2c5-4c9d-b302-893741b2b6c8 tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:35:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-242de80d-f2c5-4c9d-b302-893741b2b6c8 tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-242de80d-f2c5-4c9d-b302-893741b2b6c8 tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:12 devstack sudo[104365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:35:12 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:12 devstack sudo[104361]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [req-b99bbe97-bd8b-46d3-a3a2-2de6fb83f8c6 req-fca6c439-1994-43a2-b936-c2a03041591d tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b9b7008e-835f-4c9e-b922-0b0fd89ff866" returned: 0 in 0.725s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [req-b99bbe97-bd8b-46d3-a3a2-2de6fb83f8c6 req-fca6c439-1994-43a2-b936-c2a03041591d tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.746s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:12 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-b99bbe97-bd8b-46d3-a3a2-2de6fb83f8c6 req-fca6c439-1994-43a2-b936-c2a03041591d tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1', 'name': 'volume-b9b7008e-835f-4c9e-b922-0b0fd89ff866', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ba2c99b1-f221-4da6-80b7-74b33f84dc87', 'enforce_multipath': True} {{(pid=86431) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 02 03:35:12 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-b99bbe97-bd8b-46d3-a3a2-2de6fb83f8c6 req-fca6c439-1994-43a2-b936-c2a03041591d tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] attachment_update completed successfully. Jun 02 03:35:13 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-242de80d-f2c5-4c9d-b302-893741b2b6c8 tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.639s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:13 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-242de80d-f2c5-4c9d-b302-893741b2b6c8 tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:35:13 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-242de80d-f2c5-4c9d-b302-893741b2b6c8 tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Deleted volume successfully. Jun 02 03:35:13 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-242de80d-f2c5-4c9d-b302-893741b2b6c8 tempest-VolumeAndVolumeTypeFromImageTest-1803007009 None] Lock "cinder-09cf32db-c439-4803-bade-6b2040c40b83-delete_volume" released by "delete_volume" :: held 2.899s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:35:17 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1c312aa-e86e-4117-a3ad-116441c10be3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:35:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a1c312aa-e86e-4117-a3ad-116441c10be3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Flow 'volume_create_manager' (41a341a6-24e7-4727-87fa-fb64b43b562b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:35:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a1c312aa-e86e-4117-a3ad-116441c10be3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f797b7b-0907-4383-89e2-575586a16a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a1c312aa-e86e-4117-a3ad-116441c10be3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f797b7b-0907-4383-89e2-575586a16a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2006046437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3621d373-4dd7-460c-83d0-42e7fea17d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08ecb36766a44ae59feac281bfe59fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:35:18Z,use_quota=True,user_id='a0db247fd38345568fc11fbfb3047557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a1c312aa-e86e-4117-a3ad-116441c10be3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a6fb46a-aeaa-4041-b00d-58937a6c4484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a1c312aa-e86e-4117-a3ad-116441c10be3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a6fb46a-aeaa-4041-b00d-58937a6c4484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a1c312aa-e86e-4117-a3ad-116441c10be3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edfc2dbf-828d-48ff-b28b-f9d806816137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a1c312aa-e86e-4117-a3ad-116441c10be3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edfc2dbf-828d-48ff-b28b-f9d806816137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3621d373-4dd7-460c-83d0-42e7fea17d5b', 'volume_name': 'volume-3621d373-4dd7-460c-83d0-42e7fea17d5b', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a1c312aa-e86e-4117-a3ad-116441c10be3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (139961e0-10df-43bf-aeba-78064444233c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a1c312aa-e86e-4117-a3ad-116441c10be3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (139961e0-10df-43bf-aeba-78064444233c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a1c312aa-e86e-4117-a3ad-116441c10be3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a85342-2d7c-4da8-a6f3-6fd3142cff76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:17 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-a1c312aa-e86e-4117-a3ad-116441c10be3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Volume 3621d373-4dd7-460c-83d0-42e7fea17d5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3621d373-4dd7-460c-83d0-42e7fea17d5b', 'volume_size': 1} Jun 02 03:35:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a1c312aa-e86e-4117-a3ad-116441c10be3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a1c312aa-e86e-4117-a3ad-116441c10be3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:17 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a1c312aa-e86e-4117-a3ad-116441c10be3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2006046437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3621d373-4dd7-460c-83d0-42e7fea17d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08ecb36766a44ae59feac281bfe59fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:35:18Z,use_quota=True,user_id='a0db247fd38345568fc11fbfb3047557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:35:17 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-a1c312aa-e86e-4117-a3ad-116441c10be3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Creating volume 3621d373-4dd7-460c-83d0-42e7fea17d5b {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:35:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a1c312aa-e86e-4117-a3ad-116441c10be3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a1c312aa-e86e-4117-a3ad-116441c10be3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:17 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a1c312aa-e86e-4117-a3ad-116441c10be3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:35:17 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a1c312aa-e86e-4117-a3ad-116441c10be3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:35:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a1c312aa-e86e-4117-a3ad-116441c10be3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:17 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a1c312aa-e86e-4117-a3ad-116441c10be3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:35:17 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-a1c312aa-e86e-4117-a3ad-116441c10be3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:35:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a1c312aa-e86e-4117-a3ad-116441c10be3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3621d373-4dd7-460c-83d0-42e7fea17d5b 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:17 devstack sudo[104762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3621d373-4dd7-460c-83d0-42e7fea17d5b 1073741824 Jun 02 03:35:17 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:18 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a1c312aa-e86e-4117-a3ad-116441c10be3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3621d373-4dd7-460c-83d0-42e7fea17d5b 1073741824" returned: 0 in 0.787s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a1c312aa-e86e-4117-a3ad-116441c10be3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3621d373-4dd7-460c-83d0-42e7fea17d5b {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:18 devstack sudo[104768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3621d373-4dd7-460c-83d0-42e7fea17d5b Jun 02 03:35:18 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:19 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a1c312aa-e86e-4117-a3ad-116441c10be3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3621d373-4dd7-460c-83d0-42e7fea17d5b" returned: 0 in 0.593s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:19 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a1c312aa-e86e-4117-a3ad-116441c10be3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] <== create_volume: return (1420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:35:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a1c312aa-e86e-4117-a3ad-116441c10be3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a1c312aa-e86e-4117-a3ad-116441c10be3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a85342-2d7c-4da8-a6f3-6fd3142cff76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3621d373-4dd7-460c-83d0-42e7fea17d5b', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a1c312aa-e86e-4117-a3ad-116441c10be3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe166e9-b3f7-40b7-a4eb-dcfa72ea973f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:19 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-a1c312aa-e86e-4117-a3ad-116441c10be3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Volume volume-3621d373-4dd7-460c-83d0-42e7fea17d5b (3621d373-4dd7-460c-83d0-42e7fea17d5b): created successfully Jun 02 03:35:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a1c312aa-e86e-4117-a3ad-116441c10be3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe166e9-b3f7-40b7-a4eb-dcfa72ea973f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a1c312aa-e86e-4117-a3ad-116441c10be3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Flow 'volume_create_manager' (41a341a6-24e7-4727-87fa-fb64b43b562b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:35:19 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-a1c312aa-e86e-4117-a3ad-116441c10be3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Created volume successfully. Jun 02 03:35:19 devstack cinder-volume[86431]: INFO cinder.volume.manager [req-07c17252-d276-4b79-b9b3-26449521d3dc req-864d3d2f-64c8-4ab9-9138-079de8c89f68 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Terminate volume connection completed successfully. Jun 02 03:35:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [req-07c17252-d276-4b79-b9b3-26449521d3dc req-864d3d2f-64c8-4ab9-9138-079de8c89f68 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Deleting attachment ba2c99b1-f221-4da6-80b7-74b33f84dc87. {{(pid=86431) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 02 03:35:20 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbdfb700-6754-4cce-b629-2ece9fbb358b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:35:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fbdfb700-6754-4cce-b629-2ece9fbb358b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Flow 'volume_create_manager' (78ef660c-9aa5-42b8-a23a-58886ad93379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:35:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fbdfb700-6754-4cce-b629-2ece9fbb358b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f9758d2-9ba4-46ee-a54e-0f6eb250dd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fbdfb700-6754-4cce-b629-2ece9fbb358b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f9758d2-9ba4-46ee-a54e-0f6eb250dd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-646909359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c66a2b8c-3347-416e-bcd3-a7d80f9a8117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08ecb36766a44ae59feac281bfe59fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:35:20Z,use_quota=True,user_id='a0db247fd38345568fc11fbfb3047557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fbdfb700-6754-4cce-b629-2ece9fbb358b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1b63ad5-69cf-414b-8d11-99ddcda8f435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fbdfb700-6754-4cce-b629-2ece9fbb358b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1b63ad5-69cf-414b-8d11-99ddcda8f435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fbdfb700-6754-4cce-b629-2ece9fbb358b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90378440-2883-4ec6-b191-ba10ec3f4575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fbdfb700-6754-4cce-b629-2ece9fbb358b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90378440-2883-4ec6-b191-ba10ec3f4575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c66a2b8c-3347-416e-bcd3-a7d80f9a8117', 'volume_name': 'volume-c66a2b8c-3347-416e-bcd3-a7d80f9a8117', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fbdfb700-6754-4cce-b629-2ece9fbb358b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1917c2a6-c6f6-49ed-b516-1aed6ec85029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fbdfb700-6754-4cce-b629-2ece9fbb358b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1917c2a6-c6f6-49ed-b516-1aed6ec85029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fbdfb700-6754-4cce-b629-2ece9fbb358b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784a4eb5-3780-43a6-a134-fcd5aaf31d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:20 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-fbdfb700-6754-4cce-b629-2ece9fbb358b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Volume c66a2b8c-3347-416e-bcd3-a7d80f9a8117: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c66a2b8c-3347-416e-bcd3-a7d80f9a8117', 'volume_size': 1} Jun 02 03:35:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fbdfb700-6754-4cce-b629-2ece9fbb358b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fbdfb700-6754-4cce-b629-2ece9fbb358b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-fbdfb700-6754-4cce-b629-2ece9fbb358b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-646909359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c66a2b8c-3347-416e-bcd3-a7d80f9a8117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08ecb36766a44ae59feac281bfe59fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:35:20Z,use_quota=True,user_id='a0db247fd38345568fc11fbfb3047557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:35:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-fbdfb700-6754-4cce-b629-2ece9fbb358b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Creating volume c66a2b8c-3347-416e-bcd3-a7d80f9a8117 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:35:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fbdfb700-6754-4cce-b629-2ece9fbb358b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fbdfb700-6754-4cce-b629-2ece9fbb358b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-fbdfb700-6754-4cce-b629-2ece9fbb358b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:35:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-fbdfb700-6754-4cce-b629-2ece9fbb358b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:35:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fbdfb700-6754-4cce-b629-2ece9fbb358b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-fbdfb700-6754-4cce-b629-2ece9fbb358b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:35:20 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-fbdfb700-6754-4cce-b629-2ece9fbb358b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:35:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fbdfb700-6754-4cce-b629-2ece9fbb358b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c66a2b8c-3347-416e-bcd3-a7d80f9a8117 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:20 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c66a2b8c-3347-416e-bcd3-a7d80f9a8117 1073741824 Jun 02 03:35:20 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:20 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d304c34-349f-4053-93ec-c286150c3df3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:35:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3d304c34-349f-4053-93ec-c286150c3df3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Flow 'volume_create_manager' (e4dd56c3-45d7-432f-a511-6d19d73a4a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:35:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3d304c34-349f-4053-93ec-c286150c3df3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38725ac5-590d-4849-8c66-8c7169b2d119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3d304c34-349f-4053-93ec-c286150c3df3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38725ac5-590d-4849-8c66-8c7169b2d119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-439269207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08f46690-cb35-4b10-a4ad-31b5880d14d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08ecb36766a44ae59feac281bfe59fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:35:21Z,use_quota=True,user_id='a0db247fd38345568fc11fbfb3047557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3d304c34-349f-4053-93ec-c286150c3df3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9ae18e-d606-47fb-9675-2767c0ae6c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3d304c34-349f-4053-93ec-c286150c3df3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9ae18e-d606-47fb-9675-2767c0ae6c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3d304c34-349f-4053-93ec-c286150c3df3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3e566d9-a633-4357-a6c5-b8ca6d6eeca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3d304c34-349f-4053-93ec-c286150c3df3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3e566d9-a633-4357-a6c5-b8ca6d6eeca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08f46690-cb35-4b10-a4ad-31b5880d14d8', 'volume_name': 'volume-08f46690-cb35-4b10-a4ad-31b5880d14d8', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3d304c34-349f-4053-93ec-c286150c3df3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d2474e-2a99-4279-9865-37bb0716108c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3d304c34-349f-4053-93ec-c286150c3df3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d2474e-2a99-4279-9865-37bb0716108c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:20 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3d304c34-349f-4053-93ec-c286150c3df3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ab4d6ed-13db-4dd2-9a0e-93dc7d62a7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:20 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-3d304c34-349f-4053-93ec-c286150c3df3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Volume 08f46690-cb35-4b10-a4ad-31b5880d14d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08f46690-cb35-4b10-a4ad-31b5880d14d8', 'volume_size': 1} Jun 02 03:35:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3d304c34-349f-4053-93ec-c286150c3df3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a509fcf-68ea-44e9-bbb5-e8e7a4016e29 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3a509fcf-68ea-44e9-bbb5-e8e7a4016e29 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Flow 'volume_create_manager' (f402d74e-b8c6-444c-a1d5-82d7f6457608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3a509fcf-68ea-44e9-bbb5-e8e7a4016e29 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2de1a38-419f-4de9-8f34-e7bca7d9f243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3a509fcf-68ea-44e9-bbb5-e8e7a4016e29 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2de1a38-419f-4de9-8f34-e7bca7d9f243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-969866611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd31cd6b-d7ac-4f69-bc5f-6dc1ebe000e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08ecb36766a44ae59feac281bfe59fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:35:21Z,use_quota=True,user_id='a0db247fd38345568fc11fbfb3047557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3a509fcf-68ea-44e9-bbb5-e8e7a4016e29 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff8b0e94-5b85-4dab-af82-1e44a7b9350d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3a509fcf-68ea-44e9-bbb5-e8e7a4016e29 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff8b0e94-5b85-4dab-af82-1e44a7b9350d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3a509fcf-68ea-44e9-bbb5-e8e7a4016e29 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f1dd71-7392-4921-85a8-5b037067e034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3a509fcf-68ea-44e9-bbb5-e8e7a4016e29 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f1dd71-7392-4921-85a8-5b037067e034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd31cd6b-d7ac-4f69-bc5f-6dc1ebe000e4', 'volume_name': 'volume-bd31cd6b-d7ac-4f69-bc5f-6dc1ebe000e4', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3a509fcf-68ea-44e9-bbb5-e8e7a4016e29 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3466fd07-c14b-4e1c-acb8-71ed5caedec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3a509fcf-68ea-44e9-bbb5-e8e7a4016e29 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3466fd07-c14b-4e1c-acb8-71ed5caedec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3a509fcf-68ea-44e9-bbb5-e8e7a4016e29 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccd2abb9-1630-4cd1-a629-5267ebc890c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:21 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-3a509fcf-68ea-44e9-bbb5-e8e7a4016e29 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Volume bd31cd6b-d7ac-4f69-bc5f-6dc1ebe000e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd31cd6b-d7ac-4f69-bc5f-6dc1ebe000e4', 'volume_size': 1} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3a509fcf-68ea-44e9-bbb5-e8e7a4016e29 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:21 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fbdfb700-6754-4cce-b629-2ece9fbb358b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c66a2b8c-3347-416e-bcd3-a7d80f9a8117 1073741824" returned: 0 in 0.880s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fbdfb700-6754-4cce-b629-2ece9fbb358b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c66a2b8c-3347-416e-bcd3-a7d80f9a8117 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:21 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c66a2b8c-3347-416e-bcd3-a7d80f9a8117 Jun 02 03:35:21 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f0fb0f7-f202-4844-b577-f1311f92ca2f tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1f0fb0f7-f202-4844-b577-f1311f92ca2f tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Flow 'volume_create_manager' (93d02e72-3692-4200-a9f8-004438046b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1f0fb0f7-f202-4844-b577-f1311f92ca2f tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b561785-50fd-4910-bb84-73196f6d6f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1f0fb0f7-f202-4844-b577-f1311f92ca2f tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b561785-50fd-4910-bb84-73196f6d6f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1262254545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a26ba1b9-947f-4164-901f-cd9c6c7bd1d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08ecb36766a44ae59feac281bfe59fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:35:21Z,use_quota=True,user_id='a0db247fd38345568fc11fbfb3047557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1f0fb0f7-f202-4844-b577-f1311f92ca2f tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6dbaaa9-03e6-4fdb-be84-0e9b9ae64dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1f0fb0f7-f202-4844-b577-f1311f92ca2f tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6dbaaa9-03e6-4fdb-be84-0e9b9ae64dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1f0fb0f7-f202-4844-b577-f1311f92ca2f tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf4130ca-fd63-406a-ba6c-4a89c3ea79ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1f0fb0f7-f202-4844-b577-f1311f92ca2f tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf4130ca-fd63-406a-ba6c-4a89c3ea79ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a26ba1b9-947f-4164-901f-cd9c6c7bd1d0', 'volume_name': 'volume-a26ba1b9-947f-4164-901f-cd9c6c7bd1d0', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1f0fb0f7-f202-4844-b577-f1311f92ca2f tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c87866d-4ef5-449d-96ce-34283f2a9584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1f0fb0f7-f202-4844-b577-f1311f92ca2f tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c87866d-4ef5-449d-96ce-34283f2a9584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1f0fb0f7-f202-4844-b577-f1311f92ca2f tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07949d27-e710-4c78-99ac-f5c27fc6a561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:21 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-1f0fb0f7-f202-4844-b577-f1311f92ca2f tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Volume a26ba1b9-947f-4164-901f-cd9c6c7bd1d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a26ba1b9-947f-4164-901f-cd9c6c7bd1d0', 'volume_size': 1} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1f0fb0f7-f202-4844-b577-f1311f92ca2f tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b51ca68-252c-4b34-ae97-1c772e9020be tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3b51ca68-252c-4b34-ae97-1c772e9020be tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Flow 'volume_create_manager' (2c0ffb49-9aac-4fd9-b267-e669c0c0bdb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3b51ca68-252c-4b34-ae97-1c772e9020be tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a8bcdb-67e4-4b05-be65-67a4ce85bb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3b51ca68-252c-4b34-ae97-1c772e9020be tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a8bcdb-67e4-4b05-be65-67a4ce85bb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1968827088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1134989e-a42f-4f81-87c4-62e336ec5084,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08ecb36766a44ae59feac281bfe59fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:35:22Z,use_quota=True,user_id='a0db247fd38345568fc11fbfb3047557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3b51ca68-252c-4b34-ae97-1c772e9020be tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81309f80-bf81-4523-b1b9-e5682dde6ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3b51ca68-252c-4b34-ae97-1c772e9020be tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81309f80-bf81-4523-b1b9-e5682dde6ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3b51ca68-252c-4b34-ae97-1c772e9020be tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef51998-3af6-439f-96d4-79c23f3ad858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3b51ca68-252c-4b34-ae97-1c772e9020be tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef51998-3af6-439f-96d4-79c23f3ad858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1134989e-a42f-4f81-87c4-62e336ec5084', 'volume_name': 'volume-1134989e-a42f-4f81-87c4-62e336ec5084', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3b51ca68-252c-4b34-ae97-1c772e9020be tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07113ecf-2096-4371-ae9d-e3bb9ae3e2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3b51ca68-252c-4b34-ae97-1c772e9020be tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07113ecf-2096-4371-ae9d-e3bb9ae3e2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3b51ca68-252c-4b34-ae97-1c772e9020be tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055d39c8-1f5e-4c9f-8c80-66f507d001af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:21 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-3b51ca68-252c-4b34-ae97-1c772e9020be tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Volume 1134989e-a42f-4f81-87c4-62e336ec5084: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1134989e-a42f-4f81-87c4-62e336ec5084', 'volume_size': 1} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3b51ca68-252c-4b34-ae97-1c772e9020be tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-52ace801-b129-4f76-aefd-d078daccfbc2 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Acquiring lock "cinder-b9b7008e-835f-4c9e-b922-0b0fd89ff866-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:35:21 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-52ace801-b129-4f76-aefd-d078daccfbc2 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Lock "cinder-b9b7008e-835f-4c9e-b922-0b0fd89ff866-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:35:22 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fbdfb700-6754-4cce-b629-2ece9fbb358b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c66a2b8c-3347-416e-bcd3-a7d80f9a8117" returned: 0 in 0.680s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:22 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-fbdfb700-6754-4cce-b629-2ece9fbb358b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:35:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fbdfb700-6754-4cce-b629-2ece9fbb358b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3d304c34-349f-4053-93ec-c286150c3df3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.243s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:22 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3d304c34-349f-4053-93ec-c286150c3df3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-439269207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08f46690-cb35-4b10-a4ad-31b5880d14d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08ecb36766a44ae59feac281bfe59fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:35:21Z,use_quota=True,user_id='a0db247fd38345568fc11fbfb3047557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:35:22 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-3d304c34-349f-4053-93ec-c286150c3df3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Creating volume 08f46690-cb35-4b10-a4ad-31b5880d14d8 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:35:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3d304c34-349f-4053-93ec-c286150c3df3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3d304c34-349f-4053-93ec-c286150c3df3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:22 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3d304c34-349f-4053-93ec-c286150c3df3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:35:22 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3d304c34-349f-4053-93ec-c286150c3df3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:35:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3d304c34-349f-4053-93ec-c286150c3df3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:22 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3d304c34-349f-4053-93ec-c286150c3df3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:35:22 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-3d304c34-349f-4053-93ec-c286150c3df3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:35:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3d304c34-349f-4053-93ec-c286150c3df3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-08f46690-cb35-4b10-a4ad-31b5880d14d8 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:22 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-08f46690-cb35-4b10-a4ad-31b5880d14d8 1073741824 Jun 02 03:35:22 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fbdfb700-6754-4cce-b629-2ece9fbb358b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784a4eb5-3780-43a6-a134-fcd5aaf31d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c66a2b8c-3347-416e-bcd3-a7d80f9a8117', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fbdfb700-6754-4cce-b629-2ece9fbb358b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b96959-d07d-4997-8c1f-6939dea5625d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:22 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-52ace801-b129-4f76-aefd-d078daccfbc2 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Acquiring lock "cinder-quobyte-b9b7008e-835f-4c9e-b922-0b0fd89ff866" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:35:22 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-fbdfb700-6754-4cce-b629-2ece9fbb358b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Volume volume-c66a2b8c-3347-416e-bcd3-a7d80f9a8117 (c66a2b8c-3347-416e-bcd3-a7d80f9a8117): created successfully Jun 02 03:35:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fbdfb700-6754-4cce-b629-2ece9fbb358b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b96959-d07d-4997-8c1f-6939dea5625d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:22 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fbdfb700-6754-4cce-b629-2ece9fbb358b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Flow 'volume_create_manager' (78ef660c-9aa5-42b8-a23a-58886ad93379) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:35:22 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-52ace801-b129-4f76-aefd-d078daccfbc2 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Lock "cinder-quobyte-b9b7008e-835f-4c9e-b922-0b0fd89ff866" acquired by "delete_volume" :: waited 0.029s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:35:22 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-fbdfb700-6754-4cce-b629-2ece9fbb358b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Created volume successfully. Jun 02 03:35:22 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[160be02e-3aab-4d08-ae37-8dbecf3d7f17]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:35:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-52ace801-b129-4f76-aefd-d078daccfbc2 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b9b7008e-835f-4c9e-b922-0b0fd89ff866 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:22 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b9b7008e-835f-4c9e-b922-0b0fd89ff866 Jun 02 03:35:22 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:22 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3d304c34-349f-4053-93ec-c286150c3df3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-08f46690-cb35-4b10-a4ad-31b5880d14d8 1073741824" returned: 0 in 0.758s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3d304c34-349f-4053-93ec-c286150c3df3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-08f46690-cb35-4b10-a4ad-31b5880d14d8 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:22 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:22 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-08f46690-cb35-4b10-a4ad-31b5880d14d8 Jun 02 03:35:22 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-52ace801-b129-4f76-aefd-d078daccfbc2 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b9b7008e-835f-4c9e-b922-0b0fd89ff866" returned: 0 in 0.731s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-52ace801-b129-4f76-aefd-d078daccfbc2 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b9b7008e-835f-4c9e-b922-0b0fd89ff866 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:22 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b9b7008e-835f-4c9e-b922-0b0fd89ff866 Jun 02 03:35:22 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:23 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3d304c34-349f-4053-93ec-c286150c3df3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-08f46690-cb35-4b10-a4ad-31b5880d14d8" returned: 0 in 0.589s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:23 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3d304c34-349f-4053-93ec-c286150c3df3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] <== create_volume: return (1398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:35:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3d304c34-349f-4053-93ec-c286150c3df3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3a509fcf-68ea-44e9-bbb5-e8e7a4016e29 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.236s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:23 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3a509fcf-68ea-44e9-bbb5-e8e7a4016e29 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-969866611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd31cd6b-d7ac-4f69-bc5f-6dc1ebe000e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08ecb36766a44ae59feac281bfe59fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:35:21Z,use_quota=True,user_id='a0db247fd38345568fc11fbfb3047557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:35:23 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-3a509fcf-68ea-44e9-bbb5-e8e7a4016e29 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Creating volume bd31cd6b-d7ac-4f69-bc5f-6dc1ebe000e4 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:35:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3a509fcf-68ea-44e9-bbb5-e8e7a4016e29 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3a509fcf-68ea-44e9-bbb5-e8e7a4016e29 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:23 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3a509fcf-68ea-44e9-bbb5-e8e7a4016e29 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:35:23 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3a509fcf-68ea-44e9-bbb5-e8e7a4016e29 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:35:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3a509fcf-68ea-44e9-bbb5-e8e7a4016e29 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:23 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3a509fcf-68ea-44e9-bbb5-e8e7a4016e29 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:35:23 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-3a509fcf-68ea-44e9-bbb5-e8e7a4016e29 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:35:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3a509fcf-68ea-44e9-bbb5-e8e7a4016e29 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bd31cd6b-d7ac-4f69-bc5f-6dc1ebe000e4 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:23 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3d304c34-349f-4053-93ec-c286150c3df3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ab4d6ed-13db-4dd2-9a0e-93dc7d62a7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08f46690-cb35-4b10-a4ad-31b5880d14d8', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:23 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3d304c34-349f-4053-93ec-c286150c3df3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cabe4f5b-23a3-446f-b474-15ac90910944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:23 devstack sudo[104825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bd31cd6b-d7ac-4f69-bc5f-6dc1ebe000e4 1073741824 Jun 02 03:35:23 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:23 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-52ace801-b129-4f76-aefd-d078daccfbc2 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b9b7008e-835f-4c9e-b922-0b0fd89ff866" returned: 0 in 0.597s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:23 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-52ace801-b129-4f76-aefd-d078daccfbc2 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Lock "cinder-quobyte-b9b7008e-835f-4c9e-b922-0b0fd89ff866" released by "delete_volume" :: held 1.376s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:35:23 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-3d304c34-349f-4053-93ec-c286150c3df3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Volume volume-08f46690-cb35-4b10-a4ad-31b5880d14d8 (08f46690-cb35-4b10-a4ad-31b5880d14d8): created successfully Jun 02 03:35:23 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3d304c34-349f-4053-93ec-c286150c3df3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cabe4f5b-23a3-446f-b474-15ac90910944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:23 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3d304c34-349f-4053-93ec-c286150c3df3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Flow 'volume_create_manager' (e4dd56c3-45d7-432f-a511-6d19d73a4a56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:35:23 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-3d304c34-349f-4053-93ec-c286150c3df3 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Created volume successfully. Jun 02 03:35:23 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-52ace801-b129-4f76-aefd-d078daccfbc2 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Created reservations ['6f97da84-f2cd-4af1-ac32-03a87a224918', 'b30b43ce-f38c-4781-9801-8bd8bd5d76e2', 'ae7659c0-65b2-43a8-8f98-fa23a5dc03d8', '6351f74f-9e55-4ade-a3b5-2e3424a572ae'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:35:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-52ace801-b129-4f76-aefd-d078daccfbc2 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-52ace801-b129-4f76-aefd-d078daccfbc2 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:23 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-52ace801-b129-4f76-aefd-d078daccfbc2 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:35:23 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-52ace801-b129-4f76-aefd-d078daccfbc2 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:35:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-52ace801-b129-4f76-aefd-d078daccfbc2 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-52ace801-b129-4f76-aefd-d078daccfbc2 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:23 devstack sudo[104827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:35:23 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:24 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-52ace801-b129-4f76-aefd-d078daccfbc2 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.640s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:24 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-52ace801-b129-4f76-aefd-d078daccfbc2 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:35:24 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-52ace801-b129-4f76-aefd-d078daccfbc2 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Deleted volume successfully. Jun 02 03:35:24 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3a509fcf-68ea-44e9-bbb5-e8e7a4016e29 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bd31cd6b-d7ac-4f69-bc5f-6dc1ebe000e4 1073741824" returned: 0 in 0.826s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:24 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-52ace801-b129-4f76-aefd-d078daccfbc2 tempest-TestServerVolumeAttachScenarioOldVersion-1411245805 None] Lock "cinder-b9b7008e-835f-4c9e-b922-0b0fd89ff866-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:35:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3a509fcf-68ea-44e9-bbb5-e8e7a4016e29 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bd31cd6b-d7ac-4f69-bc5f-6dc1ebe000e4 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:24 devstack sudo[104833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bd31cd6b-d7ac-4f69-bc5f-6dc1ebe000e4 Jun 02 03:35:24 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:24 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3a509fcf-68ea-44e9-bbb5-e8e7a4016e29 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bd31cd6b-d7ac-4f69-bc5f-6dc1ebe000e4" returned: 0 in 0.595s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:24 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3a509fcf-68ea-44e9-bbb5-e8e7a4016e29 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:35:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3a509fcf-68ea-44e9-bbb5-e8e7a4016e29 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1f0fb0f7-f202-4844-b577-f1311f92ca2f tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.354s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:24 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-1f0fb0f7-f202-4844-b577-f1311f92ca2f tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1262254545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a26ba1b9-947f-4164-901f-cd9c6c7bd1d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08ecb36766a44ae59feac281bfe59fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:35:21Z,use_quota=True,user_id='a0db247fd38345568fc11fbfb3047557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:35:24 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-1f0fb0f7-f202-4844-b577-f1311f92ca2f tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Creating volume a26ba1b9-947f-4164-901f-cd9c6c7bd1d0 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:35:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1f0fb0f7-f202-4844-b577-f1311f92ca2f tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1f0fb0f7-f202-4844-b577-f1311f92ca2f tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:24 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-1f0fb0f7-f202-4844-b577-f1311f92ca2f tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:35:24 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-1f0fb0f7-f202-4844-b577-f1311f92ca2f tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:35:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1f0fb0f7-f202-4844-b577-f1311f92ca2f tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:24 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-1f0fb0f7-f202-4844-b577-f1311f92ca2f tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:35:24 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-1f0fb0f7-f202-4844-b577-f1311f92ca2f tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:35:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1f0fb0f7-f202-4844-b577-f1311f92ca2f tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a26ba1b9-947f-4164-901f-cd9c6c7bd1d0 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:24 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a26ba1b9-947f-4164-901f-cd9c6c7bd1d0 1073741824 Jun 02 03:35:24 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:24 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3a509fcf-68ea-44e9-bbb5-e8e7a4016e29 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccd2abb9-1630-4cd1-a629-5267ebc890c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd31cd6b-d7ac-4f69-bc5f-6dc1ebe000e4', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:24 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3a509fcf-68ea-44e9-bbb5-e8e7a4016e29 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07fd681e-056a-4224-8ec2-d7eb968f3604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:24 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-3a509fcf-68ea-44e9-bbb5-e8e7a4016e29 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Volume volume-bd31cd6b-d7ac-4f69-bc5f-6dc1ebe000e4 (bd31cd6b-d7ac-4f69-bc5f-6dc1ebe000e4): created successfully Jun 02 03:35:24 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3a509fcf-68ea-44e9-bbb5-e8e7a4016e29 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07fd681e-056a-4224-8ec2-d7eb968f3604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:24 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3a509fcf-68ea-44e9-bbb5-e8e7a4016e29 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Flow 'volume_create_manager' (f402d74e-b8c6-444c-a1d5-82d7f6457608) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:35:24 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-3a509fcf-68ea-44e9-bbb5-e8e7a4016e29 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Created volume successfully. Jun 02 03:35:25 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1f0fb0f7-f202-4844-b577-f1311f92ca2f tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a26ba1b9-947f-4164-901f-cd9c6c7bd1d0 1073741824" returned: 0 in 0.798s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1f0fb0f7-f202-4844-b577-f1311f92ca2f tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a26ba1b9-947f-4164-901f-cd9c6c7bd1d0 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:25 devstack sudo[104856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a26ba1b9-947f-4164-901f-cd9c6c7bd1d0 Jun 02 03:35:25 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:26 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1f0fb0f7-f202-4844-b577-f1311f92ca2f tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a26ba1b9-947f-4164-901f-cd9c6c7bd1d0" returned: 0 in 0.926s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:26 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-1f0fb0f7-f202-4844-b577-f1311f92ca2f tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] <== create_volume: return (1792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:35:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1f0fb0f7-f202-4844-b577-f1311f92ca2f tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3b51ca68-252c-4b34-ae97-1c772e9020be tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.776s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:26 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3b51ca68-252c-4b34-ae97-1c772e9020be tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1968827088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1134989e-a42f-4f81-87c4-62e336ec5084,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08ecb36766a44ae59feac281bfe59fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:35:22Z,use_quota=True,user_id='a0db247fd38345568fc11fbfb3047557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:35:26 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-3b51ca68-252c-4b34-ae97-1c772e9020be tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Creating volume 1134989e-a42f-4f81-87c4-62e336ec5084 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:35:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3b51ca68-252c-4b34-ae97-1c772e9020be tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3b51ca68-252c-4b34-ae97-1c772e9020be tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:26 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3b51ca68-252c-4b34-ae97-1c772e9020be tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:35:26 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3b51ca68-252c-4b34-ae97-1c772e9020be tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:35:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3b51ca68-252c-4b34-ae97-1c772e9020be tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:26 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3b51ca68-252c-4b34-ae97-1c772e9020be tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:35:26 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-3b51ca68-252c-4b34-ae97-1c772e9020be tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:35:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3b51ca68-252c-4b34-ae97-1c772e9020be tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1134989e-a42f-4f81-87c4-62e336ec5084 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1f0fb0f7-f202-4844-b577-f1311f92ca2f tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07949d27-e710-4c78-99ac-f5c27fc6a561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a26ba1b9-947f-4164-901f-cd9c6c7bd1d0', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:26 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1134989e-a42f-4f81-87c4-62e336ec5084 1073741824 Jun 02 03:35:26 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1f0fb0f7-f202-4844-b577-f1311f92ca2f tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee21bbc4-62f7-4768-a33b-f51b967929a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:26 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-1f0fb0f7-f202-4844-b577-f1311f92ca2f tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Volume volume-a26ba1b9-947f-4164-901f-cd9c6c7bd1d0 (a26ba1b9-947f-4164-901f-cd9c6c7bd1d0): created successfully Jun 02 03:35:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1f0fb0f7-f202-4844-b577-f1311f92ca2f tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee21bbc4-62f7-4768-a33b-f51b967929a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-1f0fb0f7-f202-4844-b577-f1311f92ca2f tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Flow 'volume_create_manager' (93d02e72-3692-4200-a9f8-004438046b49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:35:26 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-1f0fb0f7-f202-4844-b577-f1311f92ca2f tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Created volume successfully. Jun 02 03:35:27 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3b51ca68-252c-4b34-ae97-1c772e9020be tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1134989e-a42f-4f81-87c4-62e336ec5084 1073741824" returned: 0 in 0.999s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3b51ca68-252c-4b34-ae97-1c772e9020be tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1134989e-a42f-4f81-87c4-62e336ec5084 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:27 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1134989e-a42f-4f81-87c4-62e336ec5084 Jun 02 03:35:27 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:28 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3b51ca68-252c-4b34-ae97-1c772e9020be tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1134989e-a42f-4f81-87c4-62e336ec5084" returned: 0 in 0.672s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:28 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3b51ca68-252c-4b34-ae97-1c772e9020be tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:35:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3b51ca68-252c-4b34-ae97-1c772e9020be tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:28 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3b51ca68-252c-4b34-ae97-1c772e9020be tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055d39c8-1f5e-4c9f-8c80-66f507d001af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1134989e-a42f-4f81-87c4-62e336ec5084', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:28 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3b51ca68-252c-4b34-ae97-1c772e9020be tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2b6dc60-a5e9-4dac-b5da-965806d34602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:28 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-3b51ca68-252c-4b34-ae97-1c772e9020be tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Volume volume-1134989e-a42f-4f81-87c4-62e336ec5084 (1134989e-a42f-4f81-87c4-62e336ec5084): created successfully Jun 02 03:35:28 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3b51ca68-252c-4b34-ae97-1c772e9020be tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2b6dc60-a5e9-4dac-b5da-965806d34602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:28 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-3b51ca68-252c-4b34-ae97-1c772e9020be tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Flow 'volume_create_manager' (2c0ffb49-9aac-4fd9-b267-e669c0c0bdb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:35:28 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-3b51ca68-252c-4b34-ae97-1c772e9020be tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Created volume successfully. Jun 02 03:35:29 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d4d1aa93-046a-48b8-ac79-cb19e60c376a tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Acquiring lock "cinder-1134989e-a42f-4f81-87c4-62e336ec5084-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:35:29 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d4d1aa93-046a-48b8-ac79-cb19e60c376a tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "cinder-1134989e-a42f-4f81-87c4-62e336ec5084-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:35:29 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d4d1aa93-046a-48b8-ac79-cb19e60c376a tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Acquiring lock "cinder-quobyte-1134989e-a42f-4f81-87c4-62e336ec5084" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:35:29 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d4d1aa93-046a-48b8-ac79-cb19e60c376a tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "cinder-quobyte-1134989e-a42f-4f81-87c4-62e336ec5084" acquired by "delete_volume" :: waited 0.022s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:35:29 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[0654f40d-db3e-4cd9-864e-5c7d3ac195de]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:35:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d4d1aa93-046a-48b8-ac79-cb19e60c376a tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1134989e-a42f-4f81-87c4-62e336ec5084 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:29 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1134989e-a42f-4f81-87c4-62e336ec5084 Jun 02 03:35:29 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:30 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d4d1aa93-046a-48b8-ac79-cb19e60c376a tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1134989e-a42f-4f81-87c4-62e336ec5084" returned: 0 in 0.695s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d4d1aa93-046a-48b8-ac79-cb19e60c376a tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1134989e-a42f-4f81-87c4-62e336ec5084 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:30 devstack sudo[104994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1134989e-a42f-4f81-87c4-62e336ec5084 Jun 02 03:35:30 devstack sudo[104994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:30 devstack sudo[104994]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d4d1aa93-046a-48b8-ac79-cb19e60c376a tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1134989e-a42f-4f81-87c4-62e336ec5084" returned: 0 in 0.586s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:31 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d4d1aa93-046a-48b8-ac79-cb19e60c376a tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "cinder-quobyte-1134989e-a42f-4f81-87c4-62e336ec5084" released by "delete_volume" :: held 1.323s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:35:31 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-d4d1aa93-046a-48b8-ac79-cb19e60c376a tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Created reservations ['e244d8d5-e5a5-444f-ae90-ac57f8c4b0fe', '5604f0a1-13bb-4d35-b78e-e8523a121084', '52812278-18d1-4db6-8eee-1b1d967b8bde', 'f002ad90-b56f-410e-8aee-152b9152f61f'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:35:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d4d1aa93-046a-48b8-ac79-cb19e60c376a tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d4d1aa93-046a-48b8-ac79-cb19e60c376a tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:31 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-d4d1aa93-046a-48b8-ac79-cb19e60c376a tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:35:31 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-d4d1aa93-046a-48b8-ac79-cb19e60c376a tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:35:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d4d1aa93-046a-48b8-ac79-cb19e60c376a tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d4d1aa93-046a-48b8-ac79-cb19e60c376a tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:31 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:35:31 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:31 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d4d1aa93-046a-48b8-ac79-cb19e60c376a tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.579s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:31 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-d4d1aa93-046a-48b8-ac79-cb19e60c376a tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:35:31 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-d4d1aa93-046a-48b8-ac79-cb19e60c376a tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Deleted volume successfully. Jun 02 03:35:31 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-d4d1aa93-046a-48b8-ac79-cb19e60c376a tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "cinder-1134989e-a42f-4f81-87c4-62e336ec5084-delete_volume" released by "delete_volume" :: held 2.120s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:35:31 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-381a4543-8d88-49fb-98fe-ee122480ea8b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Acquiring lock "cinder-a26ba1b9-947f-4164-901f-cd9c6c7bd1d0-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:35:31 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-381a4543-8d88-49fb-98fe-ee122480ea8b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "cinder-a26ba1b9-947f-4164-901f-cd9c6c7bd1d0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:35:31 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-381a4543-8d88-49fb-98fe-ee122480ea8b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Acquiring lock "cinder-quobyte-a26ba1b9-947f-4164-901f-cd9c6c7bd1d0" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:35:31 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-381a4543-8d88-49fb-98fe-ee122480ea8b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "cinder-quobyte-a26ba1b9-947f-4164-901f-cd9c6c7bd1d0" acquired by "delete_volume" :: waited 0.016s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:35:31 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29847df-b15e-4d0e-a6fa-6341b9926c7c]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:35:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-381a4543-8d88-49fb-98fe-ee122480ea8b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a26ba1b9-947f-4164-901f-cd9c6c7bd1d0 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:32 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a26ba1b9-947f-4164-901f-cd9c6c7bd1d0 Jun 02 03:35:32 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:32 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-381a4543-8d88-49fb-98fe-ee122480ea8b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a26ba1b9-947f-4164-901f-cd9c6c7bd1d0" returned: 0 in 0.724s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-381a4543-8d88-49fb-98fe-ee122480ea8b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a26ba1b9-947f-4164-901f-cd9c6c7bd1d0 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:32 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a26ba1b9-947f-4164-901f-cd9c6c7bd1d0 Jun 02 03:35:32 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:33 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-381a4543-8d88-49fb-98fe-ee122480ea8b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a26ba1b9-947f-4164-901f-cd9c6c7bd1d0" returned: 0 in 0.607s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:33 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-381a4543-8d88-49fb-98fe-ee122480ea8b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "cinder-quobyte-a26ba1b9-947f-4164-901f-cd9c6c7bd1d0" released by "delete_volume" :: held 1.375s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:35:33 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-381a4543-8d88-49fb-98fe-ee122480ea8b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Created reservations ['c5301c23-f830-4ebb-b36b-8ee04a35a9a4', '73be4b81-acbf-46b4-8c4a-e8cbefedc036', '9e069d19-4779-4b36-a268-3dd98b78b150', '1b078406-d8bd-4a63-b482-c8ff758fff70'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:35:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-381a4543-8d88-49fb-98fe-ee122480ea8b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-381a4543-8d88-49fb-98fe-ee122480ea8b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:33 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-381a4543-8d88-49fb-98fe-ee122480ea8b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:35:33 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-381a4543-8d88-49fb-98fe-ee122480ea8b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:35:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-381a4543-8d88-49fb-98fe-ee122480ea8b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-381a4543-8d88-49fb-98fe-ee122480ea8b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:33 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:35:33 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:33 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-381a4543-8d88-49fb-98fe-ee122480ea8b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.619s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:33 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-381a4543-8d88-49fb-98fe-ee122480ea8b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:35:33 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-381a4543-8d88-49fb-98fe-ee122480ea8b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Deleted volume successfully. Jun 02 03:35:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-381a4543-8d88-49fb-98fe-ee122480ea8b tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "cinder-a26ba1b9-947f-4164-901f-cd9c6c7bd1d0-delete_volume" released by "delete_volume" :: held 2.196s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:35:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e305c603-c1d7-4263-8a78-ec9e2a49a620 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Acquiring lock "cinder-bd31cd6b-d7ac-4f69-bc5f-6dc1ebe000e4-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:35:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e305c603-c1d7-4263-8a78-ec9e2a49a620 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "cinder-bd31cd6b-d7ac-4f69-bc5f-6dc1ebe000e4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:35:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e305c603-c1d7-4263-8a78-ec9e2a49a620 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Acquiring lock "cinder-quobyte-bd31cd6b-d7ac-4f69-bc5f-6dc1ebe000e4" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:35:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e305c603-c1d7-4263-8a78-ec9e2a49a620 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "cinder-quobyte-bd31cd6b-d7ac-4f69-bc5f-6dc1ebe000e4" acquired by "delete_volume" :: waited 0.020s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:35:34 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[14632ae2-727f-40c1-8ae9-b3a90e974f77]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:35:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e305c603-c1d7-4263-8a78-ec9e2a49a620 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bd31cd6b-d7ac-4f69-bc5f-6dc1ebe000e4 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:34 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bd31cd6b-d7ac-4f69-bc5f-6dc1ebe000e4 Jun 02 03:35:34 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:34 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e305c603-c1d7-4263-8a78-ec9e2a49a620 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bd31cd6b-d7ac-4f69-bc5f-6dc1ebe000e4" returned: 0 in 0.733s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e305c603-c1d7-4263-8a78-ec9e2a49a620 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bd31cd6b-d7ac-4f69-bc5f-6dc1ebe000e4 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:34 devstack sudo[105018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bd31cd6b-d7ac-4f69-bc5f-6dc1ebe000e4 Jun 02 03:35:34 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:35 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e305c603-c1d7-4263-8a78-ec9e2a49a620 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bd31cd6b-d7ac-4f69-bc5f-6dc1ebe000e4" returned: 0 in 0.654s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:35 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e305c603-c1d7-4263-8a78-ec9e2a49a620 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "cinder-quobyte-bd31cd6b-d7ac-4f69-bc5f-6dc1ebe000e4" released by "delete_volume" :: held 1.441s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:35:35 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-e305c603-c1d7-4263-8a78-ec9e2a49a620 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Created reservations ['f018941d-b891-4032-b165-447818559808', 'f83204f2-e306-40bf-befc-be5da433dd7d', 'e9d001c9-2abd-4471-825f-ca7738b07cb6', '90b8d3fb-0434-4bab-a890-e9bad6018544'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:35:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e305c603-c1d7-4263-8a78-ec9e2a49a620 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e305c603-c1d7-4263-8a78-ec9e2a49a620 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:35 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e305c603-c1d7-4263-8a78-ec9e2a49a620 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:35:35 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e305c603-c1d7-4263-8a78-ec9e2a49a620 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:35:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e305c603-c1d7-4263-8a78-ec9e2a49a620 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e305c603-c1d7-4263-8a78-ec9e2a49a620 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:35 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:35:35 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:36 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e305c603-c1d7-4263-8a78-ec9e2a49a620 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.632s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:36 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-e305c603-c1d7-4263-8a78-ec9e2a49a620 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:35:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4bfd15a0-6b38-40d7-a1d5-2ecf9172aee1 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Acquiring lock "cinder-08f46690-cb35-4b10-a4ad-31b5880d14d8-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:35:36 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-e305c603-c1d7-4263-8a78-ec9e2a49a620 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Deleted volume successfully. Jun 02 03:35:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4bfd15a0-6b38-40d7-a1d5-2ecf9172aee1 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "cinder-08f46690-cb35-4b10-a4ad-31b5880d14d8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:35:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e305c603-c1d7-4263-8a78-ec9e2a49a620 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "cinder-bd31cd6b-d7ac-4f69-bc5f-6dc1ebe000e4-delete_volume" released by "delete_volume" :: held 2.308s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:35:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4bfd15a0-6b38-40d7-a1d5-2ecf9172aee1 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Acquiring lock "cinder-quobyte-08f46690-cb35-4b10-a4ad-31b5880d14d8" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:35:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4bfd15a0-6b38-40d7-a1d5-2ecf9172aee1 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "cinder-quobyte-08f46690-cb35-4b10-a4ad-31b5880d14d8" acquired by "delete_volume" :: waited 0.014s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:35:36 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[efeec289-02f9-4b50-83a0-654414c49b92]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:35:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4bfd15a0-6b38-40d7-a1d5-2ecf9172aee1 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-08f46690-cb35-4b10-a4ad-31b5880d14d8 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:36 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-08f46690-cb35-4b10-a4ad-31b5880d14d8 Jun 02 03:35:36 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:37 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4bfd15a0-6b38-40d7-a1d5-2ecf9172aee1 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-08f46690-cb35-4b10-a4ad-31b5880d14d8" returned: 0 in 0.729s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4bfd15a0-6b38-40d7-a1d5-2ecf9172aee1 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-08f46690-cb35-4b10-a4ad-31b5880d14d8 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:37 devstack sudo[105030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-08f46690-cb35-4b10-a4ad-31b5880d14d8 Jun 02 03:35:37 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:37 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4bfd15a0-6b38-40d7-a1d5-2ecf9172aee1 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-08f46690-cb35-4b10-a4ad-31b5880d14d8" returned: 0 in 0.640s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:37 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4bfd15a0-6b38-40d7-a1d5-2ecf9172aee1 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "cinder-quobyte-08f46690-cb35-4b10-a4ad-31b5880d14d8" released by "delete_volume" :: held 1.412s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:35:37 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-4bfd15a0-6b38-40d7-a1d5-2ecf9172aee1 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Created reservations ['2508fcd8-f83d-427f-9c5d-b5c2d2382e45', 'c48a507d-221f-43b5-821d-06f889d3a364', 'c5ce0081-4981-4bba-b48e-78c4b379e66b', '4d585dca-167b-4803-a527-2653ebec6f7a'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:35:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4bfd15a0-6b38-40d7-a1d5-2ecf9172aee1 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4bfd15a0-6b38-40d7-a1d5-2ecf9172aee1 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:37 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-4bfd15a0-6b38-40d7-a1d5-2ecf9172aee1 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:35:37 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-4bfd15a0-6b38-40d7-a1d5-2ecf9172aee1 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:35:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4bfd15a0-6b38-40d7-a1d5-2ecf9172aee1 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4bfd15a0-6b38-40d7-a1d5-2ecf9172aee1 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:37 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:35:37 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:38 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4bfd15a0-6b38-40d7-a1d5-2ecf9172aee1 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.613s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:38 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-4bfd15a0-6b38-40d7-a1d5-2ecf9172aee1 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:35:38 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-4bfd15a0-6b38-40d7-a1d5-2ecf9172aee1 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Deleted volume successfully. Jun 02 03:35:38 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-40dc5e07-d9ee-4f46-962f-bbe01db58747 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Acquiring lock "cinder-c66a2b8c-3347-416e-bcd3-a7d80f9a8117-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:35:38 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-40dc5e07-d9ee-4f46-962f-bbe01db58747 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "cinder-c66a2b8c-3347-416e-bcd3-a7d80f9a8117-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:35:38 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-4bfd15a0-6b38-40d7-a1d5-2ecf9172aee1 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "cinder-08f46690-cb35-4b10-a4ad-31b5880d14d8-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:35:38 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-40dc5e07-d9ee-4f46-962f-bbe01db58747 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Acquiring lock "cinder-quobyte-c66a2b8c-3347-416e-bcd3-a7d80f9a8117" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:35:38 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-40dc5e07-d9ee-4f46-962f-bbe01db58747 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "cinder-quobyte-c66a2b8c-3347-416e-bcd3-a7d80f9a8117" acquired by "delete_volume" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:35:38 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[985d0c03-aa0b-4a87-8453-901aef8f3e12]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:35:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-40dc5e07-d9ee-4f46-962f-bbe01db58747 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c66a2b8c-3347-416e-bcd3-a7d80f9a8117 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:38 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c66a2b8c-3347-416e-bcd3-a7d80f9a8117 Jun 02 03:35:38 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:39 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-40dc5e07-d9ee-4f46-962f-bbe01db58747 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c66a2b8c-3347-416e-bcd3-a7d80f9a8117" returned: 0 in 0.793s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-40dc5e07-d9ee-4f46-962f-bbe01db58747 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c66a2b8c-3347-416e-bcd3-a7d80f9a8117 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:39 devstack sudo[105043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c66a2b8c-3347-416e-bcd3-a7d80f9a8117 Jun 02 03:35:39 devstack sudo[105043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:40 devstack sudo[105043]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-40dc5e07-d9ee-4f46-962f-bbe01db58747 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-c66a2b8c-3347-416e-bcd3-a7d80f9a8117" returned: 0 in 0.626s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-40dc5e07-d9ee-4f46-962f-bbe01db58747 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "cinder-quobyte-c66a2b8c-3347-416e-bcd3-a7d80f9a8117" released by "delete_volume" :: held 1.459s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:35:40 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-40dc5e07-d9ee-4f46-962f-bbe01db58747 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Created reservations ['1a04c55b-92c4-4d54-936a-3480da09c1d5', '87264b50-8a2f-4d67-aaf8-f4a8164d2f44', '8e30e072-bcee-42ef-b1a8-c589836d52ab', 'ce24cf35-3c07-4f72-b8ae-2d944bc6ec67'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:35:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-40dc5e07-d9ee-4f46-962f-bbe01db58747 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-40dc5e07-d9ee-4f46-962f-bbe01db58747 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:40 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-40dc5e07-d9ee-4f46-962f-bbe01db58747 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:35:40 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-40dc5e07-d9ee-4f46-962f-bbe01db58747 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:35:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-40dc5e07-d9ee-4f46-962f-bbe01db58747 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-40dc5e07-d9ee-4f46-962f-bbe01db58747 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:40 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:35:40 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-236af3e2-c999-43b3-b114-4d4c96bff831 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Acquiring lock "cinder-3621d373-4dd7-460c-83d0-42e7fea17d5b-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:35:40 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-40dc5e07-d9ee-4f46-962f-bbe01db58747 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.654s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:40 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-40dc5e07-d9ee-4f46-962f-bbe01db58747 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:35:40 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-40dc5e07-d9ee-4f46-962f-bbe01db58747 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Deleted volume successfully. Jun 02 03:35:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-236af3e2-c999-43b3-b114-4d4c96bff831 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "cinder-3621d373-4dd7-460c-83d0-42e7fea17d5b-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:35:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-40dc5e07-d9ee-4f46-962f-bbe01db58747 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "cinder-c66a2b8c-3347-416e-bcd3-a7d80f9a8117-delete_volume" released by "delete_volume" :: held 2.373s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:35:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-236af3e2-c999-43b3-b114-4d4c96bff831 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Acquiring lock "cinder-quobyte-3621d373-4dd7-460c-83d0-42e7fea17d5b" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:35:41 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-236af3e2-c999-43b3-b114-4d4c96bff831 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "cinder-quobyte-3621d373-4dd7-460c-83d0-42e7fea17d5b" acquired by "delete_volume" :: waited 0.024s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:35:41 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[145bb973-566a-4638-8e1b-98aeeb784a7d]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:35:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-236af3e2-c999-43b3-b114-4d4c96bff831 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3621d373-4dd7-460c-83d0-42e7fea17d5b {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:41 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3621d373-4dd7-460c-83d0-42e7fea17d5b Jun 02 03:35:41 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:41 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-236af3e2-c999-43b3-b114-4d4c96bff831 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3621d373-4dd7-460c-83d0-42e7fea17d5b" returned: 0 in 0.713s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-236af3e2-c999-43b3-b114-4d4c96bff831 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3621d373-4dd7-460c-83d0-42e7fea17d5b {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:41 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3621d373-4dd7-460c-83d0-42e7fea17d5b Jun 02 03:35:41 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:42 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-236af3e2-c999-43b3-b114-4d4c96bff831 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3621d373-4dd7-460c-83d0-42e7fea17d5b" returned: 0 in 0.615s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:42 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-236af3e2-c999-43b3-b114-4d4c96bff831 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "cinder-quobyte-3621d373-4dd7-460c-83d0-42e7fea17d5b" released by "delete_volume" :: held 1.380s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:35:42 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-236af3e2-c999-43b3-b114-4d4c96bff831 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Created reservations ['d92267ff-6816-461b-b9de-e1a8d1a83d73', 'f863c9ec-0324-4955-9034-92b41c16d700', '1320a6c8-b97b-4523-a788-d45bb00f240a', '1c958a15-da02-47ef-819e-d8db27685b54'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:35:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-236af3e2-c999-43b3-b114-4d4c96bff831 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-236af3e2-c999-43b3-b114-4d4c96bff831 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:42 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-236af3e2-c999-43b3-b114-4d4c96bff831 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:35:42 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-236af3e2-c999-43b3-b114-4d4c96bff831 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:35:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-236af3e2-c999-43b3-b114-4d4c96bff831 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-236af3e2-c999-43b3-b114-4d4c96bff831 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:42 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:35:42 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:42 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-92fb6609-0f32-47d6-8e6b-4dec3f315075 tempest-CreateVolumesFromImageTest-1606801834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:35:42 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-92fb6609-0f32-47d6-8e6b-4dec3f315075 tempest-CreateVolumesFromImageTest-1606801834 None] Flow 'volume_create_manager' (eb1f9383-3578-41e7-956b-ce84ce4874aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:35:42 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-92fb6609-0f32-47d6-8e6b-4dec3f315075 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9563a9f-974c-4205-b849-6d166c56d441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:42 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-92fb6609-0f32-47d6-8e6b-4dec3f315075 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9563a9f-974c-4205-b849-6d166c56d441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-472646736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01c610fa-71a9-4a63-b25e-fa07387e1668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e8bb7184eb46adbb94cd1dac6a2c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:35:43Z,use_quota=True,user_id='d9edbd06bbb0457d8099c70cbc9b7dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:42 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-92fb6609-0f32-47d6-8e6b-4dec3f315075 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e0e6c3-f8ac-4304-b889-9706500c6e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:42 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-92fb6609-0f32-47d6-8e6b-4dec3f315075 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e0e6c3-f8ac-4304-b889-9706500c6e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:42 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-92fb6609-0f32-47d6-8e6b-4dec3f315075 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7bafe58-d295-4088-a611-31394291cc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:42 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-92fb6609-0f32-47d6-8e6b-4dec3f315075 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7bafe58-d295-4088-a611-31394291cc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01c610fa-71a9-4a63-b25e-fa07387e1668', 'volume_name': 'volume-01c610fa-71a9-4a63-b25e-fa07387e1668', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:42 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-92fb6609-0f32-47d6-8e6b-4dec3f315075 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (536d456a-3204-4a70-8181-3d5ed008032a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:42 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-92fb6609-0f32-47d6-8e6b-4dec3f315075 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (536d456a-3204-4a70-8181-3d5ed008032a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:42 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-92fb6609-0f32-47d6-8e6b-4dec3f315075 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e37f08-7313-432f-b7f7-5936167c6233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:42 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-92fb6609-0f32-47d6-8e6b-4dec3f315075 tempest-CreateVolumesFromImageTest-1606801834 None] Volume 01c610fa-71a9-4a63-b25e-fa07387e1668: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01c610fa-71a9-4a63-b25e-fa07387e1668', 'volume_size': 1} Jun 02 03:35:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-92fb6609-0f32-47d6-8e6b-4dec3f315075 tempest-CreateVolumesFromImageTest-1606801834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-92fb6609-0f32-47d6-8e6b-4dec3f315075 tempest-CreateVolumesFromImageTest-1606801834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:42 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-92fb6609-0f32-47d6-8e6b-4dec3f315075 tempest-CreateVolumesFromImageTest-1606801834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-472646736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01c610fa-71a9-4a63-b25e-fa07387e1668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e8bb7184eb46adbb94cd1dac6a2c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:35:43Z,use_quota=True,user_id='d9edbd06bbb0457d8099c70cbc9b7dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:35:42 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-92fb6609-0f32-47d6-8e6b-4dec3f315075 tempest-CreateVolumesFromImageTest-1606801834 None] Creating volume 01c610fa-71a9-4a63-b25e-fa07387e1668 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:35:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-92fb6609-0f32-47d6-8e6b-4dec3f315075 tempest-CreateVolumesFromImageTest-1606801834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-92fb6609-0f32-47d6-8e6b-4dec3f315075 tempest-CreateVolumesFromImageTest-1606801834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:42 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-92fb6609-0f32-47d6-8e6b-4dec3f315075 tempest-CreateVolumesFromImageTest-1606801834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:35:42 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-92fb6609-0f32-47d6-8e6b-4dec3f315075 tempest-CreateVolumesFromImageTest-1606801834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:35:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-92fb6609-0f32-47d6-8e6b-4dec3f315075 tempest-CreateVolumesFromImageTest-1606801834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:42 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-92fb6609-0f32-47d6-8e6b-4dec3f315075 tempest-CreateVolumesFromImageTest-1606801834 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:35:42 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-92fb6609-0f32-47d6-8e6b-4dec3f315075 tempest-CreateVolumesFromImageTest-1606801834 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:35:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-92fb6609-0f32-47d6-8e6b-4dec3f315075 tempest-CreateVolumesFromImageTest-1606801834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-01c610fa-71a9-4a63-b25e-fa07387e1668 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:42 devstack sudo[105059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-01c610fa-71a9-4a63-b25e-fa07387e1668 1073741824 Jun 02 03:35:42 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:43 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed2ec162-1f94-437b-8f77-a6850b5696cb tempest-CreateVolumesFromImageTest-1606801834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:35:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ed2ec162-1f94-437b-8f77-a6850b5696cb tempest-CreateVolumesFromImageTest-1606801834 None] Flow 'volume_create_manager' (e94da016-e4a6-4ec8-a1b2-44afaef22a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:35:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ed2ec162-1f94-437b-8f77-a6850b5696cb tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ede74a6-6a28-4ab8-ab60-06f5910e24b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ed2ec162-1f94-437b-8f77-a6850b5696cb tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ede74a6-6a28-4ab8-ab60-06f5910e24b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1469103740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=437e480a-e17a-40a5-a42b-242622894232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e8bb7184eb46adbb94cd1dac6a2c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:35:43Z,use_quota=True,user_id='d9edbd06bbb0457d8099c70cbc9b7dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ed2ec162-1f94-437b-8f77-a6850b5696cb tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bc14d0b-fcfc-4411-a7ad-d77a65ddb151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ed2ec162-1f94-437b-8f77-a6850b5696cb tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bc14d0b-fcfc-4411-a7ad-d77a65ddb151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ed2ec162-1f94-437b-8f77-a6850b5696cb tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d4ab71-4f57-4778-9594-125edfde65f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ed2ec162-1f94-437b-8f77-a6850b5696cb tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d4ab71-4f57-4778-9594-125edfde65f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '437e480a-e17a-40a5-a42b-242622894232', 'volume_name': 'volume-437e480a-e17a-40a5-a42b-242622894232', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ed2ec162-1f94-437b-8f77-a6850b5696cb tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01b1780-f778-4309-ad06-3731eee3ee8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ed2ec162-1f94-437b-8f77-a6850b5696cb tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01b1780-f778-4309-ad06-3731eee3ee8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ed2ec162-1f94-437b-8f77-a6850b5696cb tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d614ae52-09f9-42b2-9cb6-34c5179a7321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:43 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-ed2ec162-1f94-437b-8f77-a6850b5696cb tempest-CreateVolumesFromImageTest-1606801834 None] Volume 437e480a-e17a-40a5-a42b-242622894232: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-437e480a-e17a-40a5-a42b-242622894232', 'volume_size': 1} Jun 02 03:35:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ed2ec162-1f94-437b-8f77-a6850b5696cb tempest-CreateVolumesFromImageTest-1606801834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:43 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-236af3e2-c999-43b3-b114-4d4c96bff831 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.818s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:43 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-236af3e2-c999-43b3-b114-4d4c96bff831 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:35:43 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-236af3e2-c999-43b3-b114-4d4c96bff831 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Deleted volume successfully. Jun 02 03:35:43 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-236af3e2-c999-43b3-b114-4d4c96bff831 tempest-CreateVolumesFromSourceVolumeTest-1215048337 None] Lock "cinder-3621d373-4dd7-460c-83d0-42e7fea17d5b-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:35:43 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-edd44762-2812-4c23-bc62-0d68793466a5 tempest-CreateVolumesFromImageTest-1606801834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:35:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-edd44762-2812-4c23-bc62-0d68793466a5 tempest-CreateVolumesFromImageTest-1606801834 None] Flow 'volume_create_manager' (6a384410-739c-4be0-a51c-1597805fc015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:35:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-edd44762-2812-4c23-bc62-0d68793466a5 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acaeb268-f2b7-40a1-a480-9d4e924c6b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-edd44762-2812-4c23-bc62-0d68793466a5 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acaeb268-f2b7-40a1-a480-9d4e924c6b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1512053774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=439193e9-8e9e-45e3-a565-59a07485bfb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e8bb7184eb46adbb94cd1dac6a2c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:35:43Z,use_quota=True,user_id='d9edbd06bbb0457d8099c70cbc9b7dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-edd44762-2812-4c23-bc62-0d68793466a5 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8226f939-c43c-4d23-8cb9-811a5e3a6358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-edd44762-2812-4c23-bc62-0d68793466a5 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8226f939-c43c-4d23-8cb9-811a5e3a6358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-edd44762-2812-4c23-bc62-0d68793466a5 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93a71d12-f8d9-456e-aef1-bec4122724ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-edd44762-2812-4c23-bc62-0d68793466a5 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93a71d12-f8d9-456e-aef1-bec4122724ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '439193e9-8e9e-45e3-a565-59a07485bfb4', 'volume_name': 'volume-439193e9-8e9e-45e3-a565-59a07485bfb4', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-edd44762-2812-4c23-bc62-0d68793466a5 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85b0caf-f9aa-41da-9c1e-5d2d4ba006d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-edd44762-2812-4c23-bc62-0d68793466a5 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85b0caf-f9aa-41da-9c1e-5d2d4ba006d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-edd44762-2812-4c23-bc62-0d68793466a5 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e44a9045-9b16-40f0-94d7-45ea27b1000b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:43 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-edd44762-2812-4c23-bc62-0d68793466a5 tempest-CreateVolumesFromImageTest-1606801834 None] Volume 439193e9-8e9e-45e3-a565-59a07485bfb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-439193e9-8e9e-45e3-a565-59a07485bfb4', 'volume_size': 1} Jun 02 03:35:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-edd44762-2812-4c23-bc62-0d68793466a5 tempest-CreateVolumesFromImageTest-1606801834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:43 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-92fb6609-0f32-47d6-8e6b-4dec3f315075 tempest-CreateVolumesFromImageTest-1606801834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-01c610fa-71a9-4a63-b25e-fa07387e1668 1073741824" returned: 0 in 1.063s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-92fb6609-0f32-47d6-8e6b-4dec3f315075 tempest-CreateVolumesFromImageTest-1606801834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-01c610fa-71a9-4a63-b25e-fa07387e1668 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:43 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-08ede120-05f3-41ea-b60d-9394353414c8 tempest-CreateVolumesFromImageTest-1606801834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:35:43 devstack sudo[105067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-01c610fa-71a9-4a63-b25e-fa07387e1668 Jun 02 03:35:43 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-08ede120-05f3-41ea-b60d-9394353414c8 tempest-CreateVolumesFromImageTest-1606801834 None] Flow 'volume_create_manager' (2235b0ee-1061-43f9-b542-988bb8793248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-08ede120-05f3-41ea-b60d-9394353414c8 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e7fb2c9-ef98-423a-a495-e7e9c4ee62af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-08ede120-05f3-41ea-b60d-9394353414c8 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e7fb2c9-ef98-423a-a495-e7e9c4ee62af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1948202810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96bef45b-dffc-4736-b8c1-6733080d8766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e8bb7184eb46adbb94cd1dac6a2c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:35:44Z,use_quota=True,user_id='d9edbd06bbb0457d8099c70cbc9b7dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-08ede120-05f3-41ea-b60d-9394353414c8 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa99cf6-35ae-490d-a94d-bfd0a3f00730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-08ede120-05f3-41ea-b60d-9394353414c8 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa99cf6-35ae-490d-a94d-bfd0a3f00730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-08ede120-05f3-41ea-b60d-9394353414c8 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b82ade6-91e8-48dd-ab30-8949a8ee6e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-08ede120-05f3-41ea-b60d-9394353414c8 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b82ade6-91e8-48dd-ab30-8949a8ee6e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96bef45b-dffc-4736-b8c1-6733080d8766', 'volume_name': 'volume-96bef45b-dffc-4736-b8c1-6733080d8766', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-08ede120-05f3-41ea-b60d-9394353414c8 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88b1cd1f-0f90-4775-a2f4-896ba8633e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-08ede120-05f3-41ea-b60d-9394353414c8 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88b1cd1f-0f90-4775-a2f4-896ba8633e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-08ede120-05f3-41ea-b60d-9394353414c8 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc933dc-e92b-457d-9334-e066bc16c58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:44 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-08ede120-05f3-41ea-b60d-9394353414c8 tempest-CreateVolumesFromImageTest-1606801834 None] Volume 96bef45b-dffc-4736-b8c1-6733080d8766: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96bef45b-dffc-4736-b8c1-6733080d8766', 'volume_size': 1} Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-08ede120-05f3-41ea-b60d-9394353414c8 tempest-CreateVolumesFromImageTest-1606801834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-43f7e02e-c259-4953-bcc9-321fed630405 tempest-CreateVolumesFromImageTest-1606801834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-43f7e02e-c259-4953-bcc9-321fed630405 tempest-CreateVolumesFromImageTest-1606801834 None] Flow 'volume_create_manager' (8250969a-2ed0-48a7-a50f-3ad9fb637fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-43f7e02e-c259-4953-bcc9-321fed630405 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (088efaea-d2e1-42d4-8b08-5768958c7b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-43f7e02e-c259-4953-bcc9-321fed630405 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (088efaea-d2e1-42d4-8b08-5768958c7b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-514406980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf611094-5818-4b82-b85a-e9479f1ccb6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e8bb7184eb46adbb94cd1dac6a2c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:35:44Z,use_quota=True,user_id='d9edbd06bbb0457d8099c70cbc9b7dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-43f7e02e-c259-4953-bcc9-321fed630405 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de012d5b-3ddb-4c62-8860-070a7487add6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-43f7e02e-c259-4953-bcc9-321fed630405 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de012d5b-3ddb-4c62-8860-070a7487add6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-43f7e02e-c259-4953-bcc9-321fed630405 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (294a9e40-45ba-4c47-b84c-8e15501d6185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-43f7e02e-c259-4953-bcc9-321fed630405 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (294a9e40-45ba-4c47-b84c-8e15501d6185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf611094-5818-4b82-b85a-e9479f1ccb6d', 'volume_name': 'volume-bf611094-5818-4b82-b85a-e9479f1ccb6d', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-43f7e02e-c259-4953-bcc9-321fed630405 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (008b4f28-1349-4d39-9663-5d2af5073c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-43f7e02e-c259-4953-bcc9-321fed630405 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (008b4f28-1349-4d39-9663-5d2af5073c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-43f7e02e-c259-4953-bcc9-321fed630405 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17283506-f963-4190-b606-07289c7e6e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:44 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-43f7e02e-c259-4953-bcc9-321fed630405 tempest-CreateVolumesFromImageTest-1606801834 None] Volume bf611094-5818-4b82-b85a-e9479f1ccb6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf611094-5818-4b82-b85a-e9479f1ccb6d', 'volume_size': 1} Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-43f7e02e-c259-4953-bcc9-321fed630405 tempest-CreateVolumesFromImageTest-1606801834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:44 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-92fb6609-0f32-47d6-8e6b-4dec3f315075 tempest-CreateVolumesFromImageTest-1606801834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-01c610fa-71a9-4a63-b25e-fa07387e1668" returned: 0 in 0.685s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-92fb6609-0f32-47d6-8e6b-4dec3f315075 tempest-CreateVolumesFromImageTest-1606801834 None] <== create_volume: return (1801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-92fb6609-0f32-47d6-8e6b-4dec3f315075 tempest-CreateVolumesFromImageTest-1606801834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.803s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ed2ec162-1f94-437b-8f77-a6850b5696cb tempest-CreateVolumesFromImageTest-1606801834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.362s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ed2ec162-1f94-437b-8f77-a6850b5696cb tempest-CreateVolumesFromImageTest-1606801834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1469103740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=437e480a-e17a-40a5-a42b-242622894232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e8bb7184eb46adbb94cd1dac6a2c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:35:43Z,use_quota=True,user_id='d9edbd06bbb0457d8099c70cbc9b7dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-ed2ec162-1f94-437b-8f77-a6850b5696cb tempest-CreateVolumesFromImageTest-1606801834 None] Creating volume 437e480a-e17a-40a5-a42b-242622894232 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ed2ec162-1f94-437b-8f77-a6850b5696cb tempest-CreateVolumesFromImageTest-1606801834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ed2ec162-1f94-437b-8f77-a6850b5696cb tempest-CreateVolumesFromImageTest-1606801834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ed2ec162-1f94-437b-8f77-a6850b5696cb tempest-CreateVolumesFromImageTest-1606801834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ed2ec162-1f94-437b-8f77-a6850b5696cb tempest-CreateVolumesFromImageTest-1606801834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ed2ec162-1f94-437b-8f77-a6850b5696cb tempest-CreateVolumesFromImageTest-1606801834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ed2ec162-1f94-437b-8f77-a6850b5696cb tempest-CreateVolumesFromImageTest-1606801834 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:35:44 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-ed2ec162-1f94-437b-8f77-a6850b5696cb tempest-CreateVolumesFromImageTest-1606801834 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ed2ec162-1f94-437b-8f77-a6850b5696cb tempest-CreateVolumesFromImageTest-1606801834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-437e480a-e17a-40a5-a42b-242622894232 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:44 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-437e480a-e17a-40a5-a42b-242622894232 1073741824 Jun 02 03:35:44 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-92fb6609-0f32-47d6-8e6b-4dec3f315075 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e37f08-7313-432f-b7f7-5936167c6233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01c610fa-71a9-4a63-b25e-fa07387e1668', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-92fb6609-0f32-47d6-8e6b-4dec3f315075 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a50a229-8052-46d0-bd99-060f228df113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:44 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-92fb6609-0f32-47d6-8e6b-4dec3f315075 tempest-CreateVolumesFromImageTest-1606801834 None] Volume volume-01c610fa-71a9-4a63-b25e-fa07387e1668 (01c610fa-71a9-4a63-b25e-fa07387e1668): created successfully Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-92fb6609-0f32-47d6-8e6b-4dec3f315075 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a50a229-8052-46d0-bd99-060f228df113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:44 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-92fb6609-0f32-47d6-8e6b-4dec3f315075 tempest-CreateVolumesFromImageTest-1606801834 None] Flow 'volume_create_manager' (eb1f9383-3578-41e7-956b-ce84ce4874aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:35:44 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-92fb6609-0f32-47d6-8e6b-4dec3f315075 tempest-CreateVolumesFromImageTest-1606801834 None] Created volume successfully. Jun 02 03:35:45 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ed2ec162-1f94-437b-8f77-a6850b5696cb tempest-CreateVolumesFromImageTest-1606801834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-437e480a-e17a-40a5-a42b-242622894232 1073741824" returned: 0 in 0.819s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ed2ec162-1f94-437b-8f77-a6850b5696cb tempest-CreateVolumesFromImageTest-1606801834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-437e480a-e17a-40a5-a42b-242622894232 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:45 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-437e480a-e17a-40a5-a42b-242622894232 Jun 02 03:35:45 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:46 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ed2ec162-1f94-437b-8f77-a6850b5696cb tempest-CreateVolumesFromImageTest-1606801834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-437e480a-e17a-40a5-a42b-242622894232" returned: 0 in 0.630s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:46 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ed2ec162-1f94-437b-8f77-a6850b5696cb tempest-CreateVolumesFromImageTest-1606801834 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:35:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ed2ec162-1f94-437b-8f77-a6850b5696cb tempest-CreateVolumesFromImageTest-1606801834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-edd44762-2812-4c23-bc62-0d68793466a5 tempest-CreateVolumesFromImageTest-1606801834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.536s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:46 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-edd44762-2812-4c23-bc62-0d68793466a5 tempest-CreateVolumesFromImageTest-1606801834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1512053774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=439193e9-8e9e-45e3-a565-59a07485bfb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e8bb7184eb46adbb94cd1dac6a2c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:35:43Z,use_quota=True,user_id='d9edbd06bbb0457d8099c70cbc9b7dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:35:46 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-edd44762-2812-4c23-bc62-0d68793466a5 tempest-CreateVolumesFromImageTest-1606801834 None] Creating volume 439193e9-8e9e-45e3-a565-59a07485bfb4 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:35:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-edd44762-2812-4c23-bc62-0d68793466a5 tempest-CreateVolumesFromImageTest-1606801834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-edd44762-2812-4c23-bc62-0d68793466a5 tempest-CreateVolumesFromImageTest-1606801834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:46 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-edd44762-2812-4c23-bc62-0d68793466a5 tempest-CreateVolumesFromImageTest-1606801834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:35:46 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-edd44762-2812-4c23-bc62-0d68793466a5 tempest-CreateVolumesFromImageTest-1606801834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:35:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-edd44762-2812-4c23-bc62-0d68793466a5 tempest-CreateVolumesFromImageTest-1606801834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:46 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-edd44762-2812-4c23-bc62-0d68793466a5 tempest-CreateVolumesFromImageTest-1606801834 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:35:46 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-edd44762-2812-4c23-bc62-0d68793466a5 tempest-CreateVolumesFromImageTest-1606801834 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:35:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-edd44762-2812-4c23-bc62-0d68793466a5 tempest-CreateVolumesFromImageTest-1606801834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-439193e9-8e9e-45e3-a565-59a07485bfb4 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:46 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ed2ec162-1f94-437b-8f77-a6850b5696cb tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d614ae52-09f9-42b2-9cb6-34c5179a7321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-437e480a-e17a-40a5-a42b-242622894232', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:46 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ed2ec162-1f94-437b-8f77-a6850b5696cb tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6b323c5-f74f-46a9-ae2f-58af007f17c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:46 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-439193e9-8e9e-45e3-a565-59a07485bfb4 1073741824 Jun 02 03:35:46 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:46 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-ed2ec162-1f94-437b-8f77-a6850b5696cb tempest-CreateVolumesFromImageTest-1606801834 None] Volume volume-437e480a-e17a-40a5-a42b-242622894232 (437e480a-e17a-40a5-a42b-242622894232): created successfully Jun 02 03:35:46 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ed2ec162-1f94-437b-8f77-a6850b5696cb tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6b323c5-f74f-46a9-ae2f-58af007f17c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:46 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ed2ec162-1f94-437b-8f77-a6850b5696cb tempest-CreateVolumesFromImageTest-1606801834 None] Flow 'volume_create_manager' (e94da016-e4a6-4ec8-a1b2-44afaef22a88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:35:46 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-ed2ec162-1f94-437b-8f77-a6850b5696cb tempest-CreateVolumesFromImageTest-1606801834 None] Created volume successfully. Jun 02 03:35:47 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-edd44762-2812-4c23-bc62-0d68793466a5 tempest-CreateVolumesFromImageTest-1606801834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-439193e9-8e9e-45e3-a565-59a07485bfb4 1073741824" returned: 0 in 0.866s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-edd44762-2812-4c23-bc62-0d68793466a5 tempest-CreateVolumesFromImageTest-1606801834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-439193e9-8e9e-45e3-a565-59a07485bfb4 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:47 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-439193e9-8e9e-45e3-a565-59a07485bfb4 Jun 02 03:35:47 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:47 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-edd44762-2812-4c23-bc62-0d68793466a5 tempest-CreateVolumesFromImageTest-1606801834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-439193e9-8e9e-45e3-a565-59a07485bfb4" returned: 0 in 0.592s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-edd44762-2812-4c23-bc62-0d68793466a5 tempest-CreateVolumesFromImageTest-1606801834 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:35:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-edd44762-2812-4c23-bc62-0d68793466a5 tempest-CreateVolumesFromImageTest-1606801834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-08ede120-05f3-41ea-b60d-9394353414c8 tempest-CreateVolumesFromImageTest-1606801834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.572s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-08ede120-05f3-41ea-b60d-9394353414c8 tempest-CreateVolumesFromImageTest-1606801834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1948202810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96bef45b-dffc-4736-b8c1-6733080d8766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e8bb7184eb46adbb94cd1dac6a2c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:35:44Z,use_quota=True,user_id='d9edbd06bbb0457d8099c70cbc9b7dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:35:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-08ede120-05f3-41ea-b60d-9394353414c8 tempest-CreateVolumesFromImageTest-1606801834 None] Creating volume 96bef45b-dffc-4736-b8c1-6733080d8766 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:35:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-08ede120-05f3-41ea-b60d-9394353414c8 tempest-CreateVolumesFromImageTest-1606801834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-08ede120-05f3-41ea-b60d-9394353414c8 tempest-CreateVolumesFromImageTest-1606801834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-08ede120-05f3-41ea-b60d-9394353414c8 tempest-CreateVolumesFromImageTest-1606801834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:35:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-08ede120-05f3-41ea-b60d-9394353414c8 tempest-CreateVolumesFromImageTest-1606801834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:35:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-08ede120-05f3-41ea-b60d-9394353414c8 tempest-CreateVolumesFromImageTest-1606801834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-08ede120-05f3-41ea-b60d-9394353414c8 tempest-CreateVolumesFromImageTest-1606801834 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:35:47 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-08ede120-05f3-41ea-b60d-9394353414c8 tempest-CreateVolumesFromImageTest-1606801834 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:35:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-08ede120-05f3-41ea-b60d-9394353414c8 tempest-CreateVolumesFromImageTest-1606801834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-96bef45b-dffc-4736-b8c1-6733080d8766 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-edd44762-2812-4c23-bc62-0d68793466a5 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e44a9045-9b16-40f0-94d7-45ea27b1000b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-439193e9-8e9e-45e3-a565-59a07485bfb4', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:47 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-96bef45b-dffc-4736-b8c1-6733080d8766 1073741824 Jun 02 03:35:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-edd44762-2812-4c23-bc62-0d68793466a5 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc31289-7c04-4df2-9e67-aece1ab437d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:47 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:47 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-edd44762-2812-4c23-bc62-0d68793466a5 tempest-CreateVolumesFromImageTest-1606801834 None] Volume volume-439193e9-8e9e-45e3-a565-59a07485bfb4 (439193e9-8e9e-45e3-a565-59a07485bfb4): created successfully Jun 02 03:35:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-edd44762-2812-4c23-bc62-0d68793466a5 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc31289-7c04-4df2-9e67-aece1ab437d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:47 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-edd44762-2812-4c23-bc62-0d68793466a5 tempest-CreateVolumesFromImageTest-1606801834 None] Flow 'volume_create_manager' (6a384410-739c-4be0-a51c-1597805fc015) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:35:47 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-edd44762-2812-4c23-bc62-0d68793466a5 tempest-CreateVolumesFromImageTest-1606801834 None] Created volume successfully. Jun 02 03:35:48 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-08ede120-05f3-41ea-b60d-9394353414c8 tempest-CreateVolumesFromImageTest-1606801834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-96bef45b-dffc-4736-b8c1-6733080d8766 1073741824" returned: 0 in 0.803s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-08ede120-05f3-41ea-b60d-9394353414c8 tempest-CreateVolumesFromImageTest-1606801834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-96bef45b-dffc-4736-b8c1-6733080d8766 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:48 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-96bef45b-dffc-4736-b8c1-6733080d8766 Jun 02 03:35:48 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:49 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-08ede120-05f3-41ea-b60d-9394353414c8 tempest-CreateVolumesFromImageTest-1606801834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-96bef45b-dffc-4736-b8c1-6733080d8766" returned: 0 in 0.612s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:49 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-08ede120-05f3-41ea-b60d-9394353414c8 tempest-CreateVolumesFromImageTest-1606801834 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:35:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-08ede120-05f3-41ea-b60d-9394353414c8 tempest-CreateVolumesFromImageTest-1606801834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-43f7e02e-c259-4953-bcc9-321fed630405 tempest-CreateVolumesFromImageTest-1606801834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.756s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:49 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-43f7e02e-c259-4953-bcc9-321fed630405 tempest-CreateVolumesFromImageTest-1606801834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-514406980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf611094-5818-4b82-b85a-e9479f1ccb6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e8bb7184eb46adbb94cd1dac6a2c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:35:44Z,use_quota=True,user_id='d9edbd06bbb0457d8099c70cbc9b7dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:35:49 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-43f7e02e-c259-4953-bcc9-321fed630405 tempest-CreateVolumesFromImageTest-1606801834 None] Creating volume bf611094-5818-4b82-b85a-e9479f1ccb6d {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:35:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-43f7e02e-c259-4953-bcc9-321fed630405 tempest-CreateVolumesFromImageTest-1606801834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-43f7e02e-c259-4953-bcc9-321fed630405 tempest-CreateVolumesFromImageTest-1606801834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:49 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-43f7e02e-c259-4953-bcc9-321fed630405 tempest-CreateVolumesFromImageTest-1606801834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:35:49 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-43f7e02e-c259-4953-bcc9-321fed630405 tempest-CreateVolumesFromImageTest-1606801834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:35:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-43f7e02e-c259-4953-bcc9-321fed630405 tempest-CreateVolumesFromImageTest-1606801834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:49 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-43f7e02e-c259-4953-bcc9-321fed630405 tempest-CreateVolumesFromImageTest-1606801834 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:35:49 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-43f7e02e-c259-4953-bcc9-321fed630405 tempest-CreateVolumesFromImageTest-1606801834 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:35:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-43f7e02e-c259-4953-bcc9-321fed630405 tempest-CreateVolumesFromImageTest-1606801834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bf611094-5818-4b82-b85a-e9479f1ccb6d 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:49 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-08ede120-05f3-41ea-b60d-9394353414c8 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc933dc-e92b-457d-9334-e066bc16c58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96bef45b-dffc-4736-b8c1-6733080d8766', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:49 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-08ede120-05f3-41ea-b60d-9394353414c8 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (260993c8-305d-4348-8070-28027129390c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:49 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bf611094-5818-4b82-b85a-e9479f1ccb6d 1073741824 Jun 02 03:35:49 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:49 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-08ede120-05f3-41ea-b60d-9394353414c8 tempest-CreateVolumesFromImageTest-1606801834 None] Volume volume-96bef45b-dffc-4736-b8c1-6733080d8766 (96bef45b-dffc-4736-b8c1-6733080d8766): created successfully Jun 02 03:35:49 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-08ede120-05f3-41ea-b60d-9394353414c8 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (260993c8-305d-4348-8070-28027129390c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:49 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-08ede120-05f3-41ea-b60d-9394353414c8 tempest-CreateVolumesFromImageTest-1606801834 None] Flow 'volume_create_manager' (2235b0ee-1061-43f9-b542-988bb8793248) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:35:49 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-08ede120-05f3-41ea-b60d-9394353414c8 tempest-CreateVolumesFromImageTest-1606801834 None] Created volume successfully. Jun 02 03:35:50 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-43f7e02e-c259-4953-bcc9-321fed630405 tempest-CreateVolumesFromImageTest-1606801834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bf611094-5818-4b82-b85a-e9479f1ccb6d 1073741824" returned: 0 in 0.881s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-43f7e02e-c259-4953-bcc9-321fed630405 tempest-CreateVolumesFromImageTest-1606801834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bf611094-5818-4b82-b85a-e9479f1ccb6d {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:50 devstack sudo[105102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bf611094-5818-4b82-b85a-e9479f1ccb6d Jun 02 03:35:50 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:50 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-43f7e02e-c259-4953-bcc9-321fed630405 tempest-CreateVolumesFromImageTest-1606801834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bf611094-5818-4b82-b85a-e9479f1ccb6d" returned: 0 in 0.613s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:50 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-43f7e02e-c259-4953-bcc9-321fed630405 tempest-CreateVolumesFromImageTest-1606801834 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:35:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-43f7e02e-c259-4953-bcc9-321fed630405 tempest-CreateVolumesFromImageTest-1606801834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:50 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-43f7e02e-c259-4953-bcc9-321fed630405 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17283506-f963-4190-b606-07289c7e6e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf611094-5818-4b82-b85a-e9479f1ccb6d', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:50 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-43f7e02e-c259-4953-bcc9-321fed630405 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c71cc72b-dd78-4ced-97ae-a04ced3b24d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:35:50 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-43f7e02e-c259-4953-bcc9-321fed630405 tempest-CreateVolumesFromImageTest-1606801834 None] Volume volume-bf611094-5818-4b82-b85a-e9479f1ccb6d (bf611094-5818-4b82-b85a-e9479f1ccb6d): created successfully Jun 02 03:35:50 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-43f7e02e-c259-4953-bcc9-321fed630405 tempest-CreateVolumesFromImageTest-1606801834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c71cc72b-dd78-4ced-97ae-a04ced3b24d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:35:50 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-43f7e02e-c259-4953-bcc9-321fed630405 tempest-CreateVolumesFromImageTest-1606801834 None] Flow 'volume_create_manager' (8250969a-2ed0-48a7-a50f-3ad9fb637fcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:35:50 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-43f7e02e-c259-4953-bcc9-321fed630405 tempest-CreateVolumesFromImageTest-1606801834 None] Created volume successfully. Jun 02 03:35:51 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-dd0c46bf-4a2d-4c81-9385-755440fcec1b tempest-CreateVolumesFromImageTest-1606801834 None] Acquiring lock "cinder-bf611094-5818-4b82-b85a-e9479f1ccb6d-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:35:51 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-dd0c46bf-4a2d-4c81-9385-755440fcec1b tempest-CreateVolumesFromImageTest-1606801834 None] Lock "cinder-bf611094-5818-4b82-b85a-e9479f1ccb6d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:35:51 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-dd0c46bf-4a2d-4c81-9385-755440fcec1b tempest-CreateVolumesFromImageTest-1606801834 None] Acquiring lock "cinder-quobyte-bf611094-5818-4b82-b85a-e9479f1ccb6d" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:35:51 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-dd0c46bf-4a2d-4c81-9385-755440fcec1b tempest-CreateVolumesFromImageTest-1606801834 None] Lock "cinder-quobyte-bf611094-5818-4b82-b85a-e9479f1ccb6d" acquired by "delete_volume" :: waited 0.021s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:35:51 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[58dba090-96d4-48c1-9950-b11d5b437aa5]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:35:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-dd0c46bf-4a2d-4c81-9385-755440fcec1b tempest-CreateVolumesFromImageTest-1606801834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bf611094-5818-4b82-b85a-e9479f1ccb6d {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:51 devstack sudo[105105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bf611094-5818-4b82-b85a-e9479f1ccb6d Jun 02 03:35:51 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:51 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-dd0c46bf-4a2d-4c81-9385-755440fcec1b tempest-CreateVolumesFromImageTest-1606801834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bf611094-5818-4b82-b85a-e9479f1ccb6d" returned: 0 in 0.840s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-dd0c46bf-4a2d-4c81-9385-755440fcec1b tempest-CreateVolumesFromImageTest-1606801834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bf611094-5818-4b82-b85a-e9479f1ccb6d {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:52 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bf611094-5818-4b82-b85a-e9479f1ccb6d Jun 02 03:35:52 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:52 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-dd0c46bf-4a2d-4c81-9385-755440fcec1b tempest-CreateVolumesFromImageTest-1606801834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-bf611094-5818-4b82-b85a-e9479f1ccb6d" returned: 0 in 0.647s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:52 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-dd0c46bf-4a2d-4c81-9385-755440fcec1b tempest-CreateVolumesFromImageTest-1606801834 None] Lock "cinder-quobyte-bf611094-5818-4b82-b85a-e9479f1ccb6d" released by "delete_volume" :: held 1.535s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:35:52 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-dd0c46bf-4a2d-4c81-9385-755440fcec1b tempest-CreateVolumesFromImageTest-1606801834 None] Created reservations ['dc1d88ab-d127-4360-b688-1eb12ca74bde', '42318e84-f607-48c5-b8e4-7ab28d31f50d', '2ce37c8a-8644-40e9-9ded-00789d6e9bca', '6598cd7a-debf-4262-ba65-fec55eafaa76'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:35:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-dd0c46bf-4a2d-4c81-9385-755440fcec1b tempest-CreateVolumesFromImageTest-1606801834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-dd0c46bf-4a2d-4c81-9385-755440fcec1b tempest-CreateVolumesFromImageTest-1606801834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:52 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-dd0c46bf-4a2d-4c81-9385-755440fcec1b tempest-CreateVolumesFromImageTest-1606801834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:35:52 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-dd0c46bf-4a2d-4c81-9385-755440fcec1b tempest-CreateVolumesFromImageTest-1606801834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:35:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-dd0c46bf-4a2d-4c81-9385-755440fcec1b tempest-CreateVolumesFromImageTest-1606801834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-dd0c46bf-4a2d-4c81-9385-755440fcec1b tempest-CreateVolumesFromImageTest-1606801834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:52 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:35:52 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:53 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b5763aab-3f08-4d06-a839-0d1103d41389 tempest-CreateVolumesFromImageTest-1606801834 None] Acquiring lock "cinder-96bef45b-dffc-4736-b8c1-6733080d8766-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:35:53 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b5763aab-3f08-4d06-a839-0d1103d41389 tempest-CreateVolumesFromImageTest-1606801834 None] Lock "cinder-96bef45b-dffc-4736-b8c1-6733080d8766-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:35:53 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-dd0c46bf-4a2d-4c81-9385-755440fcec1b tempest-CreateVolumesFromImageTest-1606801834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.624s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:53 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-dd0c46bf-4a2d-4c81-9385-755440fcec1b tempest-CreateVolumesFromImageTest-1606801834 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:35:53 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b5763aab-3f08-4d06-a839-0d1103d41389 tempest-CreateVolumesFromImageTest-1606801834 None] Acquiring lock "cinder-quobyte-96bef45b-dffc-4736-b8c1-6733080d8766" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:35:53 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-dd0c46bf-4a2d-4c81-9385-755440fcec1b tempest-CreateVolumesFromImageTest-1606801834 None] Deleted volume successfully. Jun 02 03:35:53 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b5763aab-3f08-4d06-a839-0d1103d41389 tempest-CreateVolumesFromImageTest-1606801834 None] Lock "cinder-quobyte-96bef45b-dffc-4736-b8c1-6733080d8766" acquired by "delete_volume" :: waited 0.025s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:35:53 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-dd0c46bf-4a2d-4c81-9385-755440fcec1b tempest-CreateVolumesFromImageTest-1606801834 None] Lock "cinder-bf611094-5818-4b82-b85a-e9479f1ccb6d-delete_volume" released by "delete_volume" :: held 2.398s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:35:53 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9d5cca-4ecd-41a7-a54a-4cd0b9096d75]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:35:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b5763aab-3f08-4d06-a839-0d1103d41389 tempest-CreateVolumesFromImageTest-1606801834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-96bef45b-dffc-4736-b8c1-6733080d8766 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:53 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-96bef45b-dffc-4736-b8c1-6733080d8766 Jun 02 03:35:53 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:54 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b5763aab-3f08-4d06-a839-0d1103d41389 tempest-CreateVolumesFromImageTest-1606801834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-96bef45b-dffc-4736-b8c1-6733080d8766" returned: 0 in 0.748s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b5763aab-3f08-4d06-a839-0d1103d41389 tempest-CreateVolumesFromImageTest-1606801834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-96bef45b-dffc-4736-b8c1-6733080d8766 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:54 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-96bef45b-dffc-4736-b8c1-6733080d8766 Jun 02 03:35:54 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:54 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b5763aab-3f08-4d06-a839-0d1103d41389 tempest-CreateVolumesFromImageTest-1606801834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-96bef45b-dffc-4736-b8c1-6733080d8766" returned: 0 in 0.589s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:54 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b5763aab-3f08-4d06-a839-0d1103d41389 tempest-CreateVolumesFromImageTest-1606801834 None] Lock "cinder-quobyte-96bef45b-dffc-4736-b8c1-6733080d8766" released by "delete_volume" :: held 1.384s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:35:54 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-b5763aab-3f08-4d06-a839-0d1103d41389 tempest-CreateVolumesFromImageTest-1606801834 None] Created reservations ['1c92976b-5222-4e44-9435-eacf7a78150c', '45712b4b-53c1-48d1-9961-349a490060e2', '88b51a66-1aed-4ba5-a1df-389fbb3c78f7', '972589ad-ea75-4eb7-9f12-bb0836071aee'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:35:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b5763aab-3f08-4d06-a839-0d1103d41389 tempest-CreateVolumesFromImageTest-1606801834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b5763aab-3f08-4d06-a839-0d1103d41389 tempest-CreateVolumesFromImageTest-1606801834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:54 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b5763aab-3f08-4d06-a839-0d1103d41389 tempest-CreateVolumesFromImageTest-1606801834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:35:54 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b5763aab-3f08-4d06-a839-0d1103d41389 tempest-CreateVolumesFromImageTest-1606801834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:35:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b5763aab-3f08-4d06-a839-0d1103d41389 tempest-CreateVolumesFromImageTest-1606801834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b5763aab-3f08-4d06-a839-0d1103d41389 tempest-CreateVolumesFromImageTest-1606801834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:54 devstack sudo[105126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:35:54 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:55 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b5763aab-3f08-4d06-a839-0d1103d41389 tempest-CreateVolumesFromImageTest-1606801834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.612s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:55 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-b5763aab-3f08-4d06-a839-0d1103d41389 tempest-CreateVolumesFromImageTest-1606801834 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:35:55 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-b5763aab-3f08-4d06-a839-0d1103d41389 tempest-CreateVolumesFromImageTest-1606801834 None] Deleted volume successfully. Jun 02 03:35:55 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b5763aab-3f08-4d06-a839-0d1103d41389 tempest-CreateVolumesFromImageTest-1606801834 None] Lock "cinder-96bef45b-dffc-4736-b8c1-6733080d8766-delete_volume" released by "delete_volume" :: held 2.227s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:35:55 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e5d813ec-7c05-40f8-84ad-3673bc180f51 tempest-CreateVolumesFromImageTest-1606801834 None] Acquiring lock "cinder-439193e9-8e9e-45e3-a565-59a07485bfb4-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:35:55 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e5d813ec-7c05-40f8-84ad-3673bc180f51 tempest-CreateVolumesFromImageTest-1606801834 None] Lock "cinder-439193e9-8e9e-45e3-a565-59a07485bfb4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:35:55 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=87,cinder:UPDATE=126,cinder:INSERT=37,cinder:DELETE=8 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:35:55 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e5d813ec-7c05-40f8-84ad-3673bc180f51 tempest-CreateVolumesFromImageTest-1606801834 None] Acquiring lock "cinder-quobyte-439193e9-8e9e-45e3-a565-59a07485bfb4" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:35:55 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e5d813ec-7c05-40f8-84ad-3673bc180f51 tempest-CreateVolumesFromImageTest-1606801834 None] Lock "cinder-quobyte-439193e9-8e9e-45e3-a565-59a07485bfb4" acquired by "delete_volume" :: waited 0.016s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:35:55 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce408f51-e85a-446b-bde5-f31f6fa65052]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:35:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e5d813ec-7c05-40f8-84ad-3673bc180f51 tempest-CreateVolumesFromImageTest-1606801834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-439193e9-8e9e-45e3-a565-59a07485bfb4 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:55 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-439193e9-8e9e-45e3-a565-59a07485bfb4 Jun 02 03:35:55 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:56 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e5d813ec-7c05-40f8-84ad-3673bc180f51 tempest-CreateVolumesFromImageTest-1606801834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-439193e9-8e9e-45e3-a565-59a07485bfb4" returned: 0 in 0.738s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e5d813ec-7c05-40f8-84ad-3673bc180f51 tempest-CreateVolumesFromImageTest-1606801834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-439193e9-8e9e-45e3-a565-59a07485bfb4 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:56 devstack sudo[105134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-439193e9-8e9e-45e3-a565-59a07485bfb4 Jun 02 03:35:56 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:57 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e5d813ec-7c05-40f8-84ad-3673bc180f51 tempest-CreateVolumesFromImageTest-1606801834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-439193e9-8e9e-45e3-a565-59a07485bfb4" returned: 0 in 0.608s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:57 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e5d813ec-7c05-40f8-84ad-3673bc180f51 tempest-CreateVolumesFromImageTest-1606801834 None] Lock "cinder-quobyte-439193e9-8e9e-45e3-a565-59a07485bfb4" released by "delete_volume" :: held 1.388s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:35:57 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-e5d813ec-7c05-40f8-84ad-3673bc180f51 tempest-CreateVolumesFromImageTest-1606801834 None] Created reservations ['832429f8-d7d9-4657-9091-d91bbabb77c0', '25a18f22-1651-4bde-83f9-634fe32194f5', 'ca2b81e5-8462-42f3-9f42-bbdeea15254f', 'd9a71090-eff0-4959-8b25-01d094800adb'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:35:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e5d813ec-7c05-40f8-84ad-3673bc180f51 tempest-CreateVolumesFromImageTest-1606801834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e5d813ec-7c05-40f8-84ad-3673bc180f51 tempest-CreateVolumesFromImageTest-1606801834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:57 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e5d813ec-7c05-40f8-84ad-3673bc180f51 tempest-CreateVolumesFromImageTest-1606801834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:35:57 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e5d813ec-7c05-40f8-84ad-3673bc180f51 tempest-CreateVolumesFromImageTest-1606801834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:35:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e5d813ec-7c05-40f8-84ad-3673bc180f51 tempest-CreateVolumesFromImageTest-1606801834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e5d813ec-7c05-40f8-84ad-3673bc180f51 tempest-CreateVolumesFromImageTest-1606801834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:57 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:35:57 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:57 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e5d813ec-7c05-40f8-84ad-3673bc180f51 tempest-CreateVolumesFromImageTest-1606801834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.587s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:57 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-e5d813ec-7c05-40f8-84ad-3673bc180f51 tempest-CreateVolumesFromImageTest-1606801834 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:35:57 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-e5d813ec-7c05-40f8-84ad-3673bc180f51 tempest-CreateVolumesFromImageTest-1606801834 None] Deleted volume successfully. Jun 02 03:35:57 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e5d813ec-7c05-40f8-84ad-3673bc180f51 tempest-CreateVolumesFromImageTest-1606801834 None] Lock "cinder-439193e9-8e9e-45e3-a565-59a07485bfb4-delete_volume" released by "delete_volume" :: held 2.202s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:35:57 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-43cd77a8-9e54-4121-a7ca-84b2cf1bdea9 tempest-CreateVolumesFromImageTest-1606801834 None] Acquiring lock "cinder-437e480a-e17a-40a5-a42b-242622894232-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:35:57 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-43cd77a8-9e54-4121-a7ca-84b2cf1bdea9 tempest-CreateVolumesFromImageTest-1606801834 None] Lock "cinder-437e480a-e17a-40a5-a42b-242622894232-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:35:57 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-43cd77a8-9e54-4121-a7ca-84b2cf1bdea9 tempest-CreateVolumesFromImageTest-1606801834 None] Acquiring lock "cinder-quobyte-437e480a-e17a-40a5-a42b-242622894232" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:35:57 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-43cd77a8-9e54-4121-a7ca-84b2cf1bdea9 tempest-CreateVolumesFromImageTest-1606801834 None] Lock "cinder-quobyte-437e480a-e17a-40a5-a42b-242622894232" acquired by "delete_volume" :: waited 0.019s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:35:57 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[26888a4a-60e8-4626-a4ec-b8922d27cc26]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:35:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-43cd77a8-9e54-4121-a7ca-84b2cf1bdea9 tempest-CreateVolumesFromImageTest-1606801834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-437e480a-e17a-40a5-a42b-242622894232 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:58 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-437e480a-e17a-40a5-a42b-242622894232 Jun 02 03:35:58 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:58 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-43cd77a8-9e54-4121-a7ca-84b2cf1bdea9 tempest-CreateVolumesFromImageTest-1606801834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-437e480a-e17a-40a5-a42b-242622894232" returned: 0 in 0.733s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-43cd77a8-9e54-4121-a7ca-84b2cf1bdea9 tempest-CreateVolumesFromImageTest-1606801834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-437e480a-e17a-40a5-a42b-242622894232 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:58 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-437e480a-e17a-40a5-a42b-242622894232 Jun 02 03:35:58 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:35:59 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Jun 02 03:35:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-43cd77a8-9e54-4121-a7ca-84b2cf1bdea9 tempest-CreateVolumesFromImageTest-1606801834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-437e480a-e17a-40a5-a42b-242622894232" returned: 0 in 0.608s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:35:59 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-43cd77a8-9e54-4121-a7ca-84b2cf1bdea9 tempest-CreateVolumesFromImageTest-1606801834 None] Lock "cinder-quobyte-437e480a-e17a-40a5-a42b-242622894232" released by "delete_volume" :: held 1.390s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:35:59 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-43cd77a8-9e54-4121-a7ca-84b2cf1bdea9 tempest-CreateVolumesFromImageTest-1606801834 None] Created reservations ['aa716bbd-d640-439d-85f0-c740de43ff4b', '78c0ecd3-50e4-4c2d-9abd-75e0f5b9aa05', '98b9386a-5d92-457b-a5ca-df9f28f05038', '4c9883df-c72f-42f7-a7eb-621a35a27b3f'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:35:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-43cd77a8-9e54-4121-a7ca-84b2cf1bdea9 tempest-CreateVolumesFromImageTest-1606801834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:35:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-43cd77a8-9e54-4121-a7ca-84b2cf1bdea9 tempest-CreateVolumesFromImageTest-1606801834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:35:59 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-43cd77a8-9e54-4121-a7ca-84b2cf1bdea9 tempest-CreateVolumesFromImageTest-1606801834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:35:59 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-43cd77a8-9e54-4121-a7ca-84b2cf1bdea9 tempest-CreateVolumesFromImageTest-1606801834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:35:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-43cd77a8-9e54-4121-a7ca-84b2cf1bdea9 tempest-CreateVolumesFromImageTest-1606801834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:35:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-43cd77a8-9e54-4121-a7ca-84b2cf1bdea9 tempest-CreateVolumesFromImageTest-1606801834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:35:59 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:35:59 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:00 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-99b624ca-ca4f-4fe7-888a-07efc9dd6f5c tempest-CreateVolumesFromImageTest-1606801834 None] Acquiring lock "cinder-01c610fa-71a9-4a63-b25e-fa07387e1668-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:36:00 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-43cd77a8-9e54-4121-a7ca-84b2cf1bdea9 tempest-CreateVolumesFromImageTest-1606801834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.692s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:00 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-43cd77a8-9e54-4121-a7ca-84b2cf1bdea9 tempest-CreateVolumesFromImageTest-1606801834 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:36:00 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-99b624ca-ca4f-4fe7-888a-07efc9dd6f5c tempest-CreateVolumesFromImageTest-1606801834 None] Lock "cinder-01c610fa-71a9-4a63-b25e-fa07387e1668-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:36:00 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-43cd77a8-9e54-4121-a7ca-84b2cf1bdea9 tempest-CreateVolumesFromImageTest-1606801834 None] Deleted volume successfully. Jun 02 03:36:00 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-43cd77a8-9e54-4121-a7ca-84b2cf1bdea9 tempest-CreateVolumesFromImageTest-1606801834 None] Lock "cinder-437e480a-e17a-40a5-a42b-242622894232-delete_volume" released by "delete_volume" :: held 2.322s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:36:00 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-99b624ca-ca4f-4fe7-888a-07efc9dd6f5c tempest-CreateVolumesFromImageTest-1606801834 None] Acquiring lock "cinder-quobyte-01c610fa-71a9-4a63-b25e-fa07387e1668" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:36:00 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-99b624ca-ca4f-4fe7-888a-07efc9dd6f5c tempest-CreateVolumesFromImageTest-1606801834 None] Lock "cinder-quobyte-01c610fa-71a9-4a63-b25e-fa07387e1668" acquired by "delete_volume" :: waited 0.016s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:36:00 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48574e2-538d-4b28-b960-69b1b7c529b7]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:36:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-99b624ca-ca4f-4fe7-888a-07efc9dd6f5c tempest-CreateVolumesFromImageTest-1606801834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-01c610fa-71a9-4a63-b25e-fa07387e1668 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:00 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-01c610fa-71a9-4a63-b25e-fa07387e1668 Jun 02 03:36:00 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:00 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-99b624ca-ca4f-4fe7-888a-07efc9dd6f5c tempest-CreateVolumesFromImageTest-1606801834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-01c610fa-71a9-4a63-b25e-fa07387e1668" returned: 0 in 0.738s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-99b624ca-ca4f-4fe7-888a-07efc9dd6f5c tempest-CreateVolumesFromImageTest-1606801834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-01c610fa-71a9-4a63-b25e-fa07387e1668 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:01 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-01c610fa-71a9-4a63-b25e-fa07387e1668 Jun 02 03:36:01 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:01 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-99b624ca-ca4f-4fe7-888a-07efc9dd6f5c tempest-CreateVolumesFromImageTest-1606801834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-01c610fa-71a9-4a63-b25e-fa07387e1668" returned: 0 in 0.672s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:01 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-99b624ca-ca4f-4fe7-888a-07efc9dd6f5c tempest-CreateVolumesFromImageTest-1606801834 None] Lock "cinder-quobyte-01c610fa-71a9-4a63-b25e-fa07387e1668" released by "delete_volume" :: held 1.465s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:36:01 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-99b624ca-ca4f-4fe7-888a-07efc9dd6f5c tempest-CreateVolumesFromImageTest-1606801834 None] Created reservations ['6733cde3-b849-46b9-9575-161381af9a18', '27833786-d439-4db7-b269-2f147ffe3f49', '8c633f75-a1a9-43fd-ab0f-7ab372ca3282', '5bd1a86e-46af-4677-b495-4faed0b91e6b'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:36:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-99b624ca-ca4f-4fe7-888a-07efc9dd6f5c tempest-CreateVolumesFromImageTest-1606801834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:36:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-99b624ca-ca4f-4fe7-888a-07efc9dd6f5c tempest-CreateVolumesFromImageTest-1606801834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:36:01 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-99b624ca-ca4f-4fe7-888a-07efc9dd6f5c tempest-CreateVolumesFromImageTest-1606801834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:36:01 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-99b624ca-ca4f-4fe7-888a-07efc9dd6f5c tempest-CreateVolumesFromImageTest-1606801834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:36:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-99b624ca-ca4f-4fe7-888a-07efc9dd6f5c tempest-CreateVolumesFromImageTest-1606801834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:36:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-99b624ca-ca4f-4fe7-888a-07efc9dd6f5c tempest-CreateVolumesFromImageTest-1606801834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:01 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:36:01 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:02 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-99b624ca-ca4f-4fe7-888a-07efc9dd6f5c tempest-CreateVolumesFromImageTest-1606801834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.610s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:02 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-99b624ca-ca4f-4fe7-888a-07efc9dd6f5c tempest-CreateVolumesFromImageTest-1606801834 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:36:02 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-99b624ca-ca4f-4fe7-888a-07efc9dd6f5c tempest-CreateVolumesFromImageTest-1606801834 None] Deleted volume successfully. Jun 02 03:36:02 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-99b624ca-ca4f-4fe7-888a-07efc9dd6f5c tempest-CreateVolumesFromImageTest-1606801834 None] Lock "cinder-01c610fa-71a9-4a63-b25e-fa07387e1668-delete_volume" released by "delete_volume" :: held 2.328s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-51e59ba4-8c02-4eb2-bfe1-7decd131c97a tempest-SnapshotDependencyTests-1392321604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-51e59ba4-8c02-4eb2-bfe1-7decd131c97a tempest-SnapshotDependencyTests-1392321604 None] Flow 'volume_create_manager' (9a30dbc7-ccf0-4f3e-bef3-cd36408885ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-51e59ba4-8c02-4eb2-bfe1-7decd131c97a tempest-SnapshotDependencyTests-1392321604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf56763c-e59b-496f-adec-02adbb0513d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-51e59ba4-8c02-4eb2-bfe1-7decd131c97a tempest-SnapshotDependencyTests-1392321604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf56763c-e59b-496f-adec-02adbb0513d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-750418153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b86b310-9603-4a1f-a33f-c44d6269ade2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c453c14667e1416f9875d1d900ab5644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:36:05Z,use_quota=True,user_id='c28266be1549443d87c3192a6e5c4abe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-51e59ba4-8c02-4eb2-bfe1-7decd131c97a tempest-SnapshotDependencyTests-1392321604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b799b42c-d13a-43e2-856b-eb24ccfe1a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-51e59ba4-8c02-4eb2-bfe1-7decd131c97a tempest-SnapshotDependencyTests-1392321604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b799b42c-d13a-43e2-856b-eb24ccfe1a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-51e59ba4-8c02-4eb2-bfe1-7decd131c97a tempest-SnapshotDependencyTests-1392321604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ee4aff9-abb4-4154-b597-4c521a023abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-51e59ba4-8c02-4eb2-bfe1-7decd131c97a tempest-SnapshotDependencyTests-1392321604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ee4aff9-abb4-4154-b597-4c521a023abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b86b310-9603-4a1f-a33f-c44d6269ade2', 'volume_name': 'volume-6b86b310-9603-4a1f-a33f-c44d6269ade2', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-51e59ba4-8c02-4eb2-bfe1-7decd131c97a tempest-SnapshotDependencyTests-1392321604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe99ed05-b8fd-4dc4-a2bd-abc972ed3606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-51e59ba4-8c02-4eb2-bfe1-7decd131c97a tempest-SnapshotDependencyTests-1392321604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe99ed05-b8fd-4dc4-a2bd-abc972ed3606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-51e59ba4-8c02-4eb2-bfe1-7decd131c97a tempest-SnapshotDependencyTests-1392321604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (987cbff6-4ba5-41e9-840b-51a797c32b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:05 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-51e59ba4-8c02-4eb2-bfe1-7decd131c97a tempest-SnapshotDependencyTests-1392321604 None] Volume 6b86b310-9603-4a1f-a33f-c44d6269ade2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b86b310-9603-4a1f-a33f-c44d6269ade2', 'volume_size': 1} Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-51e59ba4-8c02-4eb2-bfe1-7decd131c97a tempest-SnapshotDependencyTests-1392321604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-51e59ba4-8c02-4eb2-bfe1-7decd131c97a tempest-SnapshotDependencyTests-1392321604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-51e59ba4-8c02-4eb2-bfe1-7decd131c97a tempest-SnapshotDependencyTests-1392321604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-750418153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b86b310-9603-4a1f-a33f-c44d6269ade2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c453c14667e1416f9875d1d900ab5644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:36:05Z,use_quota=True,user_id='c28266be1549443d87c3192a6e5c4abe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-51e59ba4-8c02-4eb2-bfe1-7decd131c97a tempest-SnapshotDependencyTests-1392321604 None] Creating volume 6b86b310-9603-4a1f-a33f-c44d6269ade2 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-51e59ba4-8c02-4eb2-bfe1-7decd131c97a tempest-SnapshotDependencyTests-1392321604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-51e59ba4-8c02-4eb2-bfe1-7decd131c97a tempest-SnapshotDependencyTests-1392321604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-51e59ba4-8c02-4eb2-bfe1-7decd131c97a tempest-SnapshotDependencyTests-1392321604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-51e59ba4-8c02-4eb2-bfe1-7decd131c97a tempest-SnapshotDependencyTests-1392321604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-51e59ba4-8c02-4eb2-bfe1-7decd131c97a tempest-SnapshotDependencyTests-1392321604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-51e59ba4-8c02-4eb2-bfe1-7decd131c97a tempest-SnapshotDependencyTests-1392321604 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:36:05 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-51e59ba4-8c02-4eb2-bfe1-7decd131c97a tempest-SnapshotDependencyTests-1392321604 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-51e59ba4-8c02-4eb2-bfe1-7decd131c97a tempest-SnapshotDependencyTests-1392321604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:05 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2 1073741824 Jun 02 03:36:05 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-9593ea92-755f-42e5-a962-0c8f248e1604 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9593ea92-755f-42e5-a962-0c8f248e1604 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Flow 'volume_create_manager' (06312d39-3d54-413b-96b4-6f91ca7d3a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9593ea92-755f-42e5-a962-0c8f248e1604 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0f45c6c-3269-481f-89ae-9dcfc8ac2b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9593ea92-755f-42e5-a962-0c8f248e1604 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0f45c6c-3269-481f-89ae-9dcfc8ac2b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-262210295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29eb8b2d-ba54-455b-b142-4ff2f575b648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777f7c08b4764095acba00e5a37fe930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:36:05Z,use_quota=True,user_id='257fa4ecd16d44beb4df2249a95a337c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9593ea92-755f-42e5-a962-0c8f248e1604 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2184628-8016-4002-937d-36ab405878be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9593ea92-755f-42e5-a962-0c8f248e1604 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2184628-8016-4002-937d-36ab405878be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9593ea92-755f-42e5-a962-0c8f248e1604 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f24b27b-4d8c-4623-9490-3023af6fa589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9593ea92-755f-42e5-a962-0c8f248e1604 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f24b27b-4d8c-4623-9490-3023af6fa589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29eb8b2d-ba54-455b-b142-4ff2f575b648', 'volume_name': 'volume-29eb8b2d-ba54-455b-b142-4ff2f575b648', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9593ea92-755f-42e5-a962-0c8f248e1604 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3786f32-0f1e-42f7-ae7a-bd3b10859787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9593ea92-755f-42e5-a962-0c8f248e1604 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3786f32-0f1e-42f7-ae7a-bd3b10859787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9593ea92-755f-42e5-a962-0c8f248e1604 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a1073d5-146c-4508-97e2-4778f2d7aa44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:05 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-9593ea92-755f-42e5-a962-0c8f248e1604 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Volume 29eb8b2d-ba54-455b-b142-4ff2f575b648: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29eb8b2d-ba54-455b-b142-4ff2f575b648', 'volume_size': 1} Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9593ea92-755f-42e5-a962-0c8f248e1604 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:36:05 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-51e59ba4-8c02-4eb2-bfe1-7decd131c97a tempest-SnapshotDependencyTests-1392321604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2 1073741824" returned: 0 in 0.739s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-51e59ba4-8c02-4eb2-bfe1-7decd131c97a tempest-SnapshotDependencyTests-1392321604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:05 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2 Jun 02 03:36:05 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:06 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-51e59ba4-8c02-4eb2-bfe1-7decd131c97a tempest-SnapshotDependencyTests-1392321604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2" returned: 0 in 0.587s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:06 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-51e59ba4-8c02-4eb2-bfe1-7decd131c97a tempest-SnapshotDependencyTests-1392321604 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:36:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-51e59ba4-8c02-4eb2-bfe1-7decd131c97a tempest-SnapshotDependencyTests-1392321604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:36:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9593ea92-755f-42e5-a962-0c8f248e1604 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.198s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:36:06 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9593ea92-755f-42e5-a962-0c8f248e1604 tempest-CreateVolumesFromSnapshotTest-1409429096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:36:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-262210295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29eb8b2d-ba54-455b-b142-4ff2f575b648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777f7c08b4764095acba00e5a37fe930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:36:05Z,use_quota=True,user_id='257fa4ecd16d44beb4df2249a95a337c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:36:06 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-9593ea92-755f-42e5-a962-0c8f248e1604 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Creating volume 29eb8b2d-ba54-455b-b142-4ff2f575b648 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:36:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9593ea92-755f-42e5-a962-0c8f248e1604 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:36:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9593ea92-755f-42e5-a962-0c8f248e1604 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:36:06 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9593ea92-755f-42e5-a962-0c8f248e1604 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:36:06 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9593ea92-755f-42e5-a962-0c8f248e1604 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:36:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9593ea92-755f-42e5-a962-0c8f248e1604 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:36:06 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9593ea92-755f-42e5-a962-0c8f248e1604 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:36:06 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-9593ea92-755f-42e5-a962-0c8f248e1604 tempest-CreateVolumesFromSnapshotTest-1409429096 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:36:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9593ea92-755f-42e5-a962-0c8f248e1604 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:06 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648 1073741824 Jun 02 03:36:06 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:06 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-51e59ba4-8c02-4eb2-bfe1-7decd131c97a tempest-SnapshotDependencyTests-1392321604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (987cbff6-4ba5-41e9-840b-51a797c32b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b86b310-9603-4a1f-a33f-c44d6269ade2', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:06 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-51e59ba4-8c02-4eb2-bfe1-7decd131c97a tempest-SnapshotDependencyTests-1392321604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ddd12cf-80a3-4dee-b94f-0faa24960db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:06 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-51e59ba4-8c02-4eb2-bfe1-7decd131c97a tempest-SnapshotDependencyTests-1392321604 None] Volume volume-6b86b310-9603-4a1f-a33f-c44d6269ade2 (6b86b310-9603-4a1f-a33f-c44d6269ade2): created successfully Jun 02 03:36:06 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-51e59ba4-8c02-4eb2-bfe1-7decd131c97a tempest-SnapshotDependencyTests-1392321604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ddd12cf-80a3-4dee-b94f-0faa24960db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:06 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-51e59ba4-8c02-4eb2-bfe1-7decd131c97a tempest-SnapshotDependencyTests-1392321604 None] Flow 'volume_create_manager' (9a30dbc7-ccf0-4f3e-bef3-cd36408885ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:36:06 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-51e59ba4-8c02-4eb2-bfe1-7decd131c97a tempest-SnapshotDependencyTests-1392321604 None] Created volume successfully. Jun 02 03:36:07 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9593ea92-755f-42e5-a962-0c8f248e1604 tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648 1073741824" returned: 0 in 0.795s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9593ea92-755f-42e5-a962-0c8f248e1604 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:07 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648 Jun 02 03:36:07 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5dac5333-364d-468e-ac13-5259bd0cca85 tempest-SnapshotDependencyTests-1392321604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:36:07 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9593ea92-755f-42e5-a962-0c8f248e1604 tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648" returned: 0 in 0.599s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:07 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9593ea92-755f-42e5-a962-0c8f248e1604 tempest-CreateVolumesFromSnapshotTest-1409429096 None] <== create_volume: return (1440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:36:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9593ea92-755f-42e5-a962-0c8f248e1604 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:36:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5dac5333-364d-468e-ac13-5259bd0cca85 tempest-SnapshotDependencyTests-1392321604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.533s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:36:07 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-5dac5333-364d-468e-ac13-5259bd0cca85 tempest-SnapshotDependencyTests-1392321604 None] Creating offline snapshot 6946b34e-294e-4879-83e9-246698a5ced5 of volume 6b86b310-9603-4a1f-a33f-c44d6269ade2 {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:36:07 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9593ea92-755f-42e5-a962-0c8f248e1604 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a1073d5-146c-4508-97e2-4778f2d7aa44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29eb8b2d-ba54-455b-b142-4ff2f575b648', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:07 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9593ea92-755f-42e5-a962-0c8f248e1604 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4239237b-f0f0-46d4-9aa5-cb41d7273dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:07 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[442e1da0-cbbc-4fcc-be08-e7922346f03f]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:36:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5dac5333-364d-468e-ac13-5259bd0cca85 tempest-SnapshotDependencyTests-1392321604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:07 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-9593ea92-755f-42e5-a962-0c8f248e1604 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Volume volume-29eb8b2d-ba54-455b-b142-4ff2f575b648 (29eb8b2d-ba54-455b-b142-4ff2f575b648): created successfully Jun 02 03:36:07 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9593ea92-755f-42e5-a962-0c8f248e1604 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4239237b-f0f0-46d4-9aa5-cb41d7273dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:07 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-9593ea92-755f-42e5-a962-0c8f248e1604 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Flow 'volume_create_manager' (06312d39-3d54-413b-96b4-6f91ca7d3a96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:36:08 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-9593ea92-755f-42e5-a962-0c8f248e1604 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Created volume successfully. Jun 02 03:36:08 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2 Jun 02 03:36:08 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1df97eb1-4ff4-412d-bda1-01444c79f86c tempest-CreateVolumesFromSnapshotTest-1409429096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:36:08 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5dac5333-364d-468e-ac13-5259bd0cca85 tempest-SnapshotDependencyTests-1392321604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2" returned: 0 in 0.714s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5dac5333-364d-468e-ac13-5259bd0cca85 tempest-SnapshotDependencyTests-1392321604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2.6946b34e-294e-4879-83e9-246698a5ced5 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:08 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2.6946b34e-294e-4879-83e9-246698a5ced5 1G Jun 02 03:36:08 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:09 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5dac5333-364d-468e-ac13-5259bd0cca85 tempest-SnapshotDependencyTests-1392321604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2.6946b34e-294e-4879-83e9-246698a5ced5 1G" returned: 0 in 0.723s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5dac5333-364d-468e-ac13-5259bd0cca85 tempest-SnapshotDependencyTests-1392321604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b86b310-9603-4a1f-a33f-c44d6269ade2 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2.6946b34e-294e-4879-83e9-246698a5ced5 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:09 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b86b310-9603-4a1f-a33f-c44d6269ade2 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2.6946b34e-294e-4879-83e9-246698a5ced5 Jun 02 03:36:09 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:09 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager._thread_info {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:36:09 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread count: 28 {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 02 03:36:09 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread info: [<_MainThread(MainThread, started 138618128814208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 02 03:36:10 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5dac5333-364d-468e-ac13-5259bd0cca85 tempest-SnapshotDependencyTests-1392321604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b86b310-9603-4a1f-a33f-c44d6269ade2 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2.6946b34e-294e-4879-83e9-246698a5ced5" returned: 0 in 0.632s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:10 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-5dac5333-364d-468e-ac13-5259bd0cca85 tempest-SnapshotDependencyTests-1392321604 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2.6946b34e-294e-4879-83e9-246698a5ced5 is being set with open permissions: ugo+rw Jun 02 03:36:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5dac5333-364d-468e-ac13-5259bd0cca85 tempest-SnapshotDependencyTests-1392321604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2.6946b34e-294e-4879-83e9-246698a5ced5 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:10 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2.6946b34e-294e-4879-83e9-246698a5ced5 Jun 02 03:36:10 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:10 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5dac5333-364d-468e-ac13-5259bd0cca85 tempest-SnapshotDependencyTests-1392321604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2.6946b34e-294e-4879-83e9-246698a5ced5" returned: 0 in 0.587s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5dac5333-364d-468e-ac13-5259bd0cca85 tempest-SnapshotDependencyTests-1392321604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:10 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2.info Jun 02 03:36:10 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:11 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5dac5333-364d-468e-ac13-5259bd0cca85 tempest-SnapshotDependencyTests-1392321604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2.info" returned: 0 in 0.585s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:11 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-5dac5333-364d-468e-ac13-5259bd0cca85 tempest-SnapshotDependencyTests-1392321604 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2.info is being set with open permissions: ugo+rw Jun 02 03:36:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5dac5333-364d-468e-ac13-5259bd0cca85 tempest-SnapshotDependencyTests-1392321604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:11 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2.info Jun 02 03:36:11 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:11 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5dac5333-364d-468e-ac13-5259bd0cca85 tempest-SnapshotDependencyTests-1392321604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2.info" returned: 0 in 0.605s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5dac5333-364d-468e-ac13-5259bd0cca85 tempest-SnapshotDependencyTests-1392321604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.932s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:36:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1df97eb1-4ff4-412d-bda1-01444c79f86c tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.274s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:36:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-1df97eb1-4ff4-412d-bda1-01444c79f86c tempest-CreateVolumesFromSnapshotTest-1409429096 None] Creating offline snapshot 364ea76c-342f-43d4-a452-b14ed3f99128 of volume 29eb8b2d-ba54-455b-b142-4ff2f575b648 {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:36:11 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-5dac5333-364d-468e-ac13-5259bd0cca85 tempest-SnapshotDependencyTests-1392321604 None] Create snapshot completed successfully Jun 02 03:36:11 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc55a6a-3485-4440-ad17-698908419c07]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:36:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1df97eb1-4ff4-412d-bda1-01444c79f86c tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:12 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648 Jun 02 03:36:12 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:12 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1df97eb1-4ff4-412d-bda1-01444c79f86c tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648" returned: 0 in 0.716s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1df97eb1-4ff4-412d-bda1-01444c79f86c tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648.364ea76c-342f-43d4-a452-b14ed3f99128 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:12 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648.364ea76c-342f-43d4-a452-b14ed3f99128 1G Jun 02 03:36:12 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:13 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=105,cinder:INSERT=27,cinder:UPDATE=142,cinder:DELETE=16 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:36:13 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:36:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Flow 'volume_create_manager' (e4bf14fa-893b-4103-8b94-2cf45b528328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:36:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3f83294-f747-4c9b-8481-acbf0229d71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3f83294-f747-4c9b-8481-acbf0229d71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eefbc0d-d08f-4d71-a065-84dfbcadb30f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c453c14667e1416f9875d1d900ab5644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6946b34e-294e-4879-83e9-246698a5ced5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:36:13Z,use_quota=True,user_id='c28266be1549443d87c3192a6e5c4abe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e2f08c6-7fa6-4868-a6e1-34b840c96512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e2f08c6-7fa6-4868-a6e1-34b840c96512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e08be845-3acc-42c4-bd10-25db56f5d1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e08be845-3acc-42c4-bd10-25db56f5d1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5eefbc0d-d08f-4d71-a065-84dfbcadb30f', 'volume_name': 'volume-5eefbc0d-d08f-4d71-a065-84dfbcadb30f', 'volume_size': 1, 'snapshot_id': '6946b34e-294e-4879-83e9-246698a5ced5'}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34045f6c-a7f9-412f-9c10-4ecb02ba8760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34045f6c-a7f9-412f-9c10-4ecb02ba8760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f632d0c1-3c07-4a41-b68c-87aaf4e89b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:13 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Volume 5eefbc0d-d08f-4d71-a065-84dfbcadb30f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5eefbc0d-d08f-4d71-a065-84dfbcadb30f', 'volume_size': 1, 'snapshot_id': '6946b34e-294e-4879-83e9-246698a5ced5'} Jun 02 03:36:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:36:13 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1df97eb1-4ff4-412d-bda1-01444c79f86c tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648.364ea76c-342f-43d4-a452-b14ed3f99128 1G" returned: 0 in 0.789s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1df97eb1-4ff4-412d-bda1-01444c79f86c tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29eb8b2d-ba54-455b-b142-4ff2f575b648 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648.364ea76c-342f-43d4-a452-b14ed3f99128 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:13 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29eb8b2d-ba54-455b-b142-4ff2f575b648 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648.364ea76c-342f-43d4-a452-b14ed3f99128 Jun 02 03:36:13 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:14 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1df97eb1-4ff4-412d-bda1-01444c79f86c tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29eb8b2d-ba54-455b-b142-4ff2f575b648 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648.364ea76c-342f-43d4-a452-b14ed3f99128" returned: 0 in 0.631s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:14 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-1df97eb1-4ff4-412d-bda1-01444c79f86c tempest-CreateVolumesFromSnapshotTest-1409429096 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648.364ea76c-342f-43d4-a452-b14ed3f99128 is being set with open permissions: ugo+rw Jun 02 03:36:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1df97eb1-4ff4-412d-bda1-01444c79f86c tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648.364ea76c-342f-43d4-a452-b14ed3f99128 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:14 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648.364ea76c-342f-43d4-a452-b14ed3f99128 Jun 02 03:36:14 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:14 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1df97eb1-4ff4-412d-bda1-01444c79f86c tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648.364ea76c-342f-43d4-a452-b14ed3f99128" returned: 0 in 0.586s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1df97eb1-4ff4-412d-bda1-01444c79f86c tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:14 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648.info Jun 02 03:36:14 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:15 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1df97eb1-4ff4-412d-bda1-01444c79f86c tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648.info" returned: 0 in 0.593s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:15 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-1df97eb1-4ff4-412d-bda1-01444c79f86c tempest-CreateVolumesFromSnapshotTest-1409429096 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648.info is being set with open permissions: ugo+rw Jun 02 03:36:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1df97eb1-4ff4-412d-bda1-01444c79f86c tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:15 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648.info Jun 02 03:36:15 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:15 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1df97eb1-4ff4-412d-bda1-01444c79f86c tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648.info" returned: 0 in 0.586s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1df97eb1-4ff4-412d-bda1-01444c79f86c tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.998s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:36:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.585s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:36:15 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Acquiring lock "cinder-quobyte-6946b34e-294e-4879-83e9-246698a5ced5-5eefbc0d-d08f-4d71-a065-84dfbcadb30f" by "_create_volume_from_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:36:15 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Lock "cinder-quobyte-6946b34e-294e-4879-83e9-246698a5ced5-5eefbc0d-d08f-4d71-a065-84dfbcadb30f" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:36:15 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Creating volume 5eefbc0d-d08f-4d71-a065-84dfbcadb30f from snapshot 6946b34e-294e-4879-83e9-246698a5ced5 {{(pid=86431) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 02 03:36:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:36:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:36:15 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:36:15 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:36:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:36:15 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:36:15 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Acquiring lock "cinder-quobyte-5eefbc0d-d08f-4d71-a065-84dfbcadb30f" by "_copy_volume_from_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:36:15 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-1df97eb1-4ff4-412d-bda1-01444c79f86c tempest-CreateVolumesFromSnapshotTest-1409429096 None] Create snapshot completed successfully Jun 02 03:36:15 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Lock "cinder-quobyte-5eefbc0d-d08f-4d71-a065-84dfbcadb30f" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:36:15 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] snapshot: 6946b34e-294e-4879-83e9-246698a5ced5, volume: 5eefbc0d-d08f-4d71-a065-84dfbcadb30f, {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 03:36:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:36:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:36:15 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:36:15 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:36:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:36:15 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[489e4e81-38f4-479d-b3cc-4351756331f3]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:36:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2.6946b34e-294e-4879-83e9-246698a5ced5 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:16 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2.6946b34e-294e-4879-83e9-246698a5ced5 Jun 02 03:36:16 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:16 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2.6946b34e-294e-4879-83e9-246698a5ced5" returned: 0 in 0.682s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:16 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b86b310-9603-4a1f-a33f-c44d6269ade2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:36:16 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2 {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 03:36:16 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Creating direct copy from snapshot {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 03:36:16 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ea8720-8bfc-475f-bdaf-e7e735d32ea3]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:36:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:16 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2 Jun 02 03:36:16 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:17 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5b4955c-f1de-4830-8803-cfb9fd9b6ab2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:36:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a5b4955c-f1de-4830-8803-cfb9fd9b6ab2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Flow 'volume_create_manager' (096f5a50-558e-40be-bc88-5119a95c882d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:36:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a5b4955c-f1de-4830-8803-cfb9fd9b6ab2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e18d1727-d039-4e17-aaac-b9caec811fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a5b4955c-f1de-4830-8803-cfb9fd9b6ab2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e18d1727-d039-4e17-aaac-b9caec811fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2106046232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a970193e-c316-4397-b1d5-4f2251325ed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777f7c08b4764095acba00e5a37fe930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:36:17Z,use_quota=True,user_id='257fa4ecd16d44beb4df2249a95a337c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a5b4955c-f1de-4830-8803-cfb9fd9b6ab2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec149cd-b934-4d89-bed7-64e1578a2dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a5b4955c-f1de-4830-8803-cfb9fd9b6ab2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec149cd-b934-4d89-bed7-64e1578a2dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a5b4955c-f1de-4830-8803-cfb9fd9b6ab2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4bbe268-bf72-4043-91ae-f150abd2220e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a5b4955c-f1de-4830-8803-cfb9fd9b6ab2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4bbe268-bf72-4043-91ae-f150abd2220e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a970193e-c316-4397-b1d5-4f2251325ed5', 'volume_name': 'volume-a970193e-c316-4397-b1d5-4f2251325ed5', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a5b4955c-f1de-4830-8803-cfb9fd9b6ab2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7326f1a-dcaf-4aa7-bd8e-6e2670e7fb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a5b4955c-f1de-4830-8803-cfb9fd9b6ab2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7326f1a-dcaf-4aa7-bd8e-6e2670e7fb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a5b4955c-f1de-4830-8803-cfb9fd9b6ab2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e123917-a606-4f60-86d6-65b5755e2844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:17 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-a5b4955c-f1de-4830-8803-cfb9fd9b6ab2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Volume a970193e-c316-4397-b1d5-4f2251325ed5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a970193e-c316-4397-b1d5-4f2251325ed5', 'volume_size': 1} Jun 02 03:36:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a5b4955c-f1de-4830-8803-cfb9fd9b6ab2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:36:17 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2" returned: 0 in 0.772s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:17 devstack cinder-volume[86431]: DEBUG cinder.utils [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Path /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5eefbc0d-d08f-4d71-a065-84dfbcadb30f not found in is_blk_device check {{(pid=86431) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 02 03:36:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5eefbc0d-d08f-4d71-a065-84dfbcadb30f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:17 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5eefbc0d-d08f-4d71-a065-84dfbcadb30f Jun 02 03:36:17 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:17 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4d2e291-74d4-403d-a6f9-fd3e8b6ba8d7 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:36:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b4d2e291-74d4-403d-a6f9-fd3e8b6ba8d7 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Flow 'volume_create_manager' (1f14bc09-1ecc-4421-bc61-780075d3f369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:36:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b4d2e291-74d4-403d-a6f9-fd3e8b6ba8d7 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a3c56b4-ae59-40f4-879c-35c92d3324c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b4d2e291-74d4-403d-a6f9-fd3e8b6ba8d7 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a3c56b4-ae59-40f4-879c-35c92d3324c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1474423663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42e5e3e8-3ae6-453c-bd9e-180696537548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777f7c08b4764095acba00e5a37fe930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:36:18Z,use_quota=True,user_id='257fa4ecd16d44beb4df2249a95a337c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b4d2e291-74d4-403d-a6f9-fd3e8b6ba8d7 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f64b67bc-eb68-404e-8819-265daf061b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b4d2e291-74d4-403d-a6f9-fd3e8b6ba8d7 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f64b67bc-eb68-404e-8819-265daf061b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b4d2e291-74d4-403d-a6f9-fd3e8b6ba8d7 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2222195-1e88-498f-ab28-59f86778c752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b4d2e291-74d4-403d-a6f9-fd3e8b6ba8d7 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2222195-1e88-498f-ab28-59f86778c752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42e5e3e8-3ae6-453c-bd9e-180696537548', 'volume_name': 'volume-42e5e3e8-3ae6-453c-bd9e-180696537548', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b4d2e291-74d4-403d-a6f9-fd3e8b6ba8d7 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ef2a26-d10b-4a2d-b26e-9a5bf0ac85c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b4d2e291-74d4-403d-a6f9-fd3e8b6ba8d7 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ef2a26-d10b-4a2d-b26e-9a5bf0ac85c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b4d2e291-74d4-403d-a6f9-fd3e8b6ba8d7 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff176e56-c0d3-4255-a42e-bd2b5e238171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:17 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-b4d2e291-74d4-403d-a6f9-fd3e8b6ba8d7 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Volume 42e5e3e8-3ae6-453c-bd9e-180696537548: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42e5e3e8-3ae6-453c-bd9e-180696537548', 'volume_size': 1} Jun 02 03:36:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b4d2e291-74d4-403d-a6f9-fd3e8b6ba8d7 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:36:18 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdfa8163-13ac-46c6-b9c1-bd594aff4d16 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:36:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-cdfa8163-13ac-46c6-b9c1-bd594aff4d16 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Flow 'volume_create_manager' (e32b486e-f042-4806-8c17-ef0aa15dbfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:36:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-cdfa8163-13ac-46c6-b9c1-bd594aff4d16 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea493d63-5bbe-4ef7-ab06-fade06579963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-cdfa8163-13ac-46c6-b9c1-bd594aff4d16 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea493d63-5bbe-4ef7-ab06-fade06579963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1654088196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba77cdec-f5ce-4ac4-b31d-7cafc50ce4a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777f7c08b4764095acba00e5a37fe930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:36:18Z,use_quota=True,user_id='257fa4ecd16d44beb4df2249a95a337c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-cdfa8163-13ac-46c6-b9c1-bd594aff4d16 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f9ff23-0d97-47ef-8da9-5251b6d762d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-cdfa8163-13ac-46c6-b9c1-bd594aff4d16 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f9ff23-0d97-47ef-8da9-5251b6d762d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-cdfa8163-13ac-46c6-b9c1-bd594aff4d16 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da58101-6da7-4813-b8bc-6c1e4bc35dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-cdfa8163-13ac-46c6-b9c1-bd594aff4d16 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da58101-6da7-4813-b8bc-6c1e4bc35dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba77cdec-f5ce-4ac4-b31d-7cafc50ce4a6', 'volume_name': 'volume-ba77cdec-f5ce-4ac4-b31d-7cafc50ce4a6', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-cdfa8163-13ac-46c6-b9c1-bd594aff4d16 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c25d3da-b860-49be-9377-a7ab1872dbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-cdfa8163-13ac-46c6-b9c1-bd594aff4d16 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c25d3da-b860-49be-9377-a7ab1872dbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-cdfa8163-13ac-46c6-b9c1-bd594aff4d16 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6fee18e-b339-4529-8ab6-09df88a12e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:18 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-cdfa8163-13ac-46c6-b9c1-bd594aff4d16 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Volume ba77cdec-f5ce-4ac4-b31d-7cafc50ce4a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba77cdec-f5ce-4ac4-b31d-7cafc50ce4a6', 'volume_size': 1} Jun 02 03:36:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-cdfa8163-13ac-46c6-b9c1-bd594aff4d16 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:36:18 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-d63af657-efc7-48f2-9651-e0d709187b32 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:36:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d63af657-efc7-48f2-9651-e0d709187b32 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Flow 'volume_create_manager' (556b7e5d-8d05-498b-9bbe-9b66e0c8a692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:36:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d63af657-efc7-48f2-9651-e0d709187b32 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b780c1c-4b9e-49f6-a22b-75d04bbc2bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d63af657-efc7-48f2-9651-e0d709187b32 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b780c1c-4b9e-49f6-a22b-75d04bbc2bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2076795157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b146e63-69e9-4b5f-8104-618c097fa96f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777f7c08b4764095acba00e5a37fe930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:36:18Z,use_quota=True,user_id='257fa4ecd16d44beb4df2249a95a337c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d63af657-efc7-48f2-9651-e0d709187b32 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d6dc67f-e53e-4018-a970-eaa9625d0ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d63af657-efc7-48f2-9651-e0d709187b32 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d6dc67f-e53e-4018-a970-eaa9625d0ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d63af657-efc7-48f2-9651-e0d709187b32 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c8ed170-e58e-49fe-a80e-214e0647fe91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d63af657-efc7-48f2-9651-e0d709187b32 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c8ed170-e58e-49fe-a80e-214e0647fe91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b146e63-69e9-4b5f-8104-618c097fa96f', 'volume_name': 'volume-9b146e63-69e9-4b5f-8104-618c097fa96f', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d63af657-efc7-48f2-9651-e0d709187b32 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56106398-774b-4075-9f20-2c5339da639e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d63af657-efc7-48f2-9651-e0d709187b32 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56106398-774b-4075-9f20-2c5339da639e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d63af657-efc7-48f2-9651-e0d709187b32 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (464f3d93-170b-4384-9b2d-ef46165c2604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:18 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-d63af657-efc7-48f2-9651-e0d709187b32 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Volume 9b146e63-69e9-4b5f-8104-618c097fa96f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b146e63-69e9-4b5f-8104-618c097fa96f', 'volume_size': 1} Jun 02 03:36:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d63af657-efc7-48f2-9651-e0d709187b32 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:36:19 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec2b1902-984b-4758-bf7f-ce0c75051926 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:36:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ec2b1902-984b-4758-bf7f-ce0c75051926 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Flow 'volume_create_manager' (001b7828-12c2-4ef0-a341-a74725136151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:36:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ec2b1902-984b-4758-bf7f-ce0c75051926 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dd9a08a-817a-46ff-b4bb-af4f2a410442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ec2b1902-984b-4758-bf7f-ce0c75051926 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dd9a08a-817a-46ff-b4bb-af4f2a410442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-864760036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7543a3aa-4303-4357-ab6b-03c8ca9dbf2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777f7c08b4764095acba00e5a37fe930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:36:20Z,use_quota=True,user_id='257fa4ecd16d44beb4df2249a95a337c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ec2b1902-984b-4758-bf7f-ce0c75051926 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f189546-b8e8-4f27-9611-804aab8fc555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ec2b1902-984b-4758-bf7f-ce0c75051926 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f189546-b8e8-4f27-9611-804aab8fc555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ec2b1902-984b-4758-bf7f-ce0c75051926 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59264482-d3af-4be5-96c0-33ab5631d462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ec2b1902-984b-4758-bf7f-ce0c75051926 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59264482-d3af-4be5-96c0-33ab5631d462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7543a3aa-4303-4357-ab6b-03c8ca9dbf2e', 'volume_name': 'volume-7543a3aa-4303-4357-ab6b-03c8ca9dbf2e', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ec2b1902-984b-4758-bf7f-ce0c75051926 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (004b9d16-009e-4e15-b9ab-bad94d3e52da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ec2b1902-984b-4758-bf7f-ce0c75051926 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (004b9d16-009e-4e15-b9ab-bad94d3e52da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ec2b1902-984b-4758-bf7f-ce0c75051926 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4534415b-193a-4463-acc8-94625ec3caa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:19 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-ec2b1902-984b-4758-bf7f-ce0c75051926 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Volume 7543a3aa-4303-4357-ab6b-03c8ca9dbf2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7543a3aa-4303-4357-ab6b-03c8ca9dbf2e', 'volume_size': 1} Jun 02 03:36:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ec2b1902-984b-4758-bf7f-ce0c75051926 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:36:22 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5eefbc0d-d08f-4d71-a065-84dfbcadb30f" returned: 0 in 4.830s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:22 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbb068e-a7d0-4fcb-b9eb-5d53739f9df8]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:36:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:22 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2 Jun 02 03:36:22 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:23 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2" returned: 0 in 0.864s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:23 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Image conversion details: src /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2, size 1024.00 MB, duration 4.83 sec, destination /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5eefbc0d-d08f-4d71-a065-84dfbcadb30f {{(pid=86431) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 02 03:36:23 devstack cinder-volume[86431]: INFO cinder.image.image_utils [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Converted 1024.00 MB image at 211.96 MB/s Jun 02 03:36:23 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5eefbc0d-d08f-4d71-a065-84dfbcadb30f is being set with open permissions: ugo+rw Jun 02 03:36:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5eefbc0d-d08f-4d71-a065-84dfbcadb30f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:23 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5eefbc0d-d08f-4d71-a065-84dfbcadb30f Jun 02 03:36:23 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:23 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5eefbc0d-d08f-4d71-a065-84dfbcadb30f" returned: 0 in 0.576s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:23 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Lock "cinder-quobyte-5eefbc0d-d08f-4d71-a065-84dfbcadb30f" released by "_copy_volume_from_snapshot" :: held 7.806s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:36:23 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Lock "cinder-quobyte-6946b34e-294e-4879-83e9-246698a5ced5-5eefbc0d-d08f-4d71-a065-84dfbcadb30f" released by "_create_volume_from_snapshot" :: held 7.839s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:36:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.860s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:36:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a5b4955c-f1de-4830-8803-cfb9fd9b6ab2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.349s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:36:23 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a5b4955c-f1de-4830-8803-cfb9fd9b6ab2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2106046232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a970193e-c316-4397-b1d5-4f2251325ed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777f7c08b4764095acba00e5a37fe930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:36:17Z,use_quota=True,user_id='257fa4ecd16d44beb4df2249a95a337c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:36:23 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-a5b4955c-f1de-4830-8803-cfb9fd9b6ab2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Creating volume a970193e-c316-4397-b1d5-4f2251325ed5 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:36:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a5b4955c-f1de-4830-8803-cfb9fd9b6ab2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:36:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a5b4955c-f1de-4830-8803-cfb9fd9b6ab2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:36:23 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a5b4955c-f1de-4830-8803-cfb9fd9b6ab2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:36:23 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a5b4955c-f1de-4830-8803-cfb9fd9b6ab2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:36:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a5b4955c-f1de-4830-8803-cfb9fd9b6ab2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:36:23 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a5b4955c-f1de-4830-8803-cfb9fd9b6ab2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:36:23 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-a5b4955c-f1de-4830-8803-cfb9fd9b6ab2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:36:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a5b4955c-f1de-4830-8803-cfb9fd9b6ab2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a970193e-c316-4397-b1d5-4f2251325ed5 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:23 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a970193e-c316-4397-b1d5-4f2251325ed5 1073741824 Jun 02 03:36:23 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:23 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f632d0c1-3c07-4a41-b68c-87aaf4e89b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eefbc0d-d08f-4d71-a065-84dfbcadb30f', 'volume_size': 1, 'snapshot_id': '6946b34e-294e-4879-83e9-246698a5ced5'}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:23 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e61dad-4a5a-4a23-953c-0f6dfc5d35f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:23 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Volume volume-5eefbc0d-d08f-4d71-a065-84dfbcadb30f (5eefbc0d-d08f-4d71-a065-84dfbcadb30f): created successfully Jun 02 03:36:23 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e61dad-4a5a-4a23-953c-0f6dfc5d35f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:23 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Flow 'volume_create_manager' (e4bf14fa-893b-4103-8b94-2cf45b528328) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:36:23 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-90a4eef2-f5fd-44d6-b0d7-50ba1c9c9032 tempest-SnapshotDependencyTests-1392321604 None] Created volume successfully. Jun 02 03:36:24 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2ba487f5-0fd5-4c5a-a518-6ff3375b19a0 tempest-SnapshotDependencyTests-1392321604 None] Acquiring lock "cinder-6946b34e-294e-4879-83e9-246698a5ced5-delete_snapshot" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:36:24 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2ba487f5-0fd5-4c5a-a518-6ff3375b19a0 tempest-SnapshotDependencyTests-1392321604 None] Lock "cinder-6946b34e-294e-4879-83e9-246698a5ced5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:36:24 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2ba487f5-0fd5-4c5a-a518-6ff3375b19a0 tempest-SnapshotDependencyTests-1392321604 None] Acquiring lock "cinder-quobyte-6b86b310-9603-4a1f-a33f-c44d6269ade2" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:36:24 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2ba487f5-0fd5-4c5a-a518-6ff3375b19a0 tempest-SnapshotDependencyTests-1392321604 None] Lock "cinder-quobyte-6b86b310-9603-4a1f-a33f-c44d6269ade2" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:36:24 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2ba487f5-0fd5-4c5a-a518-6ff3375b19a0 tempest-SnapshotDependencyTests-1392321604 None] Acquiring lock "cinder-quobyte-6946b34e-294e-4879-83e9-246698a5ced5" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:36:24 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2ba487f5-0fd5-4c5a-a518-6ff3375b19a0 tempest-SnapshotDependencyTests-1392321604 None] Lock "cinder-quobyte-6946b34e-294e-4879-83e9-246698a5ced5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:36:24 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-2ba487f5-0fd5-4c5a-a518-6ff3375b19a0 tempest-SnapshotDependencyTests-1392321604 None] Deleting offline snapshot 6946b34e-294e-4879-83e9-246698a5ced5 of volume 6b86b310-9603-4a1f-a33f-c44d6269ade2 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:36:24 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-2ba487f5-0fd5-4c5a-a518-6ff3375b19a0 tempest-SnapshotDependencyTests-1392321604 None] snapshot_file for this snap is: volume-6b86b310-9603-4a1f-a33f-c44d6269ade2.6946b34e-294e-4879-83e9-246698a5ced5 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:36:24 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[f169a84d-d862-4420-a209-0549dd7baaf2]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:36:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2ba487f5-0fd5-4c5a-a518-6ff3375b19a0 tempest-SnapshotDependencyTests-1392321604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2.6946b34e-294e-4879-83e9-246698a5ced5 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:24 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2.6946b34e-294e-4879-83e9-246698a5ced5 Jun 02 03:36:24 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:24 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a5b4955c-f1de-4830-8803-cfb9fd9b6ab2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a970193e-c316-4397-b1d5-4f2251325ed5 1073741824" returned: 0 in 0.784s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a5b4955c-f1de-4830-8803-cfb9fd9b6ab2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a970193e-c316-4397-b1d5-4f2251325ed5 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:24 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a970193e-c316-4397-b1d5-4f2251325ed5 Jun 02 03:36:24 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:25 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2ba487f5-0fd5-4c5a-a518-6ff3375b19a0 tempest-SnapshotDependencyTests-1392321604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2.6946b34e-294e-4879-83e9-246698a5ced5" returned: 0 in 0.752s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:25 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-2ba487f5-0fd5-4c5a-a518-6ff3375b19a0 tempest-SnapshotDependencyTests-1392321604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b86b310-9603-4a1f-a33f-c44d6269ade2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:36:25 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8f4ac0-a0ad-4eb6-85de-89c639fea35b]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:36:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2ba487f5-0fd5-4c5a-a518-6ff3375b19a0 tempest-SnapshotDependencyTests-1392321604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:25 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-a5b4955c-f1de-4830-8803-cfb9fd9b6ab2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a970193e-c316-4397-b1d5-4f2251325ed5" returned: 0 in 0.591s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:25 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-a5b4955c-f1de-4830-8803-cfb9fd9b6ab2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:36:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-a5b4955c-f1de-4830-8803-cfb9fd9b6ab2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:36:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b4d2e291-74d4-403d-a6f9-fd3e8b6ba8d7 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.440s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:36:25 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b4d2e291-74d4-403d-a6f9-fd3e8b6ba8d7 tempest-CreateVolumesFromSnapshotTest-1409429096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1474423663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42e5e3e8-3ae6-453c-bd9e-180696537548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777f7c08b4764095acba00e5a37fe930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:36:18Z,use_quota=True,user_id='257fa4ecd16d44beb4df2249a95a337c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:36:25 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-b4d2e291-74d4-403d-a6f9-fd3e8b6ba8d7 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Creating volume 42e5e3e8-3ae6-453c-bd9e-180696537548 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:36:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b4d2e291-74d4-403d-a6f9-fd3e8b6ba8d7 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:36:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b4d2e291-74d4-403d-a6f9-fd3e8b6ba8d7 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:36:25 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b4d2e291-74d4-403d-a6f9-fd3e8b6ba8d7 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:36:25 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b4d2e291-74d4-403d-a6f9-fd3e8b6ba8d7 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:36:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b4d2e291-74d4-403d-a6f9-fd3e8b6ba8d7 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:36:25 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b4d2e291-74d4-403d-a6f9-fd3e8b6ba8d7 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:36:25 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-b4d2e291-74d4-403d-a6f9-fd3e8b6ba8d7 tempest-CreateVolumesFromSnapshotTest-1409429096 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:36:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b4d2e291-74d4-403d-a6f9-fd3e8b6ba8d7 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-42e5e3e8-3ae6-453c-bd9e-180696537548 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:25 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2 Jun 02 03:36:25 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:25 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a5b4955c-f1de-4830-8803-cfb9fd9b6ab2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e123917-a606-4f60-86d6-65b5755e2844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a970193e-c316-4397-b1d5-4f2251325ed5', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:25 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-42e5e3e8-3ae6-453c-bd9e-180696537548 1073741824 Jun 02 03:36:25 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:25 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a5b4955c-f1de-4830-8803-cfb9fd9b6ab2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9374b809-6b4f-4019-be24-f0d2965e65f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:25 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-a5b4955c-f1de-4830-8803-cfb9fd9b6ab2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Volume volume-a970193e-c316-4397-b1d5-4f2251325ed5 (a970193e-c316-4397-b1d5-4f2251325ed5): created successfully Jun 02 03:36:25 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a5b4955c-f1de-4830-8803-cfb9fd9b6ab2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9374b809-6b4f-4019-be24-f0d2965e65f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:25 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-a5b4955c-f1de-4830-8803-cfb9fd9b6ab2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Flow 'volume_create_manager' (096f5a50-558e-40be-bc88-5119a95c882d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:36:25 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-a5b4955c-f1de-4830-8803-cfb9fd9b6ab2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Created volume successfully. Jun 02 03:36:25 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2ba487f5-0fd5-4c5a-a518-6ff3375b19a0 tempest-SnapshotDependencyTests-1392321604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2" returned: 0 in 0.709s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2ba487f5-0fd5-4c5a-a518-6ff3375b19a0 tempest-SnapshotDependencyTests-1392321604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2.6946b34e-294e-4879-83e9-246698a5ced5 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:25 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2.6946b34e-294e-4879-83e9-246698a5ced5 Jun 02 03:36:25 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:25 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b4d2e291-74d4-403d-a6f9-fd3e8b6ba8d7 tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-42e5e3e8-3ae6-453c-bd9e-180696537548 1073741824" returned: 0 in 0.762s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b4d2e291-74d4-403d-a6f9-fd3e8b6ba8d7 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-42e5e3e8-3ae6-453c-bd9e-180696537548 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:25 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-42e5e3e8-3ae6-453c-bd9e-180696537548 Jun 02 03:36:25 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:26 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2ba487f5-0fd5-4c5a-a518-6ff3375b19a0 tempest-SnapshotDependencyTests-1392321604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2.6946b34e-294e-4879-83e9-246698a5ced5" returned: 0 in 0.699s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2ba487f5-0fd5-4c5a-a518-6ff3375b19a0 tempest-SnapshotDependencyTests-1392321604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2.6946b34e-294e-4879-83e9-246698a5ced5 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:26 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2.6946b34e-294e-4879-83e9-246698a5ced5 Jun 02 03:36:26 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:26 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b4d2e291-74d4-403d-a6f9-fd3e8b6ba8d7 tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-42e5e3e8-3ae6-453c-bd9e-180696537548" returned: 0 in 0.625s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:26 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b4d2e291-74d4-403d-a6f9-fd3e8b6ba8d7 tempest-CreateVolumesFromSnapshotTest-1409429096 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:36:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b4d2e291-74d4-403d-a6f9-fd3e8b6ba8d7 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:36:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-cdfa8163-13ac-46c6-b9c1-bd594aff4d16 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.477s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:36:26 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-cdfa8163-13ac-46c6-b9c1-bd594aff4d16 tempest-CreateVolumesFromSnapshotTest-1409429096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1654088196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba77cdec-f5ce-4ac4-b31d-7cafc50ce4a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777f7c08b4764095acba00e5a37fe930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:36:18Z,use_quota=True,user_id='257fa4ecd16d44beb4df2249a95a337c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:36:26 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-cdfa8163-13ac-46c6-b9c1-bd594aff4d16 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Creating volume ba77cdec-f5ce-4ac4-b31d-7cafc50ce4a6 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:36:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-cdfa8163-13ac-46c6-b9c1-bd594aff4d16 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:36:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-cdfa8163-13ac-46c6-b9c1-bd594aff4d16 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:36:26 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-cdfa8163-13ac-46c6-b9c1-bd594aff4d16 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:36:26 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-cdfa8163-13ac-46c6-b9c1-bd594aff4d16 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:36:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-cdfa8163-13ac-46c6-b9c1-bd594aff4d16 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:36:26 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-cdfa8163-13ac-46c6-b9c1-bd594aff4d16 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:36:26 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-cdfa8163-13ac-46c6-b9c1-bd594aff4d16 tempest-CreateVolumesFromSnapshotTest-1409429096 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:36:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cdfa8163-13ac-46c6-b9c1-bd594aff4d16 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ba77cdec-f5ce-4ac4-b31d-7cafc50ce4a6 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:26 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ba77cdec-f5ce-4ac4-b31d-7cafc50ce4a6 1073741824 Jun 02 03:36:26 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b4d2e291-74d4-403d-a6f9-fd3e8b6ba8d7 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff176e56-c0d3-4255-a42e-bd2b5e238171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42e5e3e8-3ae6-453c-bd9e-180696537548', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b4d2e291-74d4-403d-a6f9-fd3e8b6ba8d7 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95092dee-3fb9-4bf2-8bdb-445433424697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:26 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-b4d2e291-74d4-403d-a6f9-fd3e8b6ba8d7 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Volume volume-42e5e3e8-3ae6-453c-bd9e-180696537548 (42e5e3e8-3ae6-453c-bd9e-180696537548): created successfully Jun 02 03:36:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b4d2e291-74d4-403d-a6f9-fd3e8b6ba8d7 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95092dee-3fb9-4bf2-8bdb-445433424697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b4d2e291-74d4-403d-a6f9-fd3e8b6ba8d7 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Flow 'volume_create_manager' (1f14bc09-1ecc-4421-bc61-780075d3f369) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:36:26 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-b4d2e291-74d4-403d-a6f9-fd3e8b6ba8d7 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Created volume successfully. Jun 02 03:36:27 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2ba487f5-0fd5-4c5a-a518-6ff3375b19a0 tempest-SnapshotDependencyTests-1392321604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2.6946b34e-294e-4879-83e9-246698a5ced5" returned: 0 in 0.602s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:27 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2ba487f5-0fd5-4c5a-a518-6ff3375b19a0 tempest-SnapshotDependencyTests-1392321604 None] Lock "cinder-quobyte-6946b34e-294e-4879-83e9-246698a5ced5" released by "_delete_snapshot" :: held 2.869s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:36:27 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2ba487f5-0fd5-4c5a-a518-6ff3375b19a0 tempest-SnapshotDependencyTests-1392321604 None] Lock "cinder-quobyte-6b86b310-9603-4a1f-a33f-c44d6269ade2" released by "delete_snapshot" :: held 2.904s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:36:27 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-2ba487f5-0fd5-4c5a-a518-6ff3375b19a0 tempest-SnapshotDependencyTests-1392321604 None] Created reservations ['63d0e8e4-1080-4079-8ecd-356541847411', 'ae577410-542c-420c-8d49-b1f61b183720', '996dfbc3-39fd-4f97-91cf-0a3a09dfd6fc', '101607b1-d32c-48d8-88e1-910a61e0a23f'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:36:27 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-2ba487f5-0fd5-4c5a-a518-6ff3375b19a0 tempest-SnapshotDependencyTests-1392321604 None] Delete snapshot completed successfully. Jun 02 03:36:27 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-2ba487f5-0fd5-4c5a-a518-6ff3375b19a0 tempest-SnapshotDependencyTests-1392321604 None] Lock "cinder-6946b34e-294e-4879-83e9-246698a5ced5-delete_snapshot" released by "delete_snapshot" :: held 3.067s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:36:27 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-243c8e4f-16da-48cb-93aa-b9c01552d396 tempest-SnapshotDependencyTests-1392321604 None] Acquiring lock "cinder-6b86b310-9603-4a1f-a33f-c44d6269ade2-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:36:27 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-243c8e4f-16da-48cb-93aa-b9c01552d396 tempest-SnapshotDependencyTests-1392321604 None] Lock "cinder-6b86b310-9603-4a1f-a33f-c44d6269ade2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:36:27 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-243c8e4f-16da-48cb-93aa-b9c01552d396 tempest-SnapshotDependencyTests-1392321604 None] Acquiring lock "cinder-quobyte-6b86b310-9603-4a1f-a33f-c44d6269ade2" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:36:27 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-243c8e4f-16da-48cb-93aa-b9c01552d396 tempest-SnapshotDependencyTests-1392321604 None] Lock "cinder-quobyte-6b86b310-9603-4a1f-a33f-c44d6269ade2" acquired by "delete_volume" :: waited 0.031s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:36:27 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cdfa8163-13ac-46c6-b9c1-bd594aff4d16 tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ba77cdec-f5ce-4ac4-b31d-7cafc50ce4a6 1073741824" returned: 0 in 0.922s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:27 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[3979b48c-ff65-44d9-a9d1-550828660c39]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:36:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-243c8e4f-16da-48cb-93aa-b9c01552d396 tempest-SnapshotDependencyTests-1392321604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cdfa8163-13ac-46c6-b9c1-bd594aff4d16 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ba77cdec-f5ce-4ac4-b31d-7cafc50ce4a6 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:27 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ba77cdec-f5ce-4ac4-b31d-7cafc50ce4a6 Jun 02 03:36:27 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:27 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2 Jun 02 03:36:27 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:28 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-cdfa8163-13ac-46c6-b9c1-bd594aff4d16 tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ba77cdec-f5ce-4ac4-b31d-7cafc50ce4a6" returned: 0 in 0.597s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:28 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-cdfa8163-13ac-46c6-b9c1-bd594aff4d16 tempest-CreateVolumesFromSnapshotTest-1409429096 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:36:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-cdfa8163-13ac-46c6-b9c1-bd594aff4d16 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:36:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d63af657-efc7-48f2-9651-e0d709187b32 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.296s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:36:28 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-d63af657-efc7-48f2-9651-e0d709187b32 tempest-CreateVolumesFromSnapshotTest-1409429096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2076795157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b146e63-69e9-4b5f-8104-618c097fa96f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777f7c08b4764095acba00e5a37fe930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:36:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:36:18Z,use_quota=True,user_id='257fa4ecd16d44beb4df2249a95a337c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:36:28 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-d63af657-efc7-48f2-9651-e0d709187b32 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Creating volume 9b146e63-69e9-4b5f-8104-618c097fa96f {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:36:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d63af657-efc7-48f2-9651-e0d709187b32 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:36:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d63af657-efc7-48f2-9651-e0d709187b32 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:36:28 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-d63af657-efc7-48f2-9651-e0d709187b32 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:36:28 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-d63af657-efc7-48f2-9651-e0d709187b32 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:36:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d63af657-efc7-48f2-9651-e0d709187b32 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:36:28 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-d63af657-efc7-48f2-9651-e0d709187b32 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:36:28 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-d63af657-efc7-48f2-9651-e0d709187b32 tempest-CreateVolumesFromSnapshotTest-1409429096 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:36:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d63af657-efc7-48f2-9651-e0d709187b32 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9b146e63-69e9-4b5f-8104-618c097fa96f 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:28 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9b146e63-69e9-4b5f-8104-618c097fa96f 1073741824 Jun 02 03:36:28 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:28 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-cdfa8163-13ac-46c6-b9c1-bd594aff4d16 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6fee18e-b339-4529-8ab6-09df88a12e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba77cdec-f5ce-4ac4-b31d-7cafc50ce4a6', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:28 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-cdfa8163-13ac-46c6-b9c1-bd594aff4d16 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4dfde3b-6ab4-4070-98e1-1b018fd4e37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:28 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-cdfa8163-13ac-46c6-b9c1-bd594aff4d16 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Volume volume-ba77cdec-f5ce-4ac4-b31d-7cafc50ce4a6 (ba77cdec-f5ce-4ac4-b31d-7cafc50ce4a6): created successfully Jun 02 03:36:28 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-cdfa8163-13ac-46c6-b9c1-bd594aff4d16 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4dfde3b-6ab4-4070-98e1-1b018fd4e37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:28 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-cdfa8163-13ac-46c6-b9c1-bd594aff4d16 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Flow 'volume_create_manager' (e32b486e-f042-4806-8c17-ef0aa15dbfc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:36:28 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-cdfa8163-13ac-46c6-b9c1-bd594aff4d16 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Created volume successfully. Jun 02 03:36:28 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-243c8e4f-16da-48cb-93aa-b9c01552d396 tempest-SnapshotDependencyTests-1392321604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2" returned: 0 in 0.734s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-243c8e4f-16da-48cb-93aa-b9c01552d396 tempest-SnapshotDependencyTests-1392321604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:28 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2 Jun 02 03:36:28 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:28 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-243c8e4f-16da-48cb-93aa-b9c01552d396 tempest-SnapshotDependencyTests-1392321604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6b86b310-9603-4a1f-a33f-c44d6269ade2" returned: 0 in 0.584s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:28 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-243c8e4f-16da-48cb-93aa-b9c01552d396 tempest-SnapshotDependencyTests-1392321604 None] Lock "cinder-quobyte-6b86b310-9603-4a1f-a33f-c44d6269ade2" released by "delete_volume" :: held 1.393s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:36:28 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-243c8e4f-16da-48cb-93aa-b9c01552d396 tempest-SnapshotDependencyTests-1392321604 None] Created reservations ['81de6b67-291e-4a38-800c-0bca79b178cd', '5f76f16f-872c-4d8b-bdba-f1ee47fc60e9', '83f5ce33-0071-41ae-ab97-f1b0e6650f5b', 'e83d4a0b-3665-486f-a244-217d2552a828'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:36:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-243c8e4f-16da-48cb-93aa-b9c01552d396 tempest-SnapshotDependencyTests-1392321604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:36:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-243c8e4f-16da-48cb-93aa-b9c01552d396 tempest-SnapshotDependencyTests-1392321604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:36:28 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-243c8e4f-16da-48cb-93aa-b9c01552d396 tempest-SnapshotDependencyTests-1392321604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:36:28 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-243c8e4f-16da-48cb-93aa-b9c01552d396 tempest-SnapshotDependencyTests-1392321604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:36:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-243c8e4f-16da-48cb-93aa-b9c01552d396 tempest-SnapshotDependencyTests-1392321604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:36:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-243c8e4f-16da-48cb-93aa-b9c01552d396 tempest-SnapshotDependencyTests-1392321604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:28 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d63af657-efc7-48f2-9651-e0d709187b32 tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9b146e63-69e9-4b5f-8104-618c097fa96f 1073741824" returned: 0 in 0.819s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:29 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:36:29 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d63af657-efc7-48f2-9651-e0d709187b32 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9b146e63-69e9-4b5f-8104-618c097fa96f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:29 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9b146e63-69e9-4b5f-8104-618c097fa96f Jun 02 03:36:29 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:29 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-243c8e4f-16da-48cb-93aa-b9c01552d396 tempest-SnapshotDependencyTests-1392321604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.591s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:29 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-243c8e4f-16da-48cb-93aa-b9c01552d396 tempest-SnapshotDependencyTests-1392321604 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:36:29 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-243c8e4f-16da-48cb-93aa-b9c01552d396 tempest-SnapshotDependencyTests-1392321604 None] Deleted volume successfully. Jun 02 03:36:29 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-243c8e4f-16da-48cb-93aa-b9c01552d396 tempest-SnapshotDependencyTests-1392321604 None] Lock "cinder-6b86b310-9603-4a1f-a33f-c44d6269ade2-delete_volume" released by "delete_volume" :: held 2.201s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:36:29 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-d63af657-efc7-48f2-9651-e0d709187b32 tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9b146e63-69e9-4b5f-8104-618c097fa96f" returned: 0 in 0.594s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:29 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-d63af657-efc7-48f2-9651-e0d709187b32 tempest-CreateVolumesFromSnapshotTest-1409429096 None] <== create_volume: return (1455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:36:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-d63af657-efc7-48f2-9651-e0d709187b32 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.458s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:36:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ec2b1902-984b-4758-bf7f-ce0c75051926 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.841s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:36:29 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ec2b1902-984b-4758-bf7f-ce0c75051926 tempest-CreateVolumesFromSnapshotTest-1409429096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-864760036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7543a3aa-4303-4357-ab6b-03c8ca9dbf2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777f7c08b4764095acba00e5a37fe930',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:36:20Z,use_quota=True,user_id='257fa4ecd16d44beb4df2249a95a337c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:36:29 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-ec2b1902-984b-4758-bf7f-ce0c75051926 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Creating volume 7543a3aa-4303-4357-ab6b-03c8ca9dbf2e {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:36:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ec2b1902-984b-4758-bf7f-ce0c75051926 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:36:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ec2b1902-984b-4758-bf7f-ce0c75051926 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:36:29 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ec2b1902-984b-4758-bf7f-ce0c75051926 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:36:29 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ec2b1902-984b-4758-bf7f-ce0c75051926 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:36:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ec2b1902-984b-4758-bf7f-ce0c75051926 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:36:29 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ec2b1902-984b-4758-bf7f-ce0c75051926 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:36:29 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-ec2b1902-984b-4758-bf7f-ce0c75051926 tempest-CreateVolumesFromSnapshotTest-1409429096 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:36:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ec2b1902-984b-4758-bf7f-ce0c75051926 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7543a3aa-4303-4357-ab6b-03c8ca9dbf2e 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:29 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ade9d28e-c89c-4132-8fbb-dbb83e15fb97 tempest-SnapshotDependencyTests-1392321604 None] Acquiring lock "cinder-5eefbc0d-d08f-4d71-a065-84dfbcadb30f-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:36:29 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7543a3aa-4303-4357-ab6b-03c8ca9dbf2e 1073741824 Jun 02 03:36:29 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:29 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d63af657-efc7-48f2-9651-e0d709187b32 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (464f3d93-170b-4384-9b2d-ef46165c2604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b146e63-69e9-4b5f-8104-618c097fa96f', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:29 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d63af657-efc7-48f2-9651-e0d709187b32 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed029c9-f5dd-408f-b072-a6e4df702571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:29 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ade9d28e-c89c-4132-8fbb-dbb83e15fb97 tempest-SnapshotDependencyTests-1392321604 None] Lock "cinder-5eefbc0d-d08f-4d71-a065-84dfbcadb30f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:36:29 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-d63af657-efc7-48f2-9651-e0d709187b32 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Volume volume-9b146e63-69e9-4b5f-8104-618c097fa96f (9b146e63-69e9-4b5f-8104-618c097fa96f): created successfully Jun 02 03:36:29 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d63af657-efc7-48f2-9651-e0d709187b32 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ed029c9-f5dd-408f-b072-a6e4df702571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:29 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-d63af657-efc7-48f2-9651-e0d709187b32 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Flow 'volume_create_manager' (556b7e5d-8d05-498b-9bbe-9b66e0c8a692) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:36:29 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-d63af657-efc7-48f2-9651-e0d709187b32 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Created volume successfully. Jun 02 03:36:29 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ade9d28e-c89c-4132-8fbb-dbb83e15fb97 tempest-SnapshotDependencyTests-1392321604 None] Acquiring lock "cinder-quobyte-5eefbc0d-d08f-4d71-a065-84dfbcadb30f" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:36:29 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ade9d28e-c89c-4132-8fbb-dbb83e15fb97 tempest-SnapshotDependencyTests-1392321604 None] Lock "cinder-quobyte-5eefbc0d-d08f-4d71-a065-84dfbcadb30f" acquired by "delete_volume" :: waited 0.019s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:36:29 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[90949fe5-eb5d-4b2c-8ae4-33f081970da4]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:36:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ade9d28e-c89c-4132-8fbb-dbb83e15fb97 tempest-SnapshotDependencyTests-1392321604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5eefbc0d-d08f-4d71-a065-84dfbcadb30f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:29 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5eefbc0d-d08f-4d71-a065-84dfbcadb30f Jun 02 03:36:29 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:30 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ec2b1902-984b-4758-bf7f-ce0c75051926 tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7543a3aa-4303-4357-ab6b-03c8ca9dbf2e 1073741824" returned: 0 in 0.772s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ec2b1902-984b-4758-bf7f-ce0c75051926 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7543a3aa-4303-4357-ab6b-03c8ca9dbf2e {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:30 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7543a3aa-4303-4357-ab6b-03c8ca9dbf2e Jun 02 03:36:30 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:30 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ade9d28e-c89c-4132-8fbb-dbb83e15fb97 tempest-SnapshotDependencyTests-1392321604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5eefbc0d-d08f-4d71-a065-84dfbcadb30f" returned: 0 in 0.741s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ade9d28e-c89c-4132-8fbb-dbb83e15fb97 tempest-SnapshotDependencyTests-1392321604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5eefbc0d-d08f-4d71-a065-84dfbcadb30f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:30 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5eefbc0d-d08f-4d71-a065-84dfbcadb30f Jun 02 03:36:30 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:31 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ec2b1902-984b-4758-bf7f-ce0c75051926 tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7543a3aa-4303-4357-ab6b-03c8ca9dbf2e" returned: 0 in 0.584s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:31 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ec2b1902-984b-4758-bf7f-ce0c75051926 tempest-CreateVolumesFromSnapshotTest-1409429096 None] <== create_volume: return (1400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:36:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ec2b1902-984b-4758-bf7f-ce0c75051926 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:36:31 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ec2b1902-984b-4758-bf7f-ce0c75051926 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4534415b-193a-4463-acc8-94625ec3caa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7543a3aa-4303-4357-ab6b-03c8ca9dbf2e', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:31 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ec2b1902-984b-4758-bf7f-ce0c75051926 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daf94f29-bcc7-42b5-8e40-2578e838f943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:31 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-ec2b1902-984b-4758-bf7f-ce0c75051926 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Volume volume-7543a3aa-4303-4357-ab6b-03c8ca9dbf2e (7543a3aa-4303-4357-ab6b-03c8ca9dbf2e): created successfully Jun 02 03:36:31 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ec2b1902-984b-4758-bf7f-ce0c75051926 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daf94f29-bcc7-42b5-8e40-2578e838f943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:31 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-ec2b1902-984b-4758-bf7f-ce0c75051926 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Flow 'volume_create_manager' (001b7828-12c2-4ef0-a341-a74725136151) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:36:31 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-ec2b1902-984b-4758-bf7f-ce0c75051926 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Created volume successfully. Jun 02 03:36:31 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ade9d28e-c89c-4132-8fbb-dbb83e15fb97 tempest-SnapshotDependencyTests-1392321604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-5eefbc0d-d08f-4d71-a065-84dfbcadb30f" returned: 0 in 0.600s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:31 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ade9d28e-c89c-4132-8fbb-dbb83e15fb97 tempest-SnapshotDependencyTests-1392321604 None] Lock "cinder-quobyte-5eefbc0d-d08f-4d71-a065-84dfbcadb30f" released by "delete_volume" :: held 1.388s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:36:31 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-ade9d28e-c89c-4132-8fbb-dbb83e15fb97 tempest-SnapshotDependencyTests-1392321604 None] Created reservations ['02fa5336-65d5-4909-8d26-f2f9d71be77e', '8456d943-1307-4d9c-9c45-c79637c72346', 'cf75ff38-b14b-4605-b66e-11e59f8414a9', 'a2dda4fa-a06e-4cc3-80bb-e20cb435d818'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:36:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ade9d28e-c89c-4132-8fbb-dbb83e15fb97 tempest-SnapshotDependencyTests-1392321604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:36:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ade9d28e-c89c-4132-8fbb-dbb83e15fb97 tempest-SnapshotDependencyTests-1392321604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:36:31 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ade9d28e-c89c-4132-8fbb-dbb83e15fb97 tempest-SnapshotDependencyTests-1392321604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:36:31 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-ade9d28e-c89c-4132-8fbb-dbb83e15fb97 tempest-SnapshotDependencyTests-1392321604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:36:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-ade9d28e-c89c-4132-8fbb-dbb83e15fb97 tempest-SnapshotDependencyTests-1392321604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:36:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ade9d28e-c89c-4132-8fbb-dbb83e15fb97 tempest-SnapshotDependencyTests-1392321604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:31 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:36:31 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:31 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7f557766-3f05-4021-81f5-f2613c4cace2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Acquiring lock "cinder-7543a3aa-4303-4357-ab6b-03c8ca9dbf2e-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:36:31 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7f557766-3f05-4021-81f5-f2613c4cace2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "cinder-7543a3aa-4303-4357-ab6b-03c8ca9dbf2e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:36:31 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7f557766-3f05-4021-81f5-f2613c4cace2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Acquiring lock "cinder-quobyte-7543a3aa-4303-4357-ab6b-03c8ca9dbf2e" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:36:31 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7f557766-3f05-4021-81f5-f2613c4cace2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "cinder-quobyte-7543a3aa-4303-4357-ab6b-03c8ca9dbf2e" acquired by "delete_volume" :: waited 0.014s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:36:31 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80eb69a-28c5-4b36-8178-8d50dae0a6f8]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:36:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7f557766-3f05-4021-81f5-f2613c4cace2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7543a3aa-4303-4357-ab6b-03c8ca9dbf2e {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:31 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7543a3aa-4303-4357-ab6b-03c8ca9dbf2e Jun 02 03:36:31 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:31 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-ade9d28e-c89c-4132-8fbb-dbb83e15fb97 tempest-SnapshotDependencyTests-1392321604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.646s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:31 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-ade9d28e-c89c-4132-8fbb-dbb83e15fb97 tempest-SnapshotDependencyTests-1392321604 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:36:31 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-ade9d28e-c89c-4132-8fbb-dbb83e15fb97 tempest-SnapshotDependencyTests-1392321604 None] Deleted volume successfully. Jun 02 03:36:31 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-ade9d28e-c89c-4132-8fbb-dbb83e15fb97 tempest-SnapshotDependencyTests-1392321604 None] Lock "cinder-5eefbc0d-d08f-4d71-a065-84dfbcadb30f-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:36:32 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7f557766-3f05-4021-81f5-f2613c4cace2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7543a3aa-4303-4357-ab6b-03c8ca9dbf2e" returned: 0 in 0.743s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7f557766-3f05-4021-81f5-f2613c4cace2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7543a3aa-4303-4357-ab6b-03c8ca9dbf2e {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:32 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7543a3aa-4303-4357-ab6b-03c8ca9dbf2e Jun 02 03:36:32 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:33 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7f557766-3f05-4021-81f5-f2613c4cace2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-7543a3aa-4303-4357-ab6b-03c8ca9dbf2e" returned: 0 in 0.630s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:33 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7f557766-3f05-4021-81f5-f2613c4cace2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "cinder-quobyte-7543a3aa-4303-4357-ab6b-03c8ca9dbf2e" released by "delete_volume" :: held 1.413s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:36:33 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-7f557766-3f05-4021-81f5-f2613c4cace2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Created reservations ['2ffd54bb-e1a8-4197-8a76-4c9739fc9a33', 'c35c415c-2c06-44c4-9211-de1b8f2c8797', 'd0b689c4-3d6f-4a63-bc2e-21f57bc05657', '98191592-d904-4a9e-97ba-561ef473fdf0'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:36:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7f557766-3f05-4021-81f5-f2613c4cace2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:36:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7f557766-3f05-4021-81f5-f2613c4cace2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:36:33 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-7f557766-3f05-4021-81f5-f2613c4cace2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:36:33 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-7f557766-3f05-4021-81f5-f2613c4cace2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:36:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-7f557766-3f05-4021-81f5-f2613c4cace2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:36:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7f557766-3f05-4021-81f5-f2613c4cace2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:33 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:36:33 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:33 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-7f557766-3f05-4021-81f5-f2613c4cace2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.627s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:33 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-7f557766-3f05-4021-81f5-f2613c4cace2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:36:33 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-3b864ddf-e8a7-40b8-beda-3c4798977d4b tempest-CreateVolumesFromSnapshotTest-1409429096 None] Acquiring lock "cinder-9b146e63-69e9-4b5f-8104-618c097fa96f-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:36:33 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-7f557766-3f05-4021-81f5-f2613c4cace2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Deleted volume successfully. Jun 02 03:36:33 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-3b864ddf-e8a7-40b8-beda-3c4798977d4b tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "cinder-9b146e63-69e9-4b5f-8104-618c097fa96f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:36:33 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-7f557766-3f05-4021-81f5-f2613c4cace2 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "cinder-7543a3aa-4303-4357-ab6b-03c8ca9dbf2e-delete_volume" released by "delete_volume" :: held 2.274s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:36:33 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-3b864ddf-e8a7-40b8-beda-3c4798977d4b tempest-CreateVolumesFromSnapshotTest-1409429096 None] Acquiring lock "cinder-quobyte-9b146e63-69e9-4b5f-8104-618c097fa96f" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:36:33 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-3b864ddf-e8a7-40b8-beda-3c4798977d4b tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "cinder-quobyte-9b146e63-69e9-4b5f-8104-618c097fa96f" acquired by "delete_volume" :: waited 0.016s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:36:33 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d45c7ba-91a0-4c68-906e-86dd657e314b]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:36:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3b864ddf-e8a7-40b8-beda-3c4798977d4b tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9b146e63-69e9-4b5f-8104-618c097fa96f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:34 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9b146e63-69e9-4b5f-8104-618c097fa96f Jun 02 03:36:34 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:34 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3b864ddf-e8a7-40b8-beda-3c4798977d4b tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9b146e63-69e9-4b5f-8104-618c097fa96f" returned: 0 in 0.799s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3b864ddf-e8a7-40b8-beda-3c4798977d4b tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9b146e63-69e9-4b5f-8104-618c097fa96f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:34 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9b146e63-69e9-4b5f-8104-618c097fa96f Jun 02 03:36:34 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:35 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3b864ddf-e8a7-40b8-beda-3c4798977d4b tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9b146e63-69e9-4b5f-8104-618c097fa96f" returned: 0 in 0.645s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:35 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-3b864ddf-e8a7-40b8-beda-3c4798977d4b tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "cinder-quobyte-9b146e63-69e9-4b5f-8104-618c097fa96f" released by "delete_volume" :: held 1.489s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:36:35 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-3b864ddf-e8a7-40b8-beda-3c4798977d4b tempest-CreateVolumesFromSnapshotTest-1409429096 None] Created reservations ['0d6bb66a-4017-4aba-80f0-f5a52f4a3701', 'd5911a0f-f9ae-452c-86ef-c822d76ac857', '3805182b-8d16-4423-9408-06f049aad555', 'a098a37f-d89a-4736-9044-a4e9a81a5cc7'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:36:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3b864ddf-e8a7-40b8-beda-3c4798977d4b tempest-CreateVolumesFromSnapshotTest-1409429096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:36:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3b864ddf-e8a7-40b8-beda-3c4798977d4b tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:36:35 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3b864ddf-e8a7-40b8-beda-3c4798977d4b tempest-CreateVolumesFromSnapshotTest-1409429096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:36:35 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-3b864ddf-e8a7-40b8-beda-3c4798977d4b tempest-CreateVolumesFromSnapshotTest-1409429096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:36:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-3b864ddf-e8a7-40b8-beda-3c4798977d4b tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:36:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3b864ddf-e8a7-40b8-beda-3c4798977d4b tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:35 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:36:35 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e2a8d4f7-65a7-40c5-bb56-a0db385f5929 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Acquiring lock "cinder-ba77cdec-f5ce-4ac4-b31d-7cafc50ce4a6-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:36:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e2a8d4f7-65a7-40c5-bb56-a0db385f5929 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "cinder-ba77cdec-f5ce-4ac4-b31d-7cafc50ce4a6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:36:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e2a8d4f7-65a7-40c5-bb56-a0db385f5929 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Acquiring lock "cinder-quobyte-ba77cdec-f5ce-4ac4-b31d-7cafc50ce4a6" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:36:36 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e2a8d4f7-65a7-40c5-bb56-a0db385f5929 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "cinder-quobyte-ba77cdec-f5ce-4ac4-b31d-7cafc50ce4a6" acquired by "delete_volume" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:36:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-3b864ddf-e8a7-40b8-beda-3c4798977d4b tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.643s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:36 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-3b864ddf-e8a7-40b8-beda-3c4798977d4b tempest-CreateVolumesFromSnapshotTest-1409429096 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:36:36 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-3b864ddf-e8a7-40b8-beda-3c4798977d4b tempest-CreateVolumesFromSnapshotTest-1409429096 None] Deleted volume successfully. Jun 02 03:36:36 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[24552a47-2d19-4e0f-98ba-f9ea634c79a5]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:36:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e2a8d4f7-65a7-40c5-bb56-a0db385f5929 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ba77cdec-f5ce-4ac4-b31d-7cafc50ce4a6 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-3b864ddf-e8a7-40b8-beda-3c4798977d4b tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "cinder-9b146e63-69e9-4b5f-8104-618c097fa96f-delete_volume" released by "delete_volume" :: held 2.348s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:36:36 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ba77cdec-f5ce-4ac4-b31d-7cafc50ce4a6 Jun 02 03:36:36 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:36 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e2a8d4f7-65a7-40c5-bb56-a0db385f5929 tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ba77cdec-f5ce-4ac4-b31d-7cafc50ce4a6" returned: 0 in 0.730s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e2a8d4f7-65a7-40c5-bb56-a0db385f5929 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ba77cdec-f5ce-4ac4-b31d-7cafc50ce4a6 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:36 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ba77cdec-f5ce-4ac4-b31d-7cafc50ce4a6 Jun 02 03:36:36 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:37 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e2a8d4f7-65a7-40c5-bb56-a0db385f5929 tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ba77cdec-f5ce-4ac4-b31d-7cafc50ce4a6" returned: 0 in 0.673s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:37 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e2a8d4f7-65a7-40c5-bb56-a0db385f5929 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "cinder-quobyte-ba77cdec-f5ce-4ac4-b31d-7cafc50ce4a6" released by "delete_volume" :: held 1.456s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:36:37 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-e2a8d4f7-65a7-40c5-bb56-a0db385f5929 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Created reservations ['bc74fa7c-3632-4296-9846-8f04922a9258', '8598cfeb-807c-488c-b853-fd2b4d363850', '5d0a35ef-51e7-4304-aeca-b1354386cf9a', '0e4088e9-5329-4955-af49-e02ecb43e5ce'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:36:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e2a8d4f7-65a7-40c5-bb56-a0db385f5929 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:36:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e2a8d4f7-65a7-40c5-bb56-a0db385f5929 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:36:37 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e2a8d4f7-65a7-40c5-bb56-a0db385f5929 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:36:37 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e2a8d4f7-65a7-40c5-bb56-a0db385f5929 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:36:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e2a8d4f7-65a7-40c5-bb56-a0db385f5929 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:36:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e2a8d4f7-65a7-40c5-bb56-a0db385f5929 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:37 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:36:37 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:38 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e7d868c3-1c19-410d-9253-9ead75ad8242 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Acquiring lock "cinder-42e5e3e8-3ae6-453c-bd9e-180696537548-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:36:38 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e2a8d4f7-65a7-40c5-bb56-a0db385f5929 tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.626s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:38 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-e2a8d4f7-65a7-40c5-bb56-a0db385f5929 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:36:38 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e7d868c3-1c19-410d-9253-9ead75ad8242 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "cinder-42e5e3e8-3ae6-453c-bd9e-180696537548-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:36:38 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-e2a8d4f7-65a7-40c5-bb56-a0db385f5929 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Deleted volume successfully. Jun 02 03:36:38 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e2a8d4f7-65a7-40c5-bb56-a0db385f5929 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "cinder-ba77cdec-f5ce-4ac4-b31d-7cafc50ce4a6-delete_volume" released by "delete_volume" :: held 2.302s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:36:38 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e7d868c3-1c19-410d-9253-9ead75ad8242 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Acquiring lock "cinder-quobyte-42e5e3e8-3ae6-453c-bd9e-180696537548" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:36:38 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e7d868c3-1c19-410d-9253-9ead75ad8242 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "cinder-quobyte-42e5e3e8-3ae6-453c-bd9e-180696537548" acquired by "delete_volume" :: waited 0.022s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:36:38 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[4953c0d9-da80-4240-92cc-45f6de357497]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:36:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e7d868c3-1c19-410d-9253-9ead75ad8242 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-42e5e3e8-3ae6-453c-bd9e-180696537548 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:38 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-42e5e3e8-3ae6-453c-bd9e-180696537548 Jun 02 03:36:38 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:39 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e7d868c3-1c19-410d-9253-9ead75ad8242 tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-42e5e3e8-3ae6-453c-bd9e-180696537548" returned: 0 in 0.753s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e7d868c3-1c19-410d-9253-9ead75ad8242 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-42e5e3e8-3ae6-453c-bd9e-180696537548 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:39 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-42e5e3e8-3ae6-453c-bd9e-180696537548 Jun 02 03:36:39 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:39 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e7d868c3-1c19-410d-9253-9ead75ad8242 tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-42e5e3e8-3ae6-453c-bd9e-180696537548" returned: 0 in 0.647s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:39 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e7d868c3-1c19-410d-9253-9ead75ad8242 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "cinder-quobyte-42e5e3e8-3ae6-453c-bd9e-180696537548" released by "delete_volume" :: held 1.451s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:36:39 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-e7d868c3-1c19-410d-9253-9ead75ad8242 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Created reservations ['e155603c-9512-491c-843d-61356443f158', '3dd1013d-e4e6-4ed0-80dc-ce22fb1d56ab', '6663542d-a87d-49c6-b01e-1edf695bf2d5', 'a89aa6ae-6324-46bf-8505-bb75409604bc'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:36:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e7d868c3-1c19-410d-9253-9ead75ad8242 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:36:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e7d868c3-1c19-410d-9253-9ead75ad8242 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:36:40 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e7d868c3-1c19-410d-9253-9ead75ad8242 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:36:40 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e7d868c3-1c19-410d-9253-9ead75ad8242 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:36:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e7d868c3-1c19-410d-9253-9ead75ad8242 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:36:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e7d868c3-1c19-410d-9253-9ead75ad8242 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:40 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:36:40 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-bff9605c-5f5f-43b7-8bef-0cb65b0bc190 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Acquiring lock "cinder-a970193e-c316-4397-b1d5-4f2251325ed5-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:36:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-bff9605c-5f5f-43b7-8bef-0cb65b0bc190 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "cinder-a970193e-c316-4397-b1d5-4f2251325ed5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:36:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-bff9605c-5f5f-43b7-8bef-0cb65b0bc190 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Acquiring lock "cinder-quobyte-a970193e-c316-4397-b1d5-4f2251325ed5" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:36:40 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e7d868c3-1c19-410d-9253-9ead75ad8242 tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.643s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:40 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-e7d868c3-1c19-410d-9253-9ead75ad8242 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:36:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-bff9605c-5f5f-43b7-8bef-0cb65b0bc190 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "cinder-quobyte-a970193e-c316-4397-b1d5-4f2251325ed5" acquired by "delete_volume" :: waited 0.016s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:36:40 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-e7d868c3-1c19-410d-9253-9ead75ad8242 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Deleted volume successfully. Jun 02 03:36:40 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d53d7ce-0d72-4ec0-8a54-2e20fc901e55]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:36:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bff9605c-5f5f-43b7-8bef-0cb65b0bc190 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a970193e-c316-4397-b1d5-4f2251325ed5 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e7d868c3-1c19-410d-9253-9ead75ad8242 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "cinder-42e5e3e8-3ae6-453c-bd9e-180696537548-delete_volume" released by "delete_volume" :: held 2.363s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:36:40 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a970193e-c316-4397-b1d5-4f2251325ed5 Jun 02 03:36:40 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:41 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bff9605c-5f5f-43b7-8bef-0cb65b0bc190 tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a970193e-c316-4397-b1d5-4f2251325ed5" returned: 0 in 0.687s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bff9605c-5f5f-43b7-8bef-0cb65b0bc190 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a970193e-c316-4397-b1d5-4f2251325ed5 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:41 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a970193e-c316-4397-b1d5-4f2251325ed5 Jun 02 03:36:41 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:42 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bff9605c-5f5f-43b7-8bef-0cb65b0bc190 tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-a970193e-c316-4397-b1d5-4f2251325ed5" returned: 0 in 0.584s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:42 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-bff9605c-5f5f-43b7-8bef-0cb65b0bc190 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "cinder-quobyte-a970193e-c316-4397-b1d5-4f2251325ed5" released by "delete_volume" :: held 1.317s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:36:42 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-bff9605c-5f5f-43b7-8bef-0cb65b0bc190 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Created reservations ['649c78c1-5cb3-4174-ab1b-cc3b90195b0f', '68631e9b-3cf4-49d3-9c46-6cae09245fd1', '1b1aa6ab-6179-4cc7-b352-8ba1d4f2cda9', 'f946d000-b8b1-4e3e-9bfa-94936231e3db'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:36:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-bff9605c-5f5f-43b7-8bef-0cb65b0bc190 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:36:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-bff9605c-5f5f-43b7-8bef-0cb65b0bc190 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:36:42 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-bff9605c-5f5f-43b7-8bef-0cb65b0bc190 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:36:42 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-bff9605c-5f5f-43b7-8bef-0cb65b0bc190 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:36:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-bff9605c-5f5f-43b7-8bef-0cb65b0bc190 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:36:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bff9605c-5f5f-43b7-8bef-0cb65b0bc190 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:42 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:36:42 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:42 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-bff9605c-5f5f-43b7-8bef-0cb65b0bc190 tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.573s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:42 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-bff9605c-5f5f-43b7-8bef-0cb65b0bc190 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:36:42 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-bff9605c-5f5f-43b7-8bef-0cb65b0bc190 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Deleted volume successfully. Jun 02 03:36:42 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-bff9605c-5f5f-43b7-8bef-0cb65b0bc190 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "cinder-a970193e-c316-4397-b1d5-4f2251325ed5-delete_volume" released by "delete_volume" :: held 2.079s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:36:42 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-63475585-588d-4a25-a943-30e587b7da1d tempest-CreateVolumesFromSnapshotTest-1409429096 None] Acquiring lock "cinder-364ea76c-342f-43d4-a452-b14ed3f99128-delete_snapshot" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:36:42 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-63475585-588d-4a25-a943-30e587b7da1d tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "cinder-364ea76c-342f-43d4-a452-b14ed3f99128-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:36:42 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-63475585-588d-4a25-a943-30e587b7da1d tempest-CreateVolumesFromSnapshotTest-1409429096 None] Acquiring lock "cinder-quobyte-29eb8b2d-ba54-455b-b142-4ff2f575b648" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:36:42 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-63475585-588d-4a25-a943-30e587b7da1d tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "cinder-quobyte-29eb8b2d-ba54-455b-b142-4ff2f575b648" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:36:42 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-63475585-588d-4a25-a943-30e587b7da1d tempest-CreateVolumesFromSnapshotTest-1409429096 None] Acquiring lock "cinder-quobyte-364ea76c-342f-43d4-a452-b14ed3f99128" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:36:42 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-63475585-588d-4a25-a943-30e587b7da1d tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "cinder-quobyte-364ea76c-342f-43d4-a452-b14ed3f99128" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:36:42 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-63475585-588d-4a25-a943-30e587b7da1d tempest-CreateVolumesFromSnapshotTest-1409429096 None] Deleting offline snapshot 364ea76c-342f-43d4-a452-b14ed3f99128 of volume 29eb8b2d-ba54-455b-b142-4ff2f575b648 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:36:42 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-63475585-588d-4a25-a943-30e587b7da1d tempest-CreateVolumesFromSnapshotTest-1409429096 None] snapshot_file for this snap is: volume-29eb8b2d-ba54-455b-b142-4ff2f575b648.364ea76c-342f-43d4-a452-b14ed3f99128 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:36:42 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[46659a17-4bf5-4d12-84ff-b20b9712a3cd]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:36:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63475585-588d-4a25-a943-30e587b7da1d tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648.364ea76c-342f-43d4-a452-b14ed3f99128 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:43 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648.364ea76c-342f-43d4-a452-b14ed3f99128 Jun 02 03:36:43 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:43 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63475585-588d-4a25-a943-30e587b7da1d tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648.364ea76c-342f-43d4-a452-b14ed3f99128" returned: 0 in 0.685s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:43 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-63475585-588d-4a25-a943-30e587b7da1d tempest-CreateVolumesFromSnapshotTest-1409429096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29eb8b2d-ba54-455b-b142-4ff2f575b648(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:36:43 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[340d3585-7962-4cfb-9170-3499aa5b84a6]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:36:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63475585-588d-4a25-a943-30e587b7da1d tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:43 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648 Jun 02 03:36:43 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:44 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63475585-588d-4a25-a943-30e587b7da1d tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648" returned: 0 in 0.683s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63475585-588d-4a25-a943-30e587b7da1d tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648.364ea76c-342f-43d4-a452-b14ed3f99128 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:44 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648.364ea76c-342f-43d4-a452-b14ed3f99128 Jun 02 03:36:44 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:44 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63475585-588d-4a25-a943-30e587b7da1d tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648.364ea76c-342f-43d4-a452-b14ed3f99128" returned: 0 in 0.655s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63475585-588d-4a25-a943-30e587b7da1d tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648.364ea76c-342f-43d4-a452-b14ed3f99128 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:44 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648.364ea76c-342f-43d4-a452-b14ed3f99128 Jun 02 03:36:44 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:45 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63475585-588d-4a25-a943-30e587b7da1d tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648.364ea76c-342f-43d4-a452-b14ed3f99128" returned: 0 in 0.568s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:45 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-63475585-588d-4a25-a943-30e587b7da1d tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "cinder-quobyte-364ea76c-342f-43d4-a452-b14ed3f99128" released by "_delete_snapshot" :: held 2.688s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:36:45 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-63475585-588d-4a25-a943-30e587b7da1d tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "cinder-quobyte-29eb8b2d-ba54-455b-b142-4ff2f575b648" released by "delete_snapshot" :: held 2.711s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:36:45 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-63475585-588d-4a25-a943-30e587b7da1d tempest-CreateVolumesFromSnapshotTest-1409429096 None] Created reservations ['609ed25c-521e-4a7c-815d-1bc86783f380', '0b9ebe3d-0d99-48e0-8612-a6385f37c65c', '497b8efe-de0d-4847-81b7-6d70735a11dd', '08a6cbae-4e2d-4975-b824-7b3ef26b1e07'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:36:45 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-63475585-588d-4a25-a943-30e587b7da1d tempest-CreateVolumesFromSnapshotTest-1409429096 None] Delete snapshot completed successfully. Jun 02 03:36:45 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-63475585-588d-4a25-a943-30e587b7da1d tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "cinder-364ea76c-342f-43d4-a452-b14ed3f99128-delete_snapshot" released by "delete_snapshot" :: held 2.831s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:36:46 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-de73807c-f3f1-41e1-8399-23971d3a91c0 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Acquiring lock "cinder-29eb8b2d-ba54-455b-b142-4ff2f575b648-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:36:46 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-de73807c-f3f1-41e1-8399-23971d3a91c0 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "cinder-29eb8b2d-ba54-455b-b142-4ff2f575b648-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:36:46 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-de73807c-f3f1-41e1-8399-23971d3a91c0 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Acquiring lock "cinder-quobyte-29eb8b2d-ba54-455b-b142-4ff2f575b648" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:36:46 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-de73807c-f3f1-41e1-8399-23971d3a91c0 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "cinder-quobyte-29eb8b2d-ba54-455b-b142-4ff2f575b648" acquired by "delete_volume" :: waited 0.015s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:36:46 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ce9077-077d-42ac-8bf0-56dca8e66a9b]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:36:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-de73807c-f3f1-41e1-8399-23971d3a91c0 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:46 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648 Jun 02 03:36:46 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:46 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-de73807c-f3f1-41e1-8399-23971d3a91c0 tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648" returned: 0 in 0.679s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-de73807c-f3f1-41e1-8399-23971d3a91c0 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:46 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648 Jun 02 03:36:46 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:47 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-de73807c-f3f1-41e1-8399-23971d3a91c0 tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-29eb8b2d-ba54-455b-b142-4ff2f575b648" returned: 0 in 0.600s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:47 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-de73807c-f3f1-41e1-8399-23971d3a91c0 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "cinder-quobyte-29eb8b2d-ba54-455b-b142-4ff2f575b648" released by "delete_volume" :: held 1.334s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:36:47 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-de73807c-f3f1-41e1-8399-23971d3a91c0 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Created reservations ['a72c0abb-6519-4b93-a11d-4164c986ec5d', 'b1f0c17c-8f2f-4c4f-8739-a696b1b0933a', '179efc72-a2d3-46b8-b614-cd6e778d4cab', '5b48d767-0e39-4b17-9f32-3ad50337c9aa'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:36:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-de73807c-f3f1-41e1-8399-23971d3a91c0 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:36:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-de73807c-f3f1-41e1-8399-23971d3a91c0 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:36:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-de73807c-f3f1-41e1-8399-23971d3a91c0 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:36:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-de73807c-f3f1-41e1-8399-23971d3a91c0 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:36:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-de73807c-f3f1-41e1-8399-23971d3a91c0 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:36:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-de73807c-f3f1-41e1-8399-23971d3a91c0 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:36:47 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:36:47 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:36:48 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Jun 02 03:36:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-de73807c-f3f1-41e1-8399-23971d3a91c0 tempest-CreateVolumesFromSnapshotTest-1409429096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.579s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:36:48 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-de73807c-f3f1-41e1-8399-23971d3a91c0 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:36:48 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-de73807c-f3f1-41e1-8399-23971d3a91c0 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Deleted volume successfully. Jun 02 03:36:48 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-de73807c-f3f1-41e1-8399-23971d3a91c0 tempest-CreateVolumesFromSnapshotTest-1409429096 None] Lock "cinder-29eb8b2d-ba54-455b-b142-4ff2f575b648-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:36:59 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c3d7805-a850-47ed-8234-0527e3d04731 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:36:59 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6c3d7805-a850-47ed-8234-0527e3d04731 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Flow 'volume_create_manager' (452e952c-8c23-41ea-aa0a-2e7c02f8ef29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:36:59 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6c3d7805-a850-47ed-8234-0527e3d04731 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dbbe82f-865d-4d36-82e6-13d8b15b9d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:59 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=92,cinder:INSERT=29,cinder:UPDATE=122,cinder:DELETE=14 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:36:59 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6c3d7805-a850-47ed-8234-0527e3d04731 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dbbe82f-865d-4d36-82e6-13d8b15b9d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1530211143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3faca16b-db61-4915-a402-ab276a65cce9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63842c8ed9b408c9c48bf62e0375ef8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:00Z,use_quota=True,user_id='3f2b020b7ac941378aceba2ed95966b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:59 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6c3d7805-a850-47ed-8234-0527e3d04731 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c80739d-02d7-43d7-ac82-96ef66c77efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:59 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6c3d7805-a850-47ed-8234-0527e3d04731 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c80739d-02d7-43d7-ac82-96ef66c77efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:59 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6c3d7805-a850-47ed-8234-0527e3d04731 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (007c8252-935f-4690-88c4-8b5110350831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:59 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6c3d7805-a850-47ed-8234-0527e3d04731 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (007c8252-935f-4690-88c4-8b5110350831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3faca16b-db61-4915-a402-ab276a65cce9', 'volume_name': 'volume-3faca16b-db61-4915-a402-ab276a65cce9', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:59 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6c3d7805-a850-47ed-8234-0527e3d04731 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f126c014-a5a5-4c37-b0e5-fa550f4a0c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:59 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6c3d7805-a850-47ed-8234-0527e3d04731 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f126c014-a5a5-4c37-b0e5-fa550f4a0c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:36:59 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6c3d7805-a850-47ed-8234-0527e3d04731 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde14183-d3e9-4c4e-ba5a-91ca81549b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:36:59 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-6c3d7805-a850-47ed-8234-0527e3d04731 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Volume 3faca16b-db61-4915-a402-ab276a65cce9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3faca16b-db61-4915-a402-ab276a65cce9', 'volume_size': 1} Jun 02 03:36:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6c3d7805-a850-47ed-8234-0527e3d04731 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:36:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6c3d7805-a850-47ed-8234-0527e3d04731 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:36:59 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6c3d7805-a850-47ed-8234-0527e3d04731 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1530211143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3faca16b-db61-4915-a402-ab276a65cce9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63842c8ed9b408c9c48bf62e0375ef8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:00Z,use_quota=True,user_id='3f2b020b7ac941378aceba2ed95966b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:36:59 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-6c3d7805-a850-47ed-8234-0527e3d04731 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Creating volume 3faca16b-db61-4915-a402-ab276a65cce9 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:36:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6c3d7805-a850-47ed-8234-0527e3d04731 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:36:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6c3d7805-a850-47ed-8234-0527e3d04731 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:36:59 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6c3d7805-a850-47ed-8234-0527e3d04731 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:36:59 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6c3d7805-a850-47ed-8234-0527e3d04731 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:36:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6c3d7805-a850-47ed-8234-0527e3d04731 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:36:59 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6c3d7805-a850-47ed-8234-0527e3d04731 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:36:59 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-6c3d7805-a850-47ed-8234-0527e3d04731 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:36:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6c3d7805-a850-47ed-8234-0527e3d04731 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3faca16b-db61-4915-a402-ab276a65cce9 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:00 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3faca16b-db61-4915-a402-ab276a65cce9 1073741824 Jun 02 03:37:00 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:00 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ad6a5f4-9a13-417b-9855-635aa9234d6c tempest-CreateVolumesFromImageTest-999091618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:37:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6ad6a5f4-9a13-417b-9855-635aa9234d6c tempest-CreateVolumesFromImageTest-999091618 None] Flow 'volume_create_manager' (c5b28886-aee1-402d-8ec6-9bc23ab2c03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6ad6a5f4-9a13-417b-9855-635aa9234d6c tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d439096c-51d9-45bc-b25e-2abde97a391e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6ad6a5f4-9a13-417b-9855-635aa9234d6c tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d439096c-51d9-45bc-b25e-2abde97a391e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1546575213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37634a57-bb0f-4cf4-9329-1dae5fbfb7a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='904170f3217846ccab75a11aeced4c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:00Z,use_quota=True,user_id='da89ef954ba548f3bdce2ca4cb8f0410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6ad6a5f4-9a13-417b-9855-635aa9234d6c tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a433e223-2e29-4da2-b306-2248f20bd253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6ad6a5f4-9a13-417b-9855-635aa9234d6c tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a433e223-2e29-4da2-b306-2248f20bd253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6ad6a5f4-9a13-417b-9855-635aa9234d6c tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b88f2a60-faa5-4460-8b11-4e23e4a6d722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6ad6a5f4-9a13-417b-9855-635aa9234d6c tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b88f2a60-faa5-4460-8b11-4e23e4a6d722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37634a57-bb0f-4cf4-9329-1dae5fbfb7a6', 'volume_name': 'volume-37634a57-bb0f-4cf4-9329-1dae5fbfb7a6', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6ad6a5f4-9a13-417b-9855-635aa9234d6c tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9078b987-fe9b-4e72-a0d7-2a42d77ce089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6ad6a5f4-9a13-417b-9855-635aa9234d6c tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9078b987-fe9b-4e72-a0d7-2a42d77ce089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6ad6a5f4-9a13-417b-9855-635aa9234d6c tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b657dd2-d8ff-43dc-ac42-22887d4b0cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:00 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-6ad6a5f4-9a13-417b-9855-635aa9234d6c tempest-CreateVolumesFromImageTest-999091618 None] Volume 37634a57-bb0f-4cf4-9329-1dae5fbfb7a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37634a57-bb0f-4cf4-9329-1dae5fbfb7a6', 'volume_size': 1} Jun 02 03:37:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6ad6a5f4-9a13-417b-9855-635aa9234d6c tempest-CreateVolumesFromImageTest-999091618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:00 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-be171c7e-fb3b-4a02-9342-6dfb2de72565 tempest-CreateVolumesFromImageTest-999091618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:37:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-be171c7e-fb3b-4a02-9342-6dfb2de72565 tempest-CreateVolumesFromImageTest-999091618 None] Flow 'volume_create_manager' (5fa6f267-4588-4ea5-88a9-fa6747b6ece5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-be171c7e-fb3b-4a02-9342-6dfb2de72565 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (803c53ea-5303-4154-b5db-ce2d5078adfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-be171c7e-fb3b-4a02-9342-6dfb2de72565 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (803c53ea-5303-4154-b5db-ce2d5078adfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-481038094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e50f1520-d636-472d-ac7c-0d99fdfb15b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='904170f3217846ccab75a11aeced4c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:00Z,use_quota=True,user_id='da89ef954ba548f3bdce2ca4cb8f0410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-be171c7e-fb3b-4a02-9342-6dfb2de72565 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d34e432-4d88-4e6a-b363-20ac45cccafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-be171c7e-fb3b-4a02-9342-6dfb2de72565 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d34e432-4d88-4e6a-b363-20ac45cccafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-be171c7e-fb3b-4a02-9342-6dfb2de72565 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fddca87-0821-4272-8079-4b62b0dc786f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-be171c7e-fb3b-4a02-9342-6dfb2de72565 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fddca87-0821-4272-8079-4b62b0dc786f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e50f1520-d636-472d-ac7c-0d99fdfb15b0', 'volume_name': 'volume-e50f1520-d636-472d-ac7c-0d99fdfb15b0', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-be171c7e-fb3b-4a02-9342-6dfb2de72565 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61465da6-2f79-4e96-a393-e864951ce99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-be171c7e-fb3b-4a02-9342-6dfb2de72565 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61465da6-2f79-4e96-a393-e864951ce99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-be171c7e-fb3b-4a02-9342-6dfb2de72565 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51b6cc89-4f53-47c2-9191-90c58442d4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:00 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-be171c7e-fb3b-4a02-9342-6dfb2de72565 tempest-CreateVolumesFromImageTest-999091618 None] Volume e50f1520-d636-472d-ac7c-0d99fdfb15b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e50f1520-d636-472d-ac7c-0d99fdfb15b0', 'volume_size': 1} Jun 02 03:37:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-be171c7e-fb3b-4a02-9342-6dfb2de72565 tempest-CreateVolumesFromImageTest-999091618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:00 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-f378af77-10c2-4f36-b96c-fb10a8166a33 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:37:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-f378af77-10c2-4f36-b96c-fb10a8166a33 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Flow 'volume_create_manager' (100d5a6e-309e-4860-86f0-88859b304bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:00 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-f378af77-10c2-4f36-b96c-fb10a8166a33 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b08039-b234-48ba-b10e-f0fa931162ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-f378af77-10c2-4f36-b96c-fb10a8166a33 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b08039-b234-48ba-b10e-f0fa931162ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1392777352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59701368-9b63-4bf7-9773-da738bfe2c99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43e3700b8ce94de2bdf9794af8e25e16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:01Z,use_quota=True,user_id='d58b0898f78c4e8ebefbfa32260e6f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-f378af77-10c2-4f36-b96c-fb10a8166a33 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddc22a21-88c3-4ac4-9ad5-c820bc22aca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-f378af77-10c2-4f36-b96c-fb10a8166a33 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddc22a21-88c3-4ac4-9ad5-c820bc22aca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-f378af77-10c2-4f36-b96c-fb10a8166a33 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1c1540-bbb3-4510-b07a-49a164565995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-f378af77-10c2-4f36-b96c-fb10a8166a33 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1c1540-bbb3-4510-b07a-49a164565995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59701368-9b63-4bf7-9773-da738bfe2c99', 'volume_name': 'volume-59701368-9b63-4bf7-9773-da738bfe2c99', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-f378af77-10c2-4f36-b96c-fb10a8166a33 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64fe368a-b88d-4bd9-9bed-09ec3dde789f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-f378af77-10c2-4f36-b96c-fb10a8166a33 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64fe368a-b88d-4bd9-9bed-09ec3dde789f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-f378af77-10c2-4f36-b96c-fb10a8166a33 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (384fe1ba-9eda-43a8-8d02-474b8afc7779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:01 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-f378af77-10c2-4f36-b96c-fb10a8166a33 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Volume 59701368-9b63-4bf7-9773-da738bfe2c99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59701368-9b63-4bf7-9773-da738bfe2c99', 'volume_size': 1} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-f378af77-10c2-4f36-b96c-fb10a8166a33 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:01 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6c3d7805-a850-47ed-8234-0527e3d04731 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3faca16b-db61-4915-a402-ab276a65cce9 1073741824" returned: 0 in 1.159s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6c3d7805-a850-47ed-8234-0527e3d04731 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3faca16b-db61-4915-a402-ab276a65cce9 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-322bf5cd-c472-455d-a84f-4c02a16c6946 tempest-CreateVolumesFromImageTest-999091618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:37:01 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3faca16b-db61-4915-a402-ab276a65cce9 Jun 02 03:37:01 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-322bf5cd-c472-455d-a84f-4c02a16c6946 tempest-CreateVolumesFromImageTest-999091618 None] Flow 'volume_create_manager' (cb22108b-bcd7-4916-9822-edc887c1593a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-322bf5cd-c472-455d-a84f-4c02a16c6946 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c085cd4d-c258-437c-af88-59d517603b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-322bf5cd-c472-455d-a84f-4c02a16c6946 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c085cd4d-c258-437c-af88-59d517603b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-176797573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1123f6bb-ce70-4683-9c1b-3330a32977ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='904170f3217846ccab75a11aeced4c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:01Z,use_quota=True,user_id='da89ef954ba548f3bdce2ca4cb8f0410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-322bf5cd-c472-455d-a84f-4c02a16c6946 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (943ef08f-6c75-4606-9c17-a00d5b4427d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-322bf5cd-c472-455d-a84f-4c02a16c6946 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (943ef08f-6c75-4606-9c17-a00d5b4427d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-322bf5cd-c472-455d-a84f-4c02a16c6946 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c017a7-b7f0-43fd-accb-857cdafac8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-322bf5cd-c472-455d-a84f-4c02a16c6946 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c017a7-b7f0-43fd-accb-857cdafac8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1123f6bb-ce70-4683-9c1b-3330a32977ff', 'volume_name': 'volume-1123f6bb-ce70-4683-9c1b-3330a32977ff', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-322bf5cd-c472-455d-a84f-4c02a16c6946 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b84b58bb-3000-4247-8a52-85199f246ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-322bf5cd-c472-455d-a84f-4c02a16c6946 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b84b58bb-3000-4247-8a52-85199f246ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-322bf5cd-c472-455d-a84f-4c02a16c6946 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a6fd48-00b3-457c-ab0a-bec441ba221f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:01 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-322bf5cd-c472-455d-a84f-4c02a16c6946 tempest-CreateVolumesFromImageTest-999091618 None] Volume 1123f6bb-ce70-4683-9c1b-3330a32977ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1123f6bb-ce70-4683-9c1b-3330a32977ff', 'volume_size': 1} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-322bf5cd-c472-455d-a84f-4c02a16c6946 tempest-CreateVolumesFromImageTest-999091618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bc0f2aa-9ac7-4c6e-9fcb-6f190a11456a tempest-CreateVolumesFromImageTest-999091618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6bc0f2aa-9ac7-4c6e-9fcb-6f190a11456a tempest-CreateVolumesFromImageTest-999091618 None] Flow 'volume_create_manager' (a082ccfe-31e9-4376-980f-62b08fa778bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6bc0f2aa-9ac7-4c6e-9fcb-6f190a11456a tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19838a0e-f9b5-4470-aa2b-665d1df60b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6bc0f2aa-9ac7-4c6e-9fcb-6f190a11456a tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19838a0e-f9b5-4470-aa2b-665d1df60b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1448478360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=203ec046-7cfe-4fea-8bd3-c4948e0f4c64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='904170f3217846ccab75a11aeced4c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:02Z,use_quota=True,user_id='da89ef954ba548f3bdce2ca4cb8f0410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6bc0f2aa-9ac7-4c6e-9fcb-6f190a11456a tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5097c6ae-c754-4dee-a556-92601f309eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6bc0f2aa-9ac7-4c6e-9fcb-6f190a11456a tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5097c6ae-c754-4dee-a556-92601f309eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6bc0f2aa-9ac7-4c6e-9fcb-6f190a11456a tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (305d1fc8-a2f5-4092-9952-f80d457ca505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6bc0f2aa-9ac7-4c6e-9fcb-6f190a11456a tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (305d1fc8-a2f5-4092-9952-f80d457ca505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '203ec046-7cfe-4fea-8bd3-c4948e0f4c64', 'volume_name': 'volume-203ec046-7cfe-4fea-8bd3-c4948e0f4c64', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6bc0f2aa-9ac7-4c6e-9fcb-6f190a11456a tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef2444c0-51eb-4cb2-af87-c1c976942836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6bc0f2aa-9ac7-4c6e-9fcb-6f190a11456a tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef2444c0-51eb-4cb2-af87-c1c976942836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6bc0f2aa-9ac7-4c6e-9fcb-6f190a11456a tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c771c593-fe18-45b4-915d-47f93288c381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:01 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-6bc0f2aa-9ac7-4c6e-9fcb-6f190a11456a tempest-CreateVolumesFromImageTest-999091618 None] Volume 203ec046-7cfe-4fea-8bd3-c4948e0f4c64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-203ec046-7cfe-4fea-8bd3-c4948e0f4c64', 'volume_size': 1} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6bc0f2aa-9ac7-4c6e-9fcb-6f190a11456a tempest-CreateVolumesFromImageTest-999091618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:01 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6c3d7805-a850-47ed-8234-0527e3d04731 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3faca16b-db61-4915-a402-ab276a65cce9" returned: 0 in 0.724s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6c3d7805-a850-47ed-8234-0527e3d04731 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] <== create_volume: return (1960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6c3d7805-a850-47ed-8234-0527e3d04731 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.965s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6ad6a5f4-9a13-417b-9855-635aa9234d6c tempest-CreateVolumesFromImageTest-999091618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.800s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6ad6a5f4-9a13-417b-9855-635aa9234d6c tempest-CreateVolumesFromImageTest-999091618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1546575213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37634a57-bb0f-4cf4-9329-1dae5fbfb7a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='904170f3217846ccab75a11aeced4c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:00Z,use_quota=True,user_id='da89ef954ba548f3bdce2ca4cb8f0410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-6ad6a5f4-9a13-417b-9855-635aa9234d6c tempest-CreateVolumesFromImageTest-999091618 None] Creating volume 37634a57-bb0f-4cf4-9329-1dae5fbfb7a6 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6ad6a5f4-9a13-417b-9855-635aa9234d6c tempest-CreateVolumesFromImageTest-999091618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6ad6a5f4-9a13-417b-9855-635aa9234d6c tempest-CreateVolumesFromImageTest-999091618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6ad6a5f4-9a13-417b-9855-635aa9234d6c tempest-CreateVolumesFromImageTest-999091618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6ad6a5f4-9a13-417b-9855-635aa9234d6c tempest-CreateVolumesFromImageTest-999091618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6ad6a5f4-9a13-417b-9855-635aa9234d6c tempest-CreateVolumesFromImageTest-999091618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6ad6a5f4-9a13-417b-9855-635aa9234d6c tempest-CreateVolumesFromImageTest-999091618 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:37:01 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-6ad6a5f4-9a13-417b-9855-635aa9234d6c tempest-CreateVolumesFromImageTest-999091618 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6ad6a5f4-9a13-417b-9855-635aa9234d6c tempest-CreateVolumesFromImageTest-999091618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-37634a57-bb0f-4cf4-9329-1dae5fbfb7a6 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:01 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-37634a57-bb0f-4cf4-9329-1dae5fbfb7a6 1073741824 Jun 02 03:37:01 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6c3d7805-a850-47ed-8234-0527e3d04731 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde14183-d3e9-4c4e-ba5a-91ca81549b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3faca16b-db61-4915-a402-ab276a65cce9', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6c3d7805-a850-47ed-8234-0527e3d04731 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f962881-6073-4fc2-839f-6ebd092187dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:02 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c9c7170-173d-4cad-b85f-67306cebfff5 tempest-CreateVolumesFromImageTest-999091618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:37:02 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c9c7170-173d-4cad-b85f-67306cebfff5 tempest-CreateVolumesFromImageTest-999091618 None] Flow 'volume_create_manager' (f82d7d7c-95c0-4bc5-bb87-7175190dff95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:02 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c9c7170-173d-4cad-b85f-67306cebfff5 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55230f06-b112-4c0e-a7d1-bacb66e25867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:02 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-6c3d7805-a850-47ed-8234-0527e3d04731 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Volume volume-3faca16b-db61-4915-a402-ab276a65cce9 (3faca16b-db61-4915-a402-ab276a65cce9): created successfully Jun 02 03:37:02 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6c3d7805-a850-47ed-8234-0527e3d04731 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f962881-6073-4fc2-839f-6ebd092187dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:02 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6c3d7805-a850-47ed-8234-0527e3d04731 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Flow 'volume_create_manager' (452e952c-8c23-41ea-aa0a-2e7c02f8ef29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:02 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c9c7170-173d-4cad-b85f-67306cebfff5 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55230f06-b112-4c0e-a7d1-bacb66e25867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-418548164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3b484c5-0e6c-4e9e-8318-e930b2657962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='904170f3217846ccab75a11aeced4c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:02Z,use_quota=True,user_id='da89ef954ba548f3bdce2ca4cb8f0410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:02 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c9c7170-173d-4cad-b85f-67306cebfff5 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (704818d2-4db3-436f-af2e-9cf9a834e082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:02 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c9c7170-173d-4cad-b85f-67306cebfff5 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (704818d2-4db3-436f-af2e-9cf9a834e082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:02 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c9c7170-173d-4cad-b85f-67306cebfff5 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acf1c94e-df3d-4760-8c9e-785fa2058059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:02 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c9c7170-173d-4cad-b85f-67306cebfff5 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acf1c94e-df3d-4760-8c9e-785fa2058059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3b484c5-0e6c-4e9e-8318-e930b2657962', 'volume_name': 'volume-e3b484c5-0e6c-4e9e-8318-e930b2657962', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:02 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c9c7170-173d-4cad-b85f-67306cebfff5 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5caf265-e6be-496f-9d9c-78c93ed6cd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:02 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c9c7170-173d-4cad-b85f-67306cebfff5 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5caf265-e6be-496f-9d9c-78c93ed6cd3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:02 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c9c7170-173d-4cad-b85f-67306cebfff5 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2346a9c9-25a0-4884-9dff-87837e3edbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:02 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-0c9c7170-173d-4cad-b85f-67306cebfff5 tempest-CreateVolumesFromImageTest-999091618 None] Volume e3b484c5-0e6c-4e9e-8318-e930b2657962: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3b484c5-0e6c-4e9e-8318-e930b2657962', 'volume_size': 1} Jun 02 03:37:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0c9c7170-173d-4cad-b85f-67306cebfff5 tempest-CreateVolumesFromImageTest-999091618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:02 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-6c3d7805-a850-47ed-8234-0527e3d04731 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Created volume successfully. Jun 02 03:37:02 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6ad6a5f4-9a13-417b-9855-635aa9234d6c tempest-CreateVolumesFromImageTest-999091618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-37634a57-bb0f-4cf4-9329-1dae5fbfb7a6 1073741824" returned: 0 in 0.808s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6ad6a5f4-9a13-417b-9855-635aa9234d6c tempest-CreateVolumesFromImageTest-999091618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-37634a57-bb0f-4cf4-9329-1dae5fbfb7a6 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:02 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-37634a57-bb0f-4cf4-9329-1dae5fbfb7a6 Jun 02 03:37:02 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:03 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6ad6a5f4-9a13-417b-9855-635aa9234d6c tempest-CreateVolumesFromImageTest-999091618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-37634a57-bb0f-4cf4-9329-1dae5fbfb7a6" returned: 0 in 0.655s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:03 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6ad6a5f4-9a13-417b-9855-635aa9234d6c tempest-CreateVolumesFromImageTest-999091618 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:37:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6ad6a5f4-9a13-417b-9855-635aa9234d6c tempest-CreateVolumesFromImageTest-999091618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-be171c7e-fb3b-4a02-9342-6dfb2de72565 tempest-CreateVolumesFromImageTest-999091618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.869s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:03 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-be171c7e-fb3b-4a02-9342-6dfb2de72565 tempest-CreateVolumesFromImageTest-999091618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-481038094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e50f1520-d636-472d-ac7c-0d99fdfb15b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='904170f3217846ccab75a11aeced4c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:00Z,use_quota=True,user_id='da89ef954ba548f3bdce2ca4cb8f0410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:37:03 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-be171c7e-fb3b-4a02-9342-6dfb2de72565 tempest-CreateVolumesFromImageTest-999091618 None] Creating volume e50f1520-d636-472d-ac7c-0d99fdfb15b0 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:37:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-be171c7e-fb3b-4a02-9342-6dfb2de72565 tempest-CreateVolumesFromImageTest-999091618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-be171c7e-fb3b-4a02-9342-6dfb2de72565 tempest-CreateVolumesFromImageTest-999091618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:03 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-be171c7e-fb3b-4a02-9342-6dfb2de72565 tempest-CreateVolumesFromImageTest-999091618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:03 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-be171c7e-fb3b-4a02-9342-6dfb2de72565 tempest-CreateVolumesFromImageTest-999091618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-be171c7e-fb3b-4a02-9342-6dfb2de72565 tempest-CreateVolumesFromImageTest-999091618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:03 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-be171c7e-fb3b-4a02-9342-6dfb2de72565 tempest-CreateVolumesFromImageTest-999091618 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:37:03 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-be171c7e-fb3b-4a02-9342-6dfb2de72565 tempest-CreateVolumesFromImageTest-999091618 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:37:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-be171c7e-fb3b-4a02-9342-6dfb2de72565 tempest-CreateVolumesFromImageTest-999091618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e50f1520-d636-472d-ac7c-0d99fdfb15b0 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:03 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6ad6a5f4-9a13-417b-9855-635aa9234d6c tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b657dd2-d8ff-43dc-ac42-22887d4b0cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37634a57-bb0f-4cf4-9329-1dae5fbfb7a6', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:03 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e50f1520-d636-472d-ac7c-0d99fdfb15b0 1073741824 Jun 02 03:37:03 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:03 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6ad6a5f4-9a13-417b-9855-635aa9234d6c tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a56810-af89-4291-8f39-88b6f05a9db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:03 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-6ad6a5f4-9a13-417b-9855-635aa9234d6c tempest-CreateVolumesFromImageTest-999091618 None] Volume volume-37634a57-bb0f-4cf4-9329-1dae5fbfb7a6 (37634a57-bb0f-4cf4-9329-1dae5fbfb7a6): created successfully Jun 02 03:37:03 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6ad6a5f4-9a13-417b-9855-635aa9234d6c tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a56810-af89-4291-8f39-88b6f05a9db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:03 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6ad6a5f4-9a13-417b-9855-635aa9234d6c tempest-CreateVolumesFromImageTest-999091618 None] Flow 'volume_create_manager' (c5b28886-aee1-402d-8ec6-9bc23ab2c03b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:03 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-6ad6a5f4-9a13-417b-9855-635aa9234d6c tempest-CreateVolumesFromImageTest-999091618 None] Created volume successfully. Jun 02 03:37:03 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-63ff4e6b-3d2e-4a6e-961f-d44b1f1b8279 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:37:03 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63ff4e6b-3d2e-4a6e-961f-d44b1f1b8279 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Flow 'volume_create_manager' (666319f9-c2c5-4015-af5a-bdbab362dacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:03 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63ff4e6b-3d2e-4a6e-961f-d44b1f1b8279 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1afee6a4-617e-4105-b054-1b47f4b3ab2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:03 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63ff4e6b-3d2e-4a6e-961f-d44b1f1b8279 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1afee6a4-617e-4105-b054-1b47f4b3ab2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1123552900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f457731a-a659-44b3-9771-a8a4ec8fc437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63842c8ed9b408c9c48bf62e0375ef8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:04Z,use_quota=True,user_id='3f2b020b7ac941378aceba2ed95966b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:03 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63ff4e6b-3d2e-4a6e-961f-d44b1f1b8279 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d65ed2c-d3f4-4d46-bde5-bac1afe4207f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:03 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63ff4e6b-3d2e-4a6e-961f-d44b1f1b8279 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d65ed2c-d3f4-4d46-bde5-bac1afe4207f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:03 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63ff4e6b-3d2e-4a6e-961f-d44b1f1b8279 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a75860d-e327-478f-875d-c384fbf65309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:03 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63ff4e6b-3d2e-4a6e-961f-d44b1f1b8279 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a75860d-e327-478f-875d-c384fbf65309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f457731a-a659-44b3-9771-a8a4ec8fc437', 'volume_name': 'volume-f457731a-a659-44b3-9771-a8a4ec8fc437', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:03 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63ff4e6b-3d2e-4a6e-961f-d44b1f1b8279 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (537b0e8f-1e74-4879-bebd-341d2e175615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:03 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63ff4e6b-3d2e-4a6e-961f-d44b1f1b8279 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (537b0e8f-1e74-4879-bebd-341d2e175615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:03 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63ff4e6b-3d2e-4a6e-961f-d44b1f1b8279 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4250c3e5-a40a-4e29-9170-51afa9f1f321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:03 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-63ff4e6b-3d2e-4a6e-961f-d44b1f1b8279 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Volume f457731a-a659-44b3-9771-a8a4ec8fc437: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f457731a-a659-44b3-9771-a8a4ec8fc437', 'volume_size': 1} Jun 02 03:37:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-63ff4e6b-3d2e-4a6e-961f-d44b1f1b8279 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-db7943ad-c076-4404-90be-bc585ee4eec1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-db7943ad-c076-4404-90be-bc585ee4eec1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Flow 'volume_create_manager' (1ad57ccd-8d44-4b57-8768-4868ab5cd337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-db7943ad-c076-4404-90be-bc585ee4eec1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d743ddc-98df-47b2-9cba-ee336d6b6429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-db7943ad-c076-4404-90be-bc585ee4eec1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d743ddc-98df-47b2-9cba-ee336d6b6429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2115482452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f618ba80-dd09-44f4-bb78-9a6ee6712933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63842c8ed9b408c9c48bf62e0375ef8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:04Z,use_quota=True,user_id='3f2b020b7ac941378aceba2ed95966b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-db7943ad-c076-4404-90be-bc585ee4eec1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24771d6c-306c-42f8-aace-24914e2416a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-db7943ad-c076-4404-90be-bc585ee4eec1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24771d6c-306c-42f8-aace-24914e2416a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-db7943ad-c076-4404-90be-bc585ee4eec1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (190bd6c5-c260-4392-8523-75b69460c9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-db7943ad-c076-4404-90be-bc585ee4eec1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (190bd6c5-c260-4392-8523-75b69460c9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f618ba80-dd09-44f4-bb78-9a6ee6712933', 'volume_name': 'volume-f618ba80-dd09-44f4-bb78-9a6ee6712933', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-db7943ad-c076-4404-90be-bc585ee4eec1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef342e4e-76c2-456e-a9f3-f2c97f6d18de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-db7943ad-c076-4404-90be-bc585ee4eec1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef342e4e-76c2-456e-a9f3-f2c97f6d18de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-db7943ad-c076-4404-90be-bc585ee4eec1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8024b3ee-cac9-4ff8-b6b5-a1da7bbc0214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:04 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-db7943ad-c076-4404-90be-bc585ee4eec1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Volume f618ba80-dd09-44f4-bb78-9a6ee6712933: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f618ba80-dd09-44f4-bb78-9a6ee6712933', 'volume_size': 1} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-db7943ad-c076-4404-90be-bc585ee4eec1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Flow 'volume_create_manager' (c5257e24-4d9b-40a3-ae8b-e0f2136c5697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3cea38a-3827-40f6-80a8-2d25afa88b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3cea38a-3827-40f6-80a8-2d25afa88b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=961c3a51-e205-4b33-919e-69ca661bb445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bc04170f6f64b72ab18bc11c9d98cfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:04Z,use_quota=True,user_id='4e03ea16cce04a47b034213af6d628bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f18b06c-b6ec-43ad-9c98-8cba78ee029b),volume_type_id=8f18b06c-b6ec-43ad-9c98-8cba78ee029b)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b6cd5ee-0428-42ac-820d-48ee8abe9d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b6cd5ee-0428-42ac-820d-48ee8abe9d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07b03fbe-ac04-418e-a479-1bf1dea674ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.image.glance [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Creating Keystone auth plugin from conf {{(pid=86431) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f5c4762-0627-4c91-a2de-974dc6ab4b76 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6f5c4762-0627-4c91-a2de-974dc6ab4b76 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Flow 'volume_create_manager' (4b536a93-4060-434b-8de6-99d602833d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6f5c4762-0627-4c91-a2de-974dc6ab4b76 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01477e58-731f-4beb-8fcd-b7d1f16aa5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6f5c4762-0627-4c91-a2de-974dc6ab4b76 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01477e58-731f-4beb-8fcd-b7d1f16aa5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2013510401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d0670d5-3922-4479-b27a-ff452673bb91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63842c8ed9b408c9c48bf62e0375ef8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:04Z,use_quota=True,user_id='3f2b020b7ac941378aceba2ed95966b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6f5c4762-0627-4c91-a2de-974dc6ab4b76 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (942206ed-3a08-4091-9b51-5ee28b6f03ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6f5c4762-0627-4c91-a2de-974dc6ab4b76 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (942206ed-3a08-4091-9b51-5ee28b6f03ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6f5c4762-0627-4c91-a2de-974dc6ab4b76 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb3a1298-2c35-4488-bbf3-ca6f15e8dda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6f5c4762-0627-4c91-a2de-974dc6ab4b76 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb3a1298-2c35-4488-bbf3-ca6f15e8dda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d0670d5-3922-4479-b27a-ff452673bb91', 'volume_name': 'volume-2d0670d5-3922-4479-b27a-ff452673bb91', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6f5c4762-0627-4c91-a2de-974dc6ab4b76 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ce29c01-1a21-48b1-b2db-8923f84503c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6f5c4762-0627-4c91-a2de-974dc6ab4b76 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ce29c01-1a21-48b1-b2db-8923f84503c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6f5c4762-0627-4c91-a2de-974dc6ab4b76 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b360cd0-d7fd-433e-8c5e-9439e5b44b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:04 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-6f5c4762-0627-4c91-a2de-974dc6ab4b76 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Volume 2d0670d5-3922-4479-b27a-ff452673bb91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d0670d5-3922-4479-b27a-ff452673bb91', 'volume_size': 1} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6f5c4762-0627-4c91-a2de-974dc6ab4b76 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:04 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-be171c7e-fb3b-4a02-9342-6dfb2de72565 tempest-CreateVolumesFromImageTest-999091618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e50f1520-d636-472d-ac7c-0d99fdfb15b0 1073741824" returned: 0 in 1.142s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-be171c7e-fb3b-4a02-9342-6dfb2de72565 tempest-CreateVolumesFromImageTest-999091618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e50f1520-d636-472d-ac7c-0d99fdfb15b0 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:04 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e50f1520-d636-472d-ac7c-0d99fdfb15b0 Jun 02 03:37:04 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07b03fbe-ac04-418e-a479-1bf1dea674ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '961c3a51-e205-4b33-919e-69ca661bb445', 'volume_name': 'volume-961c3a51-e205-4b33-919e-69ca661bb445', 'volume_size': 1, 'image_id': '5afb6044-0bab-4144-a061-659cb6d60cc9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5afb6044-0bab-4144-a061-659cb6d60cc9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6a648ecd9a8993eb9b8dd21254e25174', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0bc04170f6f64b72ab18bc11c9d98cfc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a9f5cc40732a6cb2bed09a492ee51ab9030fa654e8fa6163a6142dcc122ee03ec5aee48086b29f1d99c70a3cf16e633c515fc8ba811f5899d6bd7546e1b2f2ff', 'id': '5afb6044-0bab-4144-a061-659cb6d60cc9', 'created_at': datetime.datetime(2026, 6, 2, 1, 37, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 1, 37, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5afb6044-0bab-4144-a061-659cb6d60cc9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8623542-3c47-4d94-adf5-dc587c9f66b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8623542-3c47-4d94-adf5-dc587c9f66b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d10c1ec-42be-4d6c-a0ac-0069b034a0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:04 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Volume 961c3a51-e205-4b33-919e-69ca661bb445: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-961c3a51-e205-4b33-919e-69ca661bb445', 'volume_size': 1, 'image_id': '5afb6044-0bab-4144-a061-659cb6d60cc9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5afb6044-0bab-4144-a061-659cb6d60cc9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6a648ecd9a8993eb9b8dd21254e25174', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0bc04170f6f64b72ab18bc11c9d98cfc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a9f5cc40732a6cb2bed09a492ee51ab9030fa654e8fa6163a6142dcc122ee03ec5aee48086b29f1d99c70a3cf16e633c515fc8ba811f5899d6bd7546e1b2f2ff', 'id': '5afb6044-0bab-4144-a061-659cb6d60cc9', 'created_at': datetime.datetime(2026, 6, 2, 1, 37, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 1, 37, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5afb6044-0bab-4144-a061-659cb6d60cc9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Trying to clone 961c3a51-e205-4b33-919e-69ca661bb445 from image 5afb6044-0bab-4144-a061-659cb6d60cc9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5afb6044-0bab-4144-a061-659cb6d60cc9', 'metadata': {}}]). {{(pid=86431) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 02 03:37:04 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5afb6044-0bab-4144-a061-659cb6d60cc9_j758l1jqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86431) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 02 03:37:04 devstack cinder-volume[86431]: INFO cinder.image.image_utils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Image download 0.00 MB at 0.00 MB/s Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[031ddff4-d077-4158-bf9a-a478fb603425]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5afb6044-0bab-4144-a061-659cb6d60cc9_j758l1jqdevstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe63b384-8fd6-4986-8cfb-324e1f10cdab tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fe63b384-8fd6-4986-8cfb-324e1f10cdab tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Flow 'volume_create_manager' (0029e8dd-0a7b-4d65-b032-7164df894ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fe63b384-8fd6-4986-8cfb-324e1f10cdab tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a96ab631-8d8a-4732-ad5a-014149e1bd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fe63b384-8fd6-4986-8cfb-324e1f10cdab tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a96ab631-8d8a-4732-ad5a-014149e1bd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2106615350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42f0d0ec-a385-4967-8e70-0e8846a95b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63842c8ed9b408c9c48bf62e0375ef8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:05Z,use_quota=True,user_id='3f2b020b7ac941378aceba2ed95966b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fe63b384-8fd6-4986-8cfb-324e1f10cdab tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0bf1567-71d0-4cf9-85de-faa5eeff959b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fe63b384-8fd6-4986-8cfb-324e1f10cdab tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0bf1567-71d0-4cf9-85de-faa5eeff959b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fe63b384-8fd6-4986-8cfb-324e1f10cdab tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f4c7488-2c71-4d37-b198-0ce50fcd1c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fe63b384-8fd6-4986-8cfb-324e1f10cdab tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f4c7488-2c71-4d37-b198-0ce50fcd1c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42f0d0ec-a385-4967-8e70-0e8846a95b6d', 'volume_name': 'volume-42f0d0ec-a385-4967-8e70-0e8846a95b6d', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fe63b384-8fd6-4986-8cfb-324e1f10cdab tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73ac1363-d2f2-4df7-ba0a-225817bc792d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fe63b384-8fd6-4986-8cfb-324e1f10cdab tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73ac1363-d2f2-4df7-ba0a-225817bc792d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fe63b384-8fd6-4986-8cfb-324e1f10cdab tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89adf604-7bd0-491d-b10d-c13ca9577eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:05 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-fe63b384-8fd6-4986-8cfb-324e1f10cdab tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Volume 42f0d0ec-a385-4967-8e70-0e8846a95b6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42f0d0ec-a385-4967-8e70-0e8846a95b6d', 'volume_size': 1} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fe63b384-8fd6-4986-8cfb-324e1f10cdab tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:05 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5afb6044-0bab-4144-a061-659cb6d60cc9_j758l1jqdevstack@QuobyteHD Jun 02 03:37:05 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-254b7565-9345-4b0a-ba4b-06e1f7e23ec0 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-254b7565-9345-4b0a-ba4b-06e1f7e23ec0 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Flow 'volume_create_manager' (d4e949d0-788d-44f6-b72a-92eeb3533ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-254b7565-9345-4b0a-ba4b-06e1f7e23ec0 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eae87a09-a61a-4361-a9de-ae08baba01bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-254b7565-9345-4b0a-ba4b-06e1f7e23ec0 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eae87a09-a61a-4361-a9de-ae08baba01bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-648688057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=321fdb36-c758-4370-9423-9bb6ad20865a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63842c8ed9b408c9c48bf62e0375ef8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:05Z,use_quota=True,user_id='3f2b020b7ac941378aceba2ed95966b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-254b7565-9345-4b0a-ba4b-06e1f7e23ec0 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc642ee2-131e-42fa-8745-f26cad38cae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-254b7565-9345-4b0a-ba4b-06e1f7e23ec0 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc642ee2-131e-42fa-8745-f26cad38cae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-254b7565-9345-4b0a-ba4b-06e1f7e23ec0 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ef3e2e9-afe6-442d-9575-5a87a11c8bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-254b7565-9345-4b0a-ba4b-06e1f7e23ec0 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ef3e2e9-afe6-442d-9575-5a87a11c8bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '321fdb36-c758-4370-9423-9bb6ad20865a', 'volume_name': 'volume-321fdb36-c758-4370-9423-9bb6ad20865a', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-254b7565-9345-4b0a-ba4b-06e1f7e23ec0 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0232e487-bc2c-4177-8c6d-f6c10f802117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-254b7565-9345-4b0a-ba4b-06e1f7e23ec0 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0232e487-bc2c-4177-8c6d-f6c10f802117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-254b7565-9345-4b0a-ba4b-06e1f7e23ec0 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133aeb75-78c6-4c3d-9426-90716d5689d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:05 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-254b7565-9345-4b0a-ba4b-06e1f7e23ec0 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Volume 321fdb36-c758-4370-9423-9bb6ad20865a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-321fdb36-c758-4370-9423-9bb6ad20865a', 'volume_size': 1} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-254b7565-9345-4b0a-ba4b-06e1f7e23ec0 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:05 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-be171c7e-fb3b-4a02-9342-6dfb2de72565 tempest-CreateVolumesFromImageTest-999091618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e50f1520-d636-472d-ac7c-0d99fdfb15b0" returned: 0 in 0.803s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-be171c7e-fb3b-4a02-9342-6dfb2de72565 tempest-CreateVolumesFromImageTest-999091618 None] <== create_volume: return (1990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-be171c7e-fb3b-4a02-9342-6dfb2de72565 tempest-CreateVolumesFromImageTest-999091618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.992s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-f378af77-10c2-4f36-b96c-fb10a8166a33 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.457s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-f378af77-10c2-4f36-b96c-fb10a8166a33 tempest-CreateVolumesFromSnapshotTest-1597407613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1392777352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59701368-9b63-4bf7-9773-da738bfe2c99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43e3700b8ce94de2bdf9794af8e25e16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:01Z,use_quota=True,user_id='d58b0898f78c4e8ebefbfa32260e6f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-f378af77-10c2-4f36-b96c-fb10a8166a33 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Creating volume 59701368-9b63-4bf7-9773-da738bfe2c99 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-f378af77-10c2-4f36-b96c-fb10a8166a33 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-f378af77-10c2-4f36-b96c-fb10a8166a33 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-f378af77-10c2-4f36-b96c-fb10a8166a33 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-f378af77-10c2-4f36-b96c-fb10a8166a33 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-f378af77-10c2-4f36-b96c-fb10a8166a33 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-f378af77-10c2-4f36-b96c-fb10a8166a33 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:37:05 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-f378af77-10c2-4f36-b96c-fb10a8166a33 tempest-CreateVolumesFromSnapshotTest-1597407613 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f378af77-10c2-4f36-b96c-fb10a8166a33 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-be171c7e-fb3b-4a02-9342-6dfb2de72565 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51b6cc89-4f53-47c2-9191-90c58442d4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e50f1520-d636-472d-ac7c-0d99fdfb15b0', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:05 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99 1073741824 Jun 02 03:37:05 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-be171c7e-fb3b-4a02-9342-6dfb2de72565 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (344178c1-44da-4be8-ba2a-9366529ce353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:05 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-be171c7e-fb3b-4a02-9342-6dfb2de72565 tempest-CreateVolumesFromImageTest-999091618 None] Volume volume-e50f1520-d636-472d-ac7c-0d99fdfb15b0 (e50f1520-d636-472d-ac7c-0d99fdfb15b0): created successfully Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-be171c7e-fb3b-4a02-9342-6dfb2de72565 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (344178c1-44da-4be8-ba2a-9366529ce353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-be171c7e-fb3b-4a02-9342-6dfb2de72565 tempest-CreateVolumesFromImageTest-999091618 None] Flow 'volume_create_manager' (5fa6f267-4588-4ea5-88a9-fa6747b6ece5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:05 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-be171c7e-fb3b-4a02-9342-6dfb2de72565 tempest-CreateVolumesFromImageTest-999091618 None] Created volume successfully. Jun 02 03:37:05 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5afb6044-0bab-4144-a061-659cb6d60cc9_j758l1jqdevstack@QuobyteHD" returned: 0 in 0.764s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5afb6044-0bab-4144-a061-659cb6d60cc9_j758l1jqdevstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:05 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5afb6044-0bab-4144-a061-659cb6d60cc9_j758l1jqdevstack@QuobyteHD Jun 02 03:37:05 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:06 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f378af77-10c2-4f36-b96c-fb10a8166a33 tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99 1073741824" returned: 0 in 0.781s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f378af77-10c2-4f36-b96c-fb10a8166a33 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:06 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99 Jun 02 03:37:06 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:06 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5afb6044-0bab-4144-a061-659cb6d60cc9_j758l1jqdevstack@QuobyteHD" returned: 1 in 0.706s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5afb6044-0bab-4144-a061-659cb6d60cc9_j758l1jqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:37:06 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Temporary image 5afb6044-0bab-4144-a061-659cb6d60cc9 is fetched for user 4e03ea16cce04a47b034213af6d628bb. {{(pid=86431) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 02 03:37:06 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[86786bba-faa0-4794-9f33-804021adb9b0]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5afb6044-0bab-4144-a061-659cb6d60cc9_j758l1jqdevstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:06 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5afb6044-0bab-4144-a061-659cb6d60cc9_j758l1jqdevstack@QuobyteHD Jun 02 03:37:06 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:06 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f378af77-10c2-4f36-b96c-fb10a8166a33 tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99" returned: 0 in 0.626s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:06 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-f378af77-10c2-4f36-b96c-fb10a8166a33 tempest-CreateVolumesFromSnapshotTest-1597407613 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:37:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-f378af77-10c2-4f36-b96c-fb10a8166a33 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-322bf5cd-c472-455d-a84f-4c02a16c6946 tempest-CreateVolumesFromImageTest-999091618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.655s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:06 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-322bf5cd-c472-455d-a84f-4c02a16c6946 tempest-CreateVolumesFromImageTest-999091618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-176797573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1123f6bb-ce70-4683-9c1b-3330a32977ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='904170f3217846ccab75a11aeced4c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:01Z,use_quota=True,user_id='da89ef954ba548f3bdce2ca4cb8f0410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:37:06 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-322bf5cd-c472-455d-a84f-4c02a16c6946 tempest-CreateVolumesFromImageTest-999091618 None] Creating volume 1123f6bb-ce70-4683-9c1b-3330a32977ff {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:37:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-322bf5cd-c472-455d-a84f-4c02a16c6946 tempest-CreateVolumesFromImageTest-999091618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-322bf5cd-c472-455d-a84f-4c02a16c6946 tempest-CreateVolumesFromImageTest-999091618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:06 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-322bf5cd-c472-455d-a84f-4c02a16c6946 tempest-CreateVolumesFromImageTest-999091618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:06 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-322bf5cd-c472-455d-a84f-4c02a16c6946 tempest-CreateVolumesFromImageTest-999091618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-322bf5cd-c472-455d-a84f-4c02a16c6946 tempest-CreateVolumesFromImageTest-999091618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:06 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-322bf5cd-c472-455d-a84f-4c02a16c6946 tempest-CreateVolumesFromImageTest-999091618 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:37:06 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-322bf5cd-c472-455d-a84f-4c02a16c6946 tempest-CreateVolumesFromImageTest-999091618 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:37:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-322bf5cd-c472-455d-a84f-4c02a16c6946 tempest-CreateVolumesFromImageTest-999091618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1123f6bb-ce70-4683-9c1b-3330a32977ff 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:07 devstack sudo[105572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1123f6bb-ce70-4683-9c1b-3330a32977ff 1073741824 Jun 02 03:37:07 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:07 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-f378af77-10c2-4f36-b96c-fb10a8166a33 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (384fe1ba-9eda-43a8-8d02-474b8afc7779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59701368-9b63-4bf7-9773-da738bfe2c99', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:07 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-f378af77-10c2-4f36-b96c-fb10a8166a33 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e5b4ae9-b629-43ef-b620-cab7c10dc0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:07 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-f378af77-10c2-4f36-b96c-fb10a8166a33 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Volume volume-59701368-9b63-4bf7-9773-da738bfe2c99 (59701368-9b63-4bf7-9773-da738bfe2c99): created successfully Jun 02 03:37:07 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-f378af77-10c2-4f36-b96c-fb10a8166a33 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e5b4ae9-b629-43ef-b620-cab7c10dc0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:07 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-f378af77-10c2-4f36-b96c-fb10a8166a33 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Flow 'volume_create_manager' (100d5a6e-309e-4860-86f0-88859b304bd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:07 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-f378af77-10c2-4f36-b96c-fb10a8166a33 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Created volume successfully. Jun 02 03:37:07 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5afb6044-0bab-4144-a061-659cb6d60cc9_j758l1jqdevstack@QuobyteHD" returned: 0 in 0.704s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5afb6044-0bab-4144-a061-659cb6d60cc9_j758l1jqdevstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:07 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5afb6044-0bab-4144-a061-659cb6d60cc9_j758l1jqdevstack@QuobyteHD Jun 02 03:37:07 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-75161620-83d4-4b89-8399-9d005e1cc6b6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:07 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-322bf5cd-c472-455d-a84f-4c02a16c6946 tempest-CreateVolumesFromImageTest-999091618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1123f6bb-ce70-4683-9c1b-3330a32977ff 1073741824" returned: 0 in 0.848s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-322bf5cd-c472-455d-a84f-4c02a16c6946 tempest-CreateVolumesFromImageTest-999091618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1123f6bb-ce70-4683-9c1b-3330a32977ff {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:07 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1123f6bb-ce70-4683-9c1b-3330a32977ff Jun 02 03:37:07 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:08 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5afb6044-0bab-4144-a061-659cb6d60cc9_j758l1jqdevstack@QuobyteHD" returned: 1 in 0.731s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5afb6044-0bab-4144-a061-659cb6d60cc9_j758l1jqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:37:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:08 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-322bf5cd-c472-455d-a84f-4c02a16c6946 tempest-CreateVolumesFromImageTest-999091618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1123f6bb-ce70-4683-9c1b-3330a32977ff" returned: 0 in 0.583s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:08 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-322bf5cd-c472-455d-a84f-4c02a16c6946 tempest-CreateVolumesFromImageTest-999091618 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:37:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-322bf5cd-c472-455d-a84f-4c02a16c6946 tempest-CreateVolumesFromImageTest-999091618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6bc0f2aa-9ac7-4c6e-9fcb-6f190a11456a tempest-CreateVolumesFromImageTest-999091618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.754s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:08 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6bc0f2aa-9ac7-4c6e-9fcb-6f190a11456a tempest-CreateVolumesFromImageTest-999091618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1448478360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=203ec046-7cfe-4fea-8bd3-c4948e0f4c64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='904170f3217846ccab75a11aeced4c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:02Z,use_quota=True,user_id='da89ef954ba548f3bdce2ca4cb8f0410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:37:08 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-6bc0f2aa-9ac7-4c6e-9fcb-6f190a11456a tempest-CreateVolumesFromImageTest-999091618 None] Creating volume 203ec046-7cfe-4fea-8bd3-c4948e0f4c64 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:37:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6bc0f2aa-9ac7-4c6e-9fcb-6f190a11456a tempest-CreateVolumesFromImageTest-999091618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6bc0f2aa-9ac7-4c6e-9fcb-6f190a11456a tempest-CreateVolumesFromImageTest-999091618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:08 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6bc0f2aa-9ac7-4c6e-9fcb-6f190a11456a tempest-CreateVolumesFromImageTest-999091618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:08 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6bc0f2aa-9ac7-4c6e-9fcb-6f190a11456a tempest-CreateVolumesFromImageTest-999091618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6bc0f2aa-9ac7-4c6e-9fcb-6f190a11456a tempest-CreateVolumesFromImageTest-999091618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:08 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6bc0f2aa-9ac7-4c6e-9fcb-6f190a11456a tempest-CreateVolumesFromImageTest-999091618 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:37:08 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-6bc0f2aa-9ac7-4c6e-9fcb-6f190a11456a tempest-CreateVolumesFromImageTest-999091618 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:37:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6bc0f2aa-9ac7-4c6e-9fcb-6f190a11456a tempest-CreateVolumesFromImageTest-999091618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-203ec046-7cfe-4fea-8bd3-c4948e0f4c64 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-322bf5cd-c472-455d-a84f-4c02a16c6946 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a6fd48-00b3-457c-ab0a-bec441ba221f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1123f6bb-ce70-4683-9c1b-3330a32977ff', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:08 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-203ec046-7cfe-4fea-8bd3-c4948e0f4c64 1073741824 Jun 02 03:37:08 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-322bf5cd-c472-455d-a84f-4c02a16c6946 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e5403d-1c78-4339-a0a4-bdcefa99c12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:08 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-322bf5cd-c472-455d-a84f-4c02a16c6946 tempest-CreateVolumesFromImageTest-999091618 None] Volume volume-1123f6bb-ce70-4683-9c1b-3330a32977ff (1123f6bb-ce70-4683-9c1b-3330a32977ff): created successfully Jun 02 03:37:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-322bf5cd-c472-455d-a84f-4c02a16c6946 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e5403d-1c78-4339-a0a4-bdcefa99c12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-322bf5cd-c472-455d-a84f-4c02a16c6946 tempest-CreateVolumesFromImageTest-999091618 None] Flow 'volume_create_manager' (cb22108b-bcd7-4916-9822-edc887c1593a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:08 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-322bf5cd-c472-455d-a84f-4c02a16c6946 tempest-CreateVolumesFromImageTest-999091618 None] Created volume successfully. Jun 02 03:37:09 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6bc0f2aa-9ac7-4c6e-9fcb-6f190a11456a tempest-CreateVolumesFromImageTest-999091618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-203ec046-7cfe-4fea-8bd3-c4948e0f4c64 1073741824" returned: 0 in 0.746s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6bc0f2aa-9ac7-4c6e-9fcb-6f190a11456a tempest-CreateVolumesFromImageTest-999091618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-203ec046-7cfe-4fea-8bd3-c4948e0f4c64 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:09 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-203ec046-7cfe-4fea-8bd3-c4948e0f4c64 Jun 02 03:37:09 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:09 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:37:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:09 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:37:09 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:09 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6bc0f2aa-9ac7-4c6e-9fcb-6f190a11456a tempest-CreateVolumesFromImageTest-999091618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-203ec046-7cfe-4fea-8bd3-c4948e0f4c64" returned: 0 in 0.646s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6bc0f2aa-9ac7-4c6e-9fcb-6f190a11456a tempest-CreateVolumesFromImageTest-999091618 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:37:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6bc0f2aa-9ac7-4c6e-9fcb-6f190a11456a tempest-CreateVolumesFromImageTest-999091618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0c9c7170-173d-4cad-b85f-67306cebfff5 tempest-CreateVolumesFromImageTest-999091618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.790s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0c9c7170-173d-4cad-b85f-67306cebfff5 tempest-CreateVolumesFromImageTest-999091618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-418548164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3b484c5-0e6c-4e9e-8318-e930b2657962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='904170f3217846ccab75a11aeced4c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:02Z,use_quota=True,user_id='da89ef954ba548f3bdce2ca4cb8f0410',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:37:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-0c9c7170-173d-4cad-b85f-67306cebfff5 tempest-CreateVolumesFromImageTest-999091618 None] Creating volume e3b484c5-0e6c-4e9e-8318-e930b2657962 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:37:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0c9c7170-173d-4cad-b85f-67306cebfff5 tempest-CreateVolumesFromImageTest-999091618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0c9c7170-173d-4cad-b85f-67306cebfff5 tempest-CreateVolumesFromImageTest-999091618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0c9c7170-173d-4cad-b85f-67306cebfff5 tempest-CreateVolumesFromImageTest-999091618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0c9c7170-173d-4cad-b85f-67306cebfff5 tempest-CreateVolumesFromImageTest-999091618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0c9c7170-173d-4cad-b85f-67306cebfff5 tempest-CreateVolumesFromImageTest-999091618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0c9c7170-173d-4cad-b85f-67306cebfff5 tempest-CreateVolumesFromImageTest-999091618 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:37:09 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-0c9c7170-173d-4cad-b85f-67306cebfff5 tempest-CreateVolumesFromImageTest-999091618 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:37:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0c9c7170-173d-4cad-b85f-67306cebfff5 tempest-CreateVolumesFromImageTest-999091618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e3b484c5-0e6c-4e9e-8318-e930b2657962 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:09 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6bc0f2aa-9ac7-4c6e-9fcb-6f190a11456a tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c771c593-fe18-45b4-915d-47f93288c381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-203ec046-7cfe-4fea-8bd3-c4948e0f4c64', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:09 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e3b484c5-0e6c-4e9e-8318-e930b2657962 1073741824 Jun 02 03:37:09 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6bc0f2aa-9ac7-4c6e-9fcb-6f190a11456a tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40689d05-5378-4ddf-9f3a-1dbef34f6354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:09 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:09 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-6bc0f2aa-9ac7-4c6e-9fcb-6f190a11456a tempest-CreateVolumesFromImageTest-999091618 None] Volume volume-203ec046-7cfe-4fea-8bd3-c4948e0f4c64 (203ec046-7cfe-4fea-8bd3-c4948e0f4c64): created successfully Jun 02 03:37:09 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6bc0f2aa-9ac7-4c6e-9fcb-6f190a11456a tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40689d05-5378-4ddf-9f3a-1dbef34f6354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:09 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6bc0f2aa-9ac7-4c6e-9fcb-6f190a11456a tempest-CreateVolumesFromImageTest-999091618 None] Flow 'volume_create_manager' (a082ccfe-31e9-4376-980f-62b08fa778bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:09 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-6bc0f2aa-9ac7-4c6e-9fcb-6f190a11456a tempest-CreateVolumesFromImageTest-999091618 None] Created volume successfully. Jun 02 03:37:10 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.605s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:10 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:37:10 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager._thread_info {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:37:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread count: 28 {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 02 03:37:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread info: [<_MainThread(MainThread, started 138618128814208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 02 03:37:10 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0c9c7170-173d-4cad-b85f-67306cebfff5 tempest-CreateVolumesFromImageTest-999091618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e3b484c5-0e6c-4e9e-8318-e930b2657962 1073741824" returned: 0 in 0.811s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0c9c7170-173d-4cad-b85f-67306cebfff5 tempest-CreateVolumesFromImageTest-999091618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e3b484c5-0e6c-4e9e-8318-e930b2657962 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:10 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e3b484c5-0e6c-4e9e-8318-e930b2657962 Jun 02 03:37:10 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:11 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0c9c7170-173d-4cad-b85f-67306cebfff5 tempest-CreateVolumesFromImageTest-999091618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e3b484c5-0e6c-4e9e-8318-e930b2657962" returned: 0 in 0.632s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0c9c7170-173d-4cad-b85f-67306cebfff5 tempest-CreateVolumesFromImageTest-999091618 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:37:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0c9c7170-173d-4cad-b85f-67306cebfff5 tempest-CreateVolumesFromImageTest-999091618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-63ff4e6b-3d2e-4a6e-961f-d44b1f1b8279 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.542s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-63ff4e6b-3d2e-4a6e-961f-d44b1f1b8279 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1123552900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f457731a-a659-44b3-9771-a8a4ec8fc437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63842c8ed9b408c9c48bf62e0375ef8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:04Z,use_quota=True,user_id='3f2b020b7ac941378aceba2ed95966b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:37:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-63ff4e6b-3d2e-4a6e-961f-d44b1f1b8279 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Creating volume f457731a-a659-44b3-9771-a8a4ec8fc437 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:37:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-63ff4e6b-3d2e-4a6e-961f-d44b1f1b8279 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-63ff4e6b-3d2e-4a6e-961f-d44b1f1b8279 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-63ff4e6b-3d2e-4a6e-961f-d44b1f1b8279 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-63ff4e6b-3d2e-4a6e-961f-d44b1f1b8279 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-63ff4e6b-3d2e-4a6e-961f-d44b1f1b8279 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:11 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-63ff4e6b-3d2e-4a6e-961f-d44b1f1b8279 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:37:11 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-63ff4e6b-3d2e-4a6e-961f-d44b1f1b8279 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:37:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63ff4e6b-3d2e-4a6e-961f-d44b1f1b8279 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f457731a-a659-44b3-9771-a8a4ec8fc437 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c9c7170-173d-4cad-b85f-67306cebfff5 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2346a9c9-25a0-4884-9dff-87837e3edbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3b484c5-0e6c-4e9e-8318-e930b2657962', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c9c7170-173d-4cad-b85f-67306cebfff5 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f7065a0-097f-4c88-8515-a839e42bb395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:11 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f457731a-a659-44b3-9771-a8a4ec8fc437 1073741824 Jun 02 03:37:11 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:11 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-0c9c7170-173d-4cad-b85f-67306cebfff5 tempest-CreateVolumesFromImageTest-999091618 None] Volume volume-e3b484c5-0e6c-4e9e-8318-e930b2657962 (e3b484c5-0e6c-4e9e-8318-e930b2657962): created successfully Jun 02 03:37:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c9c7170-173d-4cad-b85f-67306cebfff5 tempest-CreateVolumesFromImageTest-999091618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f7065a0-097f-4c88-8515-a839e42bb395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:11 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0c9c7170-173d-4cad-b85f-67306cebfff5 tempest-CreateVolumesFromImageTest-999091618 None] Flow 'volume_create_manager' (f82d7d7c-95c0-4bc5-bb87-7175190dff95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:11 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-0c9c7170-173d-4cad-b85f-67306cebfff5 tempest-CreateVolumesFromImageTest-999091618 None] Created volume successfully. Jun 02 03:37:11 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6c61d506-7823-4fa0-b5d7-0793a830aa8b tempest-CreateVolumesFromImageTest-999091618 None] Acquiring lock "cinder-e3b484c5-0e6c-4e9e-8318-e930b2657962-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:12 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6c61d506-7823-4fa0-b5d7-0793a830aa8b tempest-CreateVolumesFromImageTest-999091618 None] Lock "cinder-e3b484c5-0e6c-4e9e-8318-e930b2657962-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:12 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6c61d506-7823-4fa0-b5d7-0793a830aa8b tempest-CreateVolumesFromImageTest-999091618 None] Acquiring lock "cinder-quobyte-e3b484c5-0e6c-4e9e-8318-e930b2657962" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:12 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6c61d506-7823-4fa0-b5d7-0793a830aa8b tempest-CreateVolumesFromImageTest-999091618 None] Lock "cinder-quobyte-e3b484c5-0e6c-4e9e-8318-e930b2657962" acquired by "delete_volume" :: waited 0.019s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:12 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f868f1-c9bc-450d-96a0-f0afde089a0b]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6c61d506-7823-4fa0-b5d7-0793a830aa8b tempest-CreateVolumesFromImageTest-999091618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e3b484c5-0e6c-4e9e-8318-e930b2657962 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:12 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e3b484c5-0e6c-4e9e-8318-e930b2657962 Jun 02 03:37:12 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:12 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63ff4e6b-3d2e-4a6e-961f-d44b1f1b8279 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f457731a-a659-44b3-9771-a8a4ec8fc437 1073741824" returned: 0 in 0.852s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63ff4e6b-3d2e-4a6e-961f-d44b1f1b8279 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f457731a-a659-44b3-9771-a8a4ec8fc437 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:12 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f457731a-a659-44b3-9771-a8a4ec8fc437 Jun 02 03:37:12 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:12 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6c61d506-7823-4fa0-b5d7-0793a830aa8b tempest-CreateVolumesFromImageTest-999091618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e3b484c5-0e6c-4e9e-8318-e930b2657962" returned: 0 in 0.782s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6c61d506-7823-4fa0-b5d7-0793a830aa8b tempest-CreateVolumesFromImageTest-999091618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e3b484c5-0e6c-4e9e-8318-e930b2657962 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:12 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63ff4e6b-3d2e-4a6e-961f-d44b1f1b8279 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f457731a-a659-44b3-9771-a8a4ec8fc437" returned: 0 in 0.629s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:12 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-63ff4e6b-3d2e-4a6e-961f-d44b1f1b8279 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:37:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-63ff4e6b-3d2e-4a6e-961f-d44b1f1b8279 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:12 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e3b484c5-0e6c-4e9e-8318-e930b2657962 Jun 02 03:37:12 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-db7943ad-c076-4404-90be-bc585ee4eec1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.764s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:12 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-db7943ad-c076-4404-90be-bc585ee4eec1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2115482452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f618ba80-dd09-44f4-bb78-9a6ee6712933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63842c8ed9b408c9c48bf62e0375ef8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:04Z,use_quota=True,user_id='3f2b020b7ac941378aceba2ed95966b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:37:12 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-db7943ad-c076-4404-90be-bc585ee4eec1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Creating volume f618ba80-dd09-44f4-bb78-9a6ee6712933 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:37:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-db7943ad-c076-4404-90be-bc585ee4eec1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-db7943ad-c076-4404-90be-bc585ee4eec1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:12 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-db7943ad-c076-4404-90be-bc585ee4eec1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:12 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-db7943ad-c076-4404-90be-bc585ee4eec1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-db7943ad-c076-4404-90be-bc585ee4eec1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.071s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:12 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-db7943ad-c076-4404-90be-bc585ee4eec1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:37:12 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-db7943ad-c076-4404-90be-bc585ee4eec1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:37:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-db7943ad-c076-4404-90be-bc585ee4eec1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f618ba80-dd09-44f4-bb78-9a6ee6712933 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63ff4e6b-3d2e-4a6e-961f-d44b1f1b8279 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4250c3e5-a40a-4e29-9170-51afa9f1f321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f457731a-a659-44b3-9771-a8a4ec8fc437', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63ff4e6b-3d2e-4a6e-961f-d44b1f1b8279 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89004e32-d777-4061-8d01-d9625e44564b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:13 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f618ba80-dd09-44f4-bb78-9a6ee6712933 1073741824 Jun 02 03:37:13 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:13 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-63ff4e6b-3d2e-4a6e-961f-d44b1f1b8279 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Volume volume-f457731a-a659-44b3-9771-a8a4ec8fc437 (f457731a-a659-44b3-9771-a8a4ec8fc437): created successfully Jun 02 03:37:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63ff4e6b-3d2e-4a6e-961f-d44b1f1b8279 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89004e32-d777-4061-8d01-d9625e44564b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:13 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63ff4e6b-3d2e-4a6e-961f-d44b1f1b8279 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Flow 'volume_create_manager' (666319f9-c2c5-4015-af5a-bdbab362dacd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:13 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-63ff4e6b-3d2e-4a6e-961f-d44b1f1b8279 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Created volume successfully. Jun 02 03:37:13 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6c61d506-7823-4fa0-b5d7-0793a830aa8b tempest-CreateVolumesFromImageTest-999091618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e3b484c5-0e6c-4e9e-8318-e930b2657962" returned: 0 in 0.654s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:13 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6c61d506-7823-4fa0-b5d7-0793a830aa8b tempest-CreateVolumesFromImageTest-999091618 None] Lock "cinder-quobyte-e3b484c5-0e6c-4e9e-8318-e930b2657962" released by "delete_volume" :: held 1.486s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:13 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=94,cinder:UPDATE=126,cinder:INSERT=30,cinder:DELETE=8 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:37:13 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-6c61d506-7823-4fa0-b5d7-0793a830aa8b tempest-CreateVolumesFromImageTest-999091618 None] Created reservations ['ca552510-339b-4a63-90ef-f7c7e6eacc84', 'de912c43-a2f0-4e64-bb93-df40e2504a26', 'a1fbc807-793f-4eae-9ac2-8102cb33832a', 'd72fe4ca-08f7-4dbb-ab8b-74769e1ece02'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:37:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6c61d506-7823-4fa0-b5d7-0793a830aa8b tempest-CreateVolumesFromImageTest-999091618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6c61d506-7823-4fa0-b5d7-0793a830aa8b tempest-CreateVolumesFromImageTest-999091618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:13 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6c61d506-7823-4fa0-b5d7-0793a830aa8b tempest-CreateVolumesFromImageTest-999091618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:13 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6c61d506-7823-4fa0-b5d7-0793a830aa8b tempest-CreateVolumesFromImageTest-999091618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6c61d506-7823-4fa0-b5d7-0793a830aa8b tempest-CreateVolumesFromImageTest-999091618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6c61d506-7823-4fa0-b5d7-0793a830aa8b tempest-CreateVolumesFromImageTest-999091618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:13 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:37:13 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:13 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-db7943ad-c076-4404-90be-bc585ee4eec1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f618ba80-dd09-44f4-bb78-9a6ee6712933 1073741824" returned: 0 in 0.925s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-db7943ad-c076-4404-90be-bc585ee4eec1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f618ba80-dd09-44f4-bb78-9a6ee6712933 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:13 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f618ba80-dd09-44f4-bb78-9a6ee6712933 Jun 02 03:37:13 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:14 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f2473593-6429-401b-aca3-2f2079f35308 tempest-CreateVolumesFromImageTest-999091618 None] Acquiring lock "cinder-203ec046-7cfe-4fea-8bd3-c4948e0f4c64-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:14 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f2473593-6429-401b-aca3-2f2079f35308 tempest-CreateVolumesFromImageTest-999091618 None] Lock "cinder-203ec046-7cfe-4fea-8bd3-c4948e0f4c64-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:14 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f2473593-6429-401b-aca3-2f2079f35308 tempest-CreateVolumesFromImageTest-999091618 None] Acquiring lock "cinder-quobyte-203ec046-7cfe-4fea-8bd3-c4948e0f4c64" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:14 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f2473593-6429-401b-aca3-2f2079f35308 tempest-CreateVolumesFromImageTest-999091618 None] Lock "cinder-quobyte-203ec046-7cfe-4fea-8bd3-c4948e0f4c64" acquired by "delete_volume" :: waited 0.022s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:14 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b02486-a65e-406a-a8de-9ef1c2e543fd]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f2473593-6429-401b-aca3-2f2079f35308 tempest-CreateVolumesFromImageTest-999091618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-203ec046-7cfe-4fea-8bd3-c4948e0f4c64 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:14 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6c61d506-7823-4fa0-b5d7-0793a830aa8b tempest-CreateVolumesFromImageTest-999091618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.755s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:14 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-6c61d506-7823-4fa0-b5d7-0793a830aa8b tempest-CreateVolumesFromImageTest-999091618 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:37:14 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-6c61d506-7823-4fa0-b5d7-0793a830aa8b tempest-CreateVolumesFromImageTest-999091618 None] Deleted volume successfully. Jun 02 03:37:14 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6c61d506-7823-4fa0-b5d7-0793a830aa8b tempest-CreateVolumesFromImageTest-999091618 None] Lock "cinder-e3b484c5-0e6c-4e9e-8318-e930b2657962-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:14 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-203ec046-7cfe-4fea-8bd3-c4948e0f4c64 Jun 02 03:37:14 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:14 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-db7943ad-c076-4404-90be-bc585ee4eec1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f618ba80-dd09-44f4-bb78-9a6ee6712933" returned: 0 in 0.676s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:14 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-db7943ad-c076-4404-90be-bc585ee4eec1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:37:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-db7943ad-c076-4404-90be-bc585ee4eec1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6f5c4762-0627-4c91-a2de-974dc6ab4b76 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.009s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:14 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6f5c4762-0627-4c91-a2de-974dc6ab4b76 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2013510401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d0670d5-3922-4479-b27a-ff452673bb91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63842c8ed9b408c9c48bf62e0375ef8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:04Z,use_quota=True,user_id='3f2b020b7ac941378aceba2ed95966b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:37:14 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-6f5c4762-0627-4c91-a2de-974dc6ab4b76 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Creating volume 2d0670d5-3922-4479-b27a-ff452673bb91 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:37:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6f5c4762-0627-4c91-a2de-974dc6ab4b76 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6f5c4762-0627-4c91-a2de-974dc6ab4b76 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:14 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6f5c4762-0627-4c91-a2de-974dc6ab4b76 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:14 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6f5c4762-0627-4c91-a2de-974dc6ab4b76 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6f5c4762-0627-4c91-a2de-974dc6ab4b76 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:14 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6f5c4762-0627-4c91-a2de-974dc6ab4b76 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:37:14 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-6f5c4762-0627-4c91-a2de-974dc6ab4b76 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:37:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6f5c4762-0627-4c91-a2de-974dc6ab4b76 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2d0670d5-3922-4479-b27a-ff452673bb91 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:14 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-db7943ad-c076-4404-90be-bc585ee4eec1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8024b3ee-cac9-4ff8-b6b5-a1da7bbc0214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f618ba80-dd09-44f4-bb78-9a6ee6712933', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:14 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2d0670d5-3922-4479-b27a-ff452673bb91 1073741824 Jun 02 03:37:14 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-db7943ad-c076-4404-90be-bc585ee4eec1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b09a5ccb-7051-47bd-b7e8-8eef191f35e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:14 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:14 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-db7943ad-c076-4404-90be-bc585ee4eec1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Volume volume-f618ba80-dd09-44f4-bb78-9a6ee6712933 (f618ba80-dd09-44f4-bb78-9a6ee6712933): created successfully Jun 02 03:37:14 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-db7943ad-c076-4404-90be-bc585ee4eec1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b09a5ccb-7051-47bd-b7e8-8eef191f35e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:14 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-db7943ad-c076-4404-90be-bc585ee4eec1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Flow 'volume_create_manager' (1ad57ccd-8d44-4b57-8768-4868ab5cd337) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:14 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-db7943ad-c076-4404-90be-bc585ee4eec1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Created volume successfully. Jun 02 03:37:15 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f2473593-6429-401b-aca3-2f2079f35308 tempest-CreateVolumesFromImageTest-999091618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-203ec046-7cfe-4fea-8bd3-c4948e0f4c64" returned: 0 in 0.764s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f2473593-6429-401b-aca3-2f2079f35308 tempest-CreateVolumesFromImageTest-999091618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-203ec046-7cfe-4fea-8bd3-c4948e0f4c64 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:15 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-203ec046-7cfe-4fea-8bd3-c4948e0f4c64 Jun 02 03:37:15 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:15 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6f5c4762-0627-4c91-a2de-974dc6ab4b76 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2d0670d5-3922-4479-b27a-ff452673bb91 1073741824" returned: 0 in 0.833s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6f5c4762-0627-4c91-a2de-974dc6ab4b76 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2d0670d5-3922-4479-b27a-ff452673bb91 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:15 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2d0670d5-3922-4479-b27a-ff452673bb91 Jun 02 03:37:15 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:15 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f2473593-6429-401b-aca3-2f2079f35308 tempest-CreateVolumesFromImageTest-999091618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-203ec046-7cfe-4fea-8bd3-c4948e0f4c64" returned: 0 in 0.658s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:15 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f2473593-6429-401b-aca3-2f2079f35308 tempest-CreateVolumesFromImageTest-999091618 None] Lock "cinder-quobyte-203ec046-7cfe-4fea-8bd3-c4948e0f4c64" released by "delete_volume" :: held 1.469s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:15 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-f2473593-6429-401b-aca3-2f2079f35308 tempest-CreateVolumesFromImageTest-999091618 None] Created reservations ['13f2fcbb-f28e-44d5-bb03-40bb3d886f76', '6e0ae3a7-7338-4570-8032-5f82a8f41907', '2cdcb6e3-beeb-49e1-bd77-a8f638a6dad5', '6864053a-7ef4-4b82-a156-c3a334d09cdc'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:37:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-f2473593-6429-401b-aca3-2f2079f35308 tempest-CreateVolumesFromImageTest-999091618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-f2473593-6429-401b-aca3-2f2079f35308 tempest-CreateVolumesFromImageTest-999091618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:15 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-f2473593-6429-401b-aca3-2f2079f35308 tempest-CreateVolumesFromImageTest-999091618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:15 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-f2473593-6429-401b-aca3-2f2079f35308 tempest-CreateVolumesFromImageTest-999091618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-f2473593-6429-401b-aca3-2f2079f35308 tempest-CreateVolumesFromImageTest-999091618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f2473593-6429-401b-aca3-2f2079f35308 tempest-CreateVolumesFromImageTest-999091618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:15 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:37:15 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:16 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6f5c4762-0627-4c91-a2de-974dc6ab4b76 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2d0670d5-3922-4479-b27a-ff452673bb91" returned: 0 in 0.641s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:16 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6f5c4762-0627-4c91-a2de-974dc6ab4b76 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:37:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6f5c4762-0627-4c91-a2de-974dc6ab4b76 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fe63b384-8fd6-4986-8cfb-324e1f10cdab tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.029s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:16 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-fe63b384-8fd6-4986-8cfb-324e1f10cdab tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2106615350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42f0d0ec-a385-4967-8e70-0e8846a95b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63842c8ed9b408c9c48bf62e0375ef8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:05Z,use_quota=True,user_id='3f2b020b7ac941378aceba2ed95966b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:37:16 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-fe63b384-8fd6-4986-8cfb-324e1f10cdab tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Creating volume 42f0d0ec-a385-4967-8e70-0e8846a95b6d {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:37:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fe63b384-8fd6-4986-8cfb-324e1f10cdab tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fe63b384-8fd6-4986-8cfb-324e1f10cdab tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:16 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-fe63b384-8fd6-4986-8cfb-324e1f10cdab tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:16 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-fe63b384-8fd6-4986-8cfb-324e1f10cdab tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fe63b384-8fd6-4986-8cfb-324e1f10cdab tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:16 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-fe63b384-8fd6-4986-8cfb-324e1f10cdab tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:37:16 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-fe63b384-8fd6-4986-8cfb-324e1f10cdab tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:37:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fe63b384-8fd6-4986-8cfb-324e1f10cdab tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-42f0d0ec-a385-4967-8e70-0e8846a95b6d 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:16 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6f5c4762-0627-4c91-a2de-974dc6ab4b76 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b360cd0-d7fd-433e-8c5e-9439e5b44b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d0670d5-3922-4479-b27a-ff452673bb91', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:16 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-42f0d0ec-a385-4967-8e70-0e8846a95b6d 1073741824 Jun 02 03:37:16 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:16 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6f5c4762-0627-4c91-a2de-974dc6ab4b76 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e3103bd-c7fd-4646-aa31-518fad588846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:16 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-6f5c4762-0627-4c91-a2de-974dc6ab4b76 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Volume volume-2d0670d5-3922-4479-b27a-ff452673bb91 (2d0670d5-3922-4479-b27a-ff452673bb91): created successfully Jun 02 03:37:16 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6f5c4762-0627-4c91-a2de-974dc6ab4b76 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e3103bd-c7fd-4646-aa31-518fad588846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:16 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-6f5c4762-0627-4c91-a2de-974dc6ab4b76 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Flow 'volume_create_manager' (4b536a93-4060-434b-8de6-99d602833d60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:16 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-6f5c4762-0627-4c91-a2de-974dc6ab4b76 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Created volume successfully. Jun 02 03:37:16 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-58859117-6483-4c6e-acc7-dc0812464d84 tempest-CreateVolumesFromImageTest-999091618 None] Acquiring lock "cinder-1123f6bb-ce70-4683-9c1b-3330a32977ff-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:16 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-58859117-6483-4c6e-acc7-dc0812464d84 tempest-CreateVolumesFromImageTest-999091618 None] Lock "cinder-1123f6bb-ce70-4683-9c1b-3330a32977ff-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:16 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:16 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-58859117-6483-4c6e-acc7-dc0812464d84 tempest-CreateVolumesFromImageTest-999091618 None] Acquiring lock "cinder-quobyte-1123f6bb-ce70-4683-9c1b-3330a32977ff" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-f2473593-6429-401b-aca3-2f2079f35308 tempest-CreateVolumesFromImageTest-999091618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.629s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:16 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-f2473593-6429-401b-aca3-2f2079f35308 tempest-CreateVolumesFromImageTest-999091618 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:37:16 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-f2473593-6429-401b-aca3-2f2079f35308 tempest-CreateVolumesFromImageTest-999091618 None] Deleted volume successfully. Jun 02 03:37:16 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-58859117-6483-4c6e-acc7-dc0812464d84 tempest-CreateVolumesFromImageTest-999091618 None] Lock "cinder-quobyte-1123f6bb-ce70-4683-9c1b-3330a32977ff" acquired by "delete_volume" :: waited 0.031s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:16 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fd38ec-52ca-4085-937c-a5490585cac2]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-58859117-6483-4c6e-acc7-dc0812464d84 tempest-CreateVolumesFromImageTest-999091618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1123f6bb-ce70-4683-9c1b-3330a32977ff {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:16 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-f2473593-6429-401b-aca3-2f2079f35308 tempest-CreateVolumesFromImageTest-999091618 None] Lock "cinder-203ec046-7cfe-4fea-8bd3-c4948e0f4c64-delete_volume" released by "delete_volume" :: held 2.355s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:16 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1123f6bb-ce70-4683-9c1b-3330a32977ff Jun 02 03:37:16 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:16 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fe63b384-8fd6-4986-8cfb-324e1f10cdab tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-42f0d0ec-a385-4967-8e70-0e8846a95b6d 1073741824" returned: 0 in 0.790s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fe63b384-8fd6-4986-8cfb-324e1f10cdab tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-42f0d0ec-a385-4967-8e70-0e8846a95b6d {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:17 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-42f0d0ec-a385-4967-8e70-0e8846a95b6d Jun 02 03:37:17 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:17 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-58859117-6483-4c6e-acc7-dc0812464d84 tempest-CreateVolumesFromImageTest-999091618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1123f6bb-ce70-4683-9c1b-3330a32977ff" returned: 0 in 0.735s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-58859117-6483-4c6e-acc7-dc0812464d84 tempest-CreateVolumesFromImageTest-999091618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1123f6bb-ce70-4683-9c1b-3330a32977ff {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:17 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1123f6bb-ce70-4683-9c1b-3330a32977ff Jun 02 03:37:17 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:17 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fe63b384-8fd6-4986-8cfb-324e1f10cdab tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-42f0d0ec-a385-4967-8e70-0e8846a95b6d" returned: 0 in 0.596s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:17 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-fe63b384-8fd6-4986-8cfb-324e1f10cdab tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:37:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fe63b384-8fd6-4986-8cfb-324e1f10cdab tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-254b7565-9345-4b0a-ba4b-06e1f7e23ec0 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.140s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:17 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-254b7565-9345-4b0a-ba4b-06e1f7e23ec0 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-648688057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=321fdb36-c758-4370-9423-9bb6ad20865a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63842c8ed9b408c9c48bf62e0375ef8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:05Z,use_quota=True,user_id='3f2b020b7ac941378aceba2ed95966b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:37:17 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-254b7565-9345-4b0a-ba4b-06e1f7e23ec0 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Creating volume 321fdb36-c758-4370-9423-9bb6ad20865a {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:37:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-254b7565-9345-4b0a-ba4b-06e1f7e23ec0 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-254b7565-9345-4b0a-ba4b-06e1f7e23ec0 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:17 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-254b7565-9345-4b0a-ba4b-06e1f7e23ec0 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:17 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-254b7565-9345-4b0a-ba4b-06e1f7e23ec0 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-254b7565-9345-4b0a-ba4b-06e1f7e23ec0 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:17 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-254b7565-9345-4b0a-ba4b-06e1f7e23ec0 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:37:17 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-254b7565-9345-4b0a-ba4b-06e1f7e23ec0 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:37:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-254b7565-9345-4b0a-ba4b-06e1f7e23ec0 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-321fdb36-c758-4370-9423-9bb6ad20865a 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:17 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-321fdb36-c758-4370-9423-9bb6ad20865a 1073741824 Jun 02 03:37:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fe63b384-8fd6-4986-8cfb-324e1f10cdab tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89adf604-7bd0-491d-b10d-c13ca9577eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42f0d0ec-a385-4967-8e70-0e8846a95b6d', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:17 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fe63b384-8fd6-4986-8cfb-324e1f10cdab tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df7898d-afe1-420b-9b39-062ca0937bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:17 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-fe63b384-8fd6-4986-8cfb-324e1f10cdab tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Volume volume-42f0d0ec-a385-4967-8e70-0e8846a95b6d (42f0d0ec-a385-4967-8e70-0e8846a95b6d): created successfully Jun 02 03:37:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fe63b384-8fd6-4986-8cfb-324e1f10cdab tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df7898d-afe1-420b-9b39-062ca0937bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:17 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-fe63b384-8fd6-4986-8cfb-324e1f10cdab tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Flow 'volume_create_manager' (0029e8dd-0a7b-4d65-b032-7164df894ae3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:17 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-fe63b384-8fd6-4986-8cfb-324e1f10cdab tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Created volume successfully. Jun 02 03:37:17 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-58859117-6483-4c6e-acc7-dc0812464d84 tempest-CreateVolumesFromImageTest-999091618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1123f6bb-ce70-4683-9c1b-3330a32977ff" returned: 0 in 0.602s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:17 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-58859117-6483-4c6e-acc7-dc0812464d84 tempest-CreateVolumesFromImageTest-999091618 None] Lock "cinder-quobyte-1123f6bb-ce70-4683-9c1b-3330a32977ff" released by "delete_volume" :: held 1.386s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:18 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-58859117-6483-4c6e-acc7-dc0812464d84 tempest-CreateVolumesFromImageTest-999091618 None] Created reservations ['61d6e41f-7abc-4809-a146-fdaa495eb0ec', '0683deaa-e90e-4310-a93a-4893202db2cf', '54a4640a-10f6-47b0-b9e5-fa4ea0068cb6', '6f076d46-24ca-4633-a348-9a281b74c24f'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:37:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-58859117-6483-4c6e-acc7-dc0812464d84 tempest-CreateVolumesFromImageTest-999091618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-58859117-6483-4c6e-acc7-dc0812464d84 tempest-CreateVolumesFromImageTest-999091618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:18 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-58859117-6483-4c6e-acc7-dc0812464d84 tempest-CreateVolumesFromImageTest-999091618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:18 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-58859117-6483-4c6e-acc7-dc0812464d84 tempest-CreateVolumesFromImageTest-999091618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-58859117-6483-4c6e-acc7-dc0812464d84 tempest-CreateVolumesFromImageTest-999091618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-58859117-6483-4c6e-acc7-dc0812464d84 tempest-CreateVolumesFromImageTest-999091618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:18 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:37:18 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:18 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-254b7565-9345-4b0a-ba4b-06e1f7e23ec0 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-321fdb36-c758-4370-9423-9bb6ad20865a 1073741824" returned: 0 in 0.836s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-254b7565-9345-4b0a-ba4b-06e1f7e23ec0 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-321fdb36-c758-4370-9423-9bb6ad20865a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:18 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-321fdb36-c758-4370-9423-9bb6ad20865a Jun 02 03:37:18 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:18 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-58859117-6483-4c6e-acc7-dc0812464d84 tempest-CreateVolumesFromImageTest-999091618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.627s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:18 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-58859117-6483-4c6e-acc7-dc0812464d84 tempest-CreateVolumesFromImageTest-999091618 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:37:18 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-58859117-6483-4c6e-acc7-dc0812464d84 tempest-CreateVolumesFromImageTest-999091618 None] Deleted volume successfully. Jun 02 03:37:18 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5dbe0c80-3a00-4eed-ab57-380891491aa1 tempest-CreateVolumesFromImageTest-999091618 None] Acquiring lock "cinder-e50f1520-d636-472d-ac7c-0d99fdfb15b0-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:18 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-58859117-6483-4c6e-acc7-dc0812464d84 tempest-CreateVolumesFromImageTest-999091618 None] Lock "cinder-1123f6bb-ce70-4683-9c1b-3330a32977ff-delete_volume" released by "delete_volume" :: held 2.261s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:18 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5dbe0c80-3a00-4eed-ab57-380891491aa1 tempest-CreateVolumesFromImageTest-999091618 None] Lock "cinder-e50f1520-d636-472d-ac7c-0d99fdfb15b0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:18 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5dbe0c80-3a00-4eed-ab57-380891491aa1 tempest-CreateVolumesFromImageTest-999091618 None] Acquiring lock "cinder-quobyte-e50f1520-d636-472d-ac7c-0d99fdfb15b0" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:18 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5dbe0c80-3a00-4eed-ab57-380891491aa1 tempest-CreateVolumesFromImageTest-999091618 None] Lock "cinder-quobyte-e50f1520-d636-472d-ac7c-0d99fdfb15b0" acquired by "delete_volume" :: waited 0.016s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:18 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e287eef-e590-410f-a163-7a697a119274]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5dbe0c80-3a00-4eed-ab57-380891491aa1 tempest-CreateVolumesFromImageTest-999091618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e50f1520-d636-472d-ac7c-0d99fdfb15b0 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:18 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e50f1520-d636-472d-ac7c-0d99fdfb15b0 Jun 02 03:37:18 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:19 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-254b7565-9345-4b0a-ba4b-06e1f7e23ec0 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-321fdb36-c758-4370-9423-9bb6ad20865a" returned: 0 in 0.637s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:19 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-254b7565-9345-4b0a-ba4b-06e1f7e23ec0 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:37:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-254b7565-9345-4b0a-ba4b-06e1f7e23ec0 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-75161620-83d4-4b89-8399-9d005e1cc6b6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.406s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-254b7565-9345-4b0a-ba4b-06e1f7e23ec0 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133aeb75-78c6-4c3d-9426-90716d5689d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-321fdb36-c758-4370-9423-9bb6ad20865a', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-254b7565-9345-4b0a-ba4b-06e1f7e23ec0 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9b185be-40d3-49d3-b847-b4cc972ef3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:19 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-75161620-83d4-4b89-8399-9d005e1cc6b6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Creating offline snapshot ab63b105-b871-40fb-b916-a851b485f3bc of volume 59701368-9b63-4bf7-9773-da738bfe2c99 {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:37:19 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-254b7565-9345-4b0a-ba4b-06e1f7e23ec0 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Volume volume-321fdb36-c758-4370-9423-9bb6ad20865a (321fdb36-c758-4370-9423-9bb6ad20865a): created successfully Jun 02 03:37:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-254b7565-9345-4b0a-ba4b-06e1f7e23ec0 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9b185be-40d3-49d3-b847-b4cc972ef3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:19 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-254b7565-9345-4b0a-ba4b-06e1f7e23ec0 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Flow 'volume_create_manager' (d4e949d0-788d-44f6-b72a-92eeb3533ece) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:19 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[beae5750-63a0-4695-a8e3-9fb2a5312d75]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-75161620-83d4-4b89-8399-9d005e1cc6b6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:19 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-254b7565-9345-4b0a-ba4b-06e1f7e23ec0 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Created volume successfully. Jun 02 03:37:19 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99 Jun 02 03:37:19 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:19 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-efc3b518-86f1-4773-bb61-c24379c965a1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Acquiring lock "cinder-321fdb36-c758-4370-9423-9bb6ad20865a-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:19 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-efc3b518-86f1-4773-bb61-c24379c965a1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "cinder-321fdb36-c758-4370-9423-9bb6ad20865a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:19 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5dbe0c80-3a00-4eed-ab57-380891491aa1 tempest-CreateVolumesFromImageTest-999091618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e50f1520-d636-472d-ac7c-0d99fdfb15b0" returned: 0 in 0.737s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5dbe0c80-3a00-4eed-ab57-380891491aa1 tempest-CreateVolumesFromImageTest-999091618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e50f1520-d636-472d-ac7c-0d99fdfb15b0 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:19 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-efc3b518-86f1-4773-bb61-c24379c965a1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Acquiring lock "cinder-quobyte-321fdb36-c758-4370-9423-9bb6ad20865a" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:19 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e50f1520-d636-472d-ac7c-0d99fdfb15b0 Jun 02 03:37:19 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:19 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-efc3b518-86f1-4773-bb61-c24379c965a1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "cinder-quobyte-321fdb36-c758-4370-9423-9bb6ad20865a" acquired by "delete_volume" :: waited 0.015s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:19 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc0870c-1c75-4db8-8c99-9a3078cb6a85]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-efc3b518-86f1-4773-bb61-c24379c965a1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-321fdb36-c758-4370-9423-9bb6ad20865a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:19 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-321fdb36-c758-4370-9423-9bb6ad20865a Jun 02 03:37:19 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:20 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-75161620-83d4-4b89-8399-9d005e1cc6b6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99" returned: 0 in 0.796s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-75161620-83d4-4b89-8399-9d005e1cc6b6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99.ab63b105-b871-40fb-b916-a851b485f3bc 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:20 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99.ab63b105-b871-40fb-b916-a851b485f3bc 1G Jun 02 03:37:20 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:20 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5dbe0c80-3a00-4eed-ab57-380891491aa1 tempest-CreateVolumesFromImageTest-999091618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e50f1520-d636-472d-ac7c-0d99fdfb15b0" returned: 0 in 0.648s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:20 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5dbe0c80-3a00-4eed-ab57-380891491aa1 tempest-CreateVolumesFromImageTest-999091618 None] Lock "cinder-quobyte-e50f1520-d636-472d-ac7c-0d99fdfb15b0" released by "delete_volume" :: held 1.428s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:20 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-5dbe0c80-3a00-4eed-ab57-380891491aa1 tempest-CreateVolumesFromImageTest-999091618 None] Created reservations ['918d05c4-7219-4336-b59e-80b3e2bfec73', '792ddbbc-ee4b-4255-844f-7133e056bd33', '8b026711-981c-4a77-9554-8a691c163b95', '794cf41f-e769-4ca4-8d4d-a24303fefc5d'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:37:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5dbe0c80-3a00-4eed-ab57-380891491aa1 tempest-CreateVolumesFromImageTest-999091618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5dbe0c80-3a00-4eed-ab57-380891491aa1 tempest-CreateVolumesFromImageTest-999091618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-5dbe0c80-3a00-4eed-ab57-380891491aa1 tempest-CreateVolumesFromImageTest-999091618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:20 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-5dbe0c80-3a00-4eed-ab57-380891491aa1 tempest-CreateVolumesFromImageTest-999091618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5dbe0c80-3a00-4eed-ab57-380891491aa1 tempest-CreateVolumesFromImageTest-999091618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5dbe0c80-3a00-4eed-ab57-380891491aa1 tempest-CreateVolumesFromImageTest-999091618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-efc3b518-86f1-4773-bb61-c24379c965a1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-321fdb36-c758-4370-9423-9bb6ad20865a" returned: 0 in 0.741s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-efc3b518-86f1-4773-bb61-c24379c965a1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-321fdb36-c758-4370-9423-9bb6ad20865a {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:20 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:37:20 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:20 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-321fdb36-c758-4370-9423-9bb6ad20865a Jun 02 03:37:20 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:20 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-75161620-83d4-4b89-8399-9d005e1cc6b6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99.ab63b105-b871-40fb-b916-a851b485f3bc 1G" returned: 0 in 0.781s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-75161620-83d4-4b89-8399-9d005e1cc6b6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59701368-9b63-4bf7-9773-da738bfe2c99 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99.ab63b105-b871-40fb-b916-a851b485f3bc {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:20 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59701368-9b63-4bf7-9773-da738bfe2c99 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99.ab63b105-b871-40fb-b916-a851b485f3bc Jun 02 03:37:20 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:21 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:21 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-fa8e239d-2153-4cb0-8a33-2181baf8aa49 tempest-CreateVolumesFromImageTest-999091618 None] Acquiring lock "cinder-37634a57-bb0f-4cf4-9329-1dae5fbfb7a6-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5dbe0c80-3a00-4eed-ab57-380891491aa1 tempest-CreateVolumesFromImageTest-999091618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.626s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:21 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-5dbe0c80-3a00-4eed-ab57-380891491aa1 tempest-CreateVolumesFromImageTest-999091618 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:37:21 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-5dbe0c80-3a00-4eed-ab57-380891491aa1 tempest-CreateVolumesFromImageTest-999091618 None] Deleted volume successfully. Jun 02 03:37:21 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-fa8e239d-2153-4cb0-8a33-2181baf8aa49 tempest-CreateVolumesFromImageTest-999091618 None] Lock "cinder-37634a57-bb0f-4cf4-9329-1dae5fbfb7a6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:21 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-efc3b518-86f1-4773-bb61-c24379c965a1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-321fdb36-c758-4370-9423-9bb6ad20865a" returned: 0 in 0.658s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:21 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5dbe0c80-3a00-4eed-ab57-380891491aa1 tempest-CreateVolumesFromImageTest-999091618 None] Lock "cinder-e50f1520-d636-472d-ac7c-0d99fdfb15b0-delete_volume" released by "delete_volume" :: held 2.299s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:21 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-efc3b518-86f1-4773-bb61-c24379c965a1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "cinder-quobyte-321fdb36-c758-4370-9423-9bb6ad20865a" released by "delete_volume" :: held 1.457s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:21 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-fa8e239d-2153-4cb0-8a33-2181baf8aa49 tempest-CreateVolumesFromImageTest-999091618 None] Acquiring lock "cinder-quobyte-37634a57-bb0f-4cf4-9329-1dae5fbfb7a6" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:21 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-fa8e239d-2153-4cb0-8a33-2181baf8aa49 tempest-CreateVolumesFromImageTest-999091618 None] Lock "cinder-quobyte-37634a57-bb0f-4cf4-9329-1dae5fbfb7a6" acquired by "delete_volume" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:21 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a53989-4148-412b-a2b6-7472390619ef]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fa8e239d-2153-4cb0-8a33-2181baf8aa49 tempest-CreateVolumesFromImageTest-999091618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-37634a57-bb0f-4cf4-9329-1dae5fbfb7a6 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:21 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-efc3b518-86f1-4773-bb61-c24379c965a1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Created reservations ['9582518e-0eb3-409f-a62e-8e3616dd619a', 'edf5fe9c-2f33-4cf2-a0eb-aa3eaaf57a0e', 'c666ce76-0a99-488e-a41b-e8fcdef47bfa', 'c8d6616c-7391-4655-9a3b-5c344f67bf1a'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:37:21 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-37634a57-bb0f-4cf4-9329-1dae5fbfb7a6 Jun 02 03:37:21 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-efc3b518-86f1-4773-bb61-c24379c965a1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-efc3b518-86f1-4773-bb61-c24379c965a1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:21 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-efc3b518-86f1-4773-bb61-c24379c965a1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:21 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-efc3b518-86f1-4773-bb61-c24379c965a1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-efc3b518-86f1-4773-bb61-c24379c965a1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-efc3b518-86f1-4773-bb61-c24379c965a1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:21 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:37:21 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:21 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-75161620-83d4-4b89-8399-9d005e1cc6b6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59701368-9b63-4bf7-9773-da738bfe2c99 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99.ab63b105-b871-40fb-b916-a851b485f3bc" returned: 0 in 0.687s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:21 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-75161620-83d4-4b89-8399-9d005e1cc6b6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99.ab63b105-b871-40fb-b916-a851b485f3bc is being set with open permissions: ugo+rw Jun 02 03:37:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-75161620-83d4-4b89-8399-9d005e1cc6b6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99.ab63b105-b871-40fb-b916-a851b485f3bc {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:21 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99.ab63b105-b871-40fb-b916-a851b485f3bc Jun 02 03:37:21 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:21 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6d5197ca-9b34-40c8-b138-2d45bc7a737e tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Acquiring lock "cinder-42f0d0ec-a385-4967-8e70-0e8846a95b6d-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:21 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6d5197ca-9b34-40c8-b138-2d45bc7a737e tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "cinder-42f0d0ec-a385-4967-8e70-0e8846a95b6d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:21 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6d5197ca-9b34-40c8-b138-2d45bc7a737e tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Acquiring lock "cinder-quobyte-42f0d0ec-a385-4967-8e70-0e8846a95b6d" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:21 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-efc3b518-86f1-4773-bb61-c24379c965a1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.631s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:21 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-efc3b518-86f1-4773-bb61-c24379c965a1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:37:21 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6d5197ca-9b34-40c8-b138-2d45bc7a737e tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "cinder-quobyte-42f0d0ec-a385-4967-8e70-0e8846a95b6d" acquired by "delete_volume" :: waited 0.024s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:21 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-efc3b518-86f1-4773-bb61-c24379c965a1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Deleted volume successfully. Jun 02 03:37:21 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ea2165-8123-4b53-890c-168ebb4dc7a5]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:21 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d5197ca-9b34-40c8-b138-2d45bc7a737e tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-42f0d0ec-a385-4967-8e70-0e8846a95b6d {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:21 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-efc3b518-86f1-4773-bb61-c24379c965a1 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "cinder-321fdb36-c758-4370-9423-9bb6ad20865a-delete_volume" released by "delete_volume" :: held 2.431s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:22 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fa8e239d-2153-4cb0-8a33-2181baf8aa49 tempest-CreateVolumesFromImageTest-999091618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-37634a57-bb0f-4cf4-9329-1dae5fbfb7a6" returned: 0 in 0.852s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fa8e239d-2153-4cb0-8a33-2181baf8aa49 tempest-CreateVolumesFromImageTest-999091618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-37634a57-bb0f-4cf4-9329-1dae5fbfb7a6 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:22 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-37634a57-bb0f-4cf4-9329-1dae5fbfb7a6 Jun 02 03:37:22 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:22 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-42f0d0ec-a385-4967-8e70-0e8846a95b6d Jun 02 03:37:22 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:22 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-75161620-83d4-4b89-8399-9d005e1cc6b6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99.ab63b105-b871-40fb-b916-a851b485f3bc" returned: 0 in 0.631s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-75161620-83d4-4b89-8399-9d005e1cc6b6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:22 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99.info Jun 02 03:37:22 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:22 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fa8e239d-2153-4cb0-8a33-2181baf8aa49 tempest-CreateVolumesFromImageTest-999091618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-37634a57-bb0f-4cf4-9329-1dae5fbfb7a6" returned: 0 in 0.601s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:22 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-fa8e239d-2153-4cb0-8a33-2181baf8aa49 tempest-CreateVolumesFromImageTest-999091618 None] Lock "cinder-quobyte-37634a57-bb0f-4cf4-9329-1dae5fbfb7a6" released by "delete_volume" :: held 1.497s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:22 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-fa8e239d-2153-4cb0-8a33-2181baf8aa49 tempest-CreateVolumesFromImageTest-999091618 None] Created reservations ['0e22c381-5ad9-46df-a1f9-565542ff4989', 'd5b37e9f-b310-48d8-a17c-af801d5ec269', '90451332-3358-411a-9e0c-58472e6a34aa', '5abad8d9-5cfd-4cd8-b0bc-b0b0e89805a9'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:37:22 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fa8e239d-2153-4cb0-8a33-2181baf8aa49 tempest-CreateVolumesFromImageTest-999091618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fa8e239d-2153-4cb0-8a33-2181baf8aa49 tempest-CreateVolumesFromImageTest-999091618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:22 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-fa8e239d-2153-4cb0-8a33-2181baf8aa49 tempest-CreateVolumesFromImageTest-999091618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:22 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-fa8e239d-2153-4cb0-8a33-2181baf8aa49 tempest-CreateVolumesFromImageTest-999091618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-fa8e239d-2153-4cb0-8a33-2181baf8aa49 tempest-CreateVolumesFromImageTest-999091618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fa8e239d-2153-4cb0-8a33-2181baf8aa49 tempest-CreateVolumesFromImageTest-999091618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d5197ca-9b34-40c8-b138-2d45bc7a737e tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-42f0d0ec-a385-4967-8e70-0e8846a95b6d" returned: 0 in 0.773s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d5197ca-9b34-40c8-b138-2d45bc7a737e tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-42f0d0ec-a385-4967-8e70-0e8846a95b6d {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:22 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:37:22 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:22 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-42f0d0ec-a385-4967-8e70-0e8846a95b6d Jun 02 03:37:22 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:22 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-75161620-83d4-4b89-8399-9d005e1cc6b6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99.info" returned: 0 in 0.627s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:22 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-75161620-83d4-4b89-8399-9d005e1cc6b6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99.info is being set with open permissions: ugo+rw Jun 02 03:37:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-75161620-83d4-4b89-8399-9d005e1cc6b6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:22 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99.info Jun 02 03:37:22 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:23 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d5197ca-9b34-40c8-b138-2d45bc7a737e tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-42f0d0ec-a385-4967-8e70-0e8846a95b6d" returned: 0 in 0.613s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:23 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6d5197ca-9b34-40c8-b138-2d45bc7a737e tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "cinder-quobyte-42f0d0ec-a385-4967-8e70-0e8846a95b6d" released by "delete_volume" :: held 1.447s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:23 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-fa8e239d-2153-4cb0-8a33-2181baf8aa49 tempest-CreateVolumesFromImageTest-999091618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.659s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:23 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-fa8e239d-2153-4cb0-8a33-2181baf8aa49 tempest-CreateVolumesFromImageTest-999091618 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:37:23 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-fa8e239d-2153-4cb0-8a33-2181baf8aa49 tempest-CreateVolumesFromImageTest-999091618 None] Deleted volume successfully. Jun 02 03:37:23 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-6d5197ca-9b34-40c8-b138-2d45bc7a737e tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Created reservations ['d240e48e-7209-4c59-a70d-d9ac3f31f5e9', '77206c50-191f-4c4b-a154-b0a352c4671b', '77f61c0e-12db-4c43-be45-b9ebc09752fe', 'ade59230-c41a-4cdf-907b-eedc11bd8d01'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:37:23 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-fa8e239d-2153-4cb0-8a33-2181baf8aa49 tempest-CreateVolumesFromImageTest-999091618 None] Lock "cinder-37634a57-bb0f-4cf4-9329-1dae5fbfb7a6-delete_volume" released by "delete_volume" :: held 2.429s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:23 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-75161620-83d4-4b89-8399-9d005e1cc6b6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99.info" returned: 0 in 0.699s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-75161620-83d4-4b89-8399-9d005e1cc6b6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.350s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.499s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:23 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=961c3a51-e205-4b33-919e-69ca661bb445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bc04170f6f64b72ab18bc11c9d98cfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:04Z,use_quota=True,user_id='4e03ea16cce04a47b034213af6d628bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f18b06c-b6ec-43ad-9c98-8cba78ee029b),volume_type_id=8f18b06c-b6ec-43ad-9c98-8cba78ee029b)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:37:23 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Creating volume 961c3a51-e205-4b33-919e-69ca661bb445 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:37:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:23 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:23 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:23 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:37:23 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:37:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-961c3a51-e205-4b33-919e-69ca661bb445 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:23 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-961c3a51-e205-4b33-919e-69ca661bb445 1073741824 Jun 02 03:37:23 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:23 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-75161620-83d4-4b89-8399-9d005e1cc6b6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Create snapshot completed successfully Jun 02 03:37:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6d5197ca-9b34-40c8-b138-2d45bc7a737e tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6d5197ca-9b34-40c8-b138-2d45bc7a737e tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:23 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6d5197ca-9b34-40c8-b138-2d45bc7a737e tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:23 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6d5197ca-9b34-40c8-b138-2d45bc7a737e tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6d5197ca-9b34-40c8-b138-2d45bc7a737e tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:23 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d5197ca-9b34-40c8-b138-2d45bc7a737e tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:23 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:37:23 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:24 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5ad24aed-ba2b-402d-9bad-2d3f7087f879 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Acquiring lock "cinder-2d0670d5-3922-4479-b27a-ff452673bb91-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:24 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5ad24aed-ba2b-402d-9bad-2d3f7087f879 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "cinder-2d0670d5-3922-4479-b27a-ff452673bb91-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:24 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5ad24aed-ba2b-402d-9bad-2d3f7087f879 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Acquiring lock "cinder-quobyte-2d0670d5-3922-4479-b27a-ff452673bb91" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:24 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5ad24aed-ba2b-402d-9bad-2d3f7087f879 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "cinder-quobyte-2d0670d5-3922-4479-b27a-ff452673bb91" acquired by "delete_volume" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:24 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d34f7a-6dbe-4d7c-83bb-d9eb06194fec]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5ad24aed-ba2b-402d-9bad-2d3f7087f879 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2d0670d5-3922-4479-b27a-ff452673bb91 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:24 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6d5197ca-9b34-40c8-b138-2d45bc7a737e tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.731s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:24 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-6d5197ca-9b34-40c8-b138-2d45bc7a737e tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:37:24 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-6d5197ca-9b34-40c8-b138-2d45bc7a737e tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Deleted volume successfully. Jun 02 03:37:24 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6d5197ca-9b34-40c8-b138-2d45bc7a737e tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "cinder-42f0d0ec-a385-4967-8e70-0e8846a95b6d-delete_volume" released by "delete_volume" :: held 2.519s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:24 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2d0670d5-3922-4479-b27a-ff452673bb91 Jun 02 03:37:24 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:24 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-961c3a51-e205-4b33-919e-69ca661bb445 1073741824" returned: 0 in 1.027s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:24 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-961c3a51-e205-4b33-919e-69ca661bb445 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:24 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-961c3a51-e205-4b33-919e-69ca661bb445 Jun 02 03:37:24 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:24 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e51babf-be0b-48eb-9422-19192e1a4028 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:37:24 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2e51babf-be0b-48eb-9422-19192e1a4028 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Flow 'volume_create_manager' (aaa98ae6-6d19-4684-ba18-f13f20956033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:24 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2e51babf-be0b-48eb-9422-19192e1a4028 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5d4230-363d-4262-80f2-b136745b3d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2e51babf-be0b-48eb-9422-19192e1a4028 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5d4230-363d-4262-80f2-b136745b3d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1614390727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe187678-f5c1-4757-a361-c54271e513e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43e3700b8ce94de2bdf9794af8e25e16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:25Z,use_quota=True,user_id='d58b0898f78c4e8ebefbfa32260e6f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2e51babf-be0b-48eb-9422-19192e1a4028 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9b2a02-ffb2-42dc-8525-4773a567bbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2e51babf-be0b-48eb-9422-19192e1a4028 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9b2a02-ffb2-42dc-8525-4773a567bbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2e51babf-be0b-48eb-9422-19192e1a4028 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ccdea76-c557-4f01-95b4-7a7998ad10ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2e51babf-be0b-48eb-9422-19192e1a4028 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ccdea76-c557-4f01-95b4-7a7998ad10ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe187678-f5c1-4757-a361-c54271e513e1', 'volume_name': 'volume-fe187678-f5c1-4757-a361-c54271e513e1', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2e51babf-be0b-48eb-9422-19192e1a4028 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4775cc0a-6370-4db2-aff9-d555f4c6b547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2e51babf-be0b-48eb-9422-19192e1a4028 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4775cc0a-6370-4db2-aff9-d555f4c6b547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2e51babf-be0b-48eb-9422-19192e1a4028 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b16a61-0d19-45a6-b675-94b44a28b1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:25 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-2e51babf-be0b-48eb-9422-19192e1a4028 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Volume fe187678-f5c1-4757-a361-c54271e513e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe187678-f5c1-4757-a361-c54271e513e1', 'volume_size': 1} Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2e51babf-be0b-48eb-9422-19192e1a4028 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:25 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5ad24aed-ba2b-402d-9bad-2d3f7087f879 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2d0670d5-3922-4479-b27a-ff452673bb91" returned: 0 in 1.015s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5ad24aed-ba2b-402d-9bad-2d3f7087f879 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2d0670d5-3922-4479-b27a-ff452673bb91 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:25 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2d0670d5-3922-4479-b27a-ff452673bb91 Jun 02 03:37:25 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b76af4d-c587-4501-8346-ed62ad6f56d8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4b76af4d-c587-4501-8346-ed62ad6f56d8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Flow 'volume_create_manager' (e85a672e-52e3-4e11-983b-f41f74620c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4b76af4d-c587-4501-8346-ed62ad6f56d8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb57572-4908-4cc4-9f53-583ef77429b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:25 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-961c3a51-e205-4b33-919e-69ca661bb445" returned: 0 in 0.894s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] <== create_volume: return (2030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.033s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2e51babf-be0b-48eb-9422-19192e1a4028 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.493s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-2e51babf-be0b-48eb-9422-19192e1a4028 tempest-CreateVolumesFromSnapshotTest-1597407613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1614390727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe187678-f5c1-4757-a361-c54271e513e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43e3700b8ce94de2bdf9794af8e25e16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:25Z,use_quota=True,user_id='d58b0898f78c4e8ebefbfa32260e6f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-2e51babf-be0b-48eb-9422-19192e1a4028 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Creating volume fe187678-f5c1-4757-a361-c54271e513e1 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2e51babf-be0b-48eb-9422-19192e1a4028 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2e51babf-be0b-48eb-9422-19192e1a4028 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-2e51babf-be0b-48eb-9422-19192e1a4028 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-2e51babf-be0b-48eb-9422-19192e1a4028 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2e51babf-be0b-48eb-9422-19192e1a4028 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-2e51babf-be0b-48eb-9422-19192e1a4028 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:37:25 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-2e51babf-be0b-48eb-9422-19192e1a4028 tempest-CreateVolumesFromSnapshotTest-1597407613 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2e51babf-be0b-48eb-9422-19192e1a4028 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fe187678-f5c1-4757-a361-c54271e513e1 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4b76af4d-c587-4501-8346-ed62ad6f56d8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb57572-4908-4cc4-9f53-583ef77429b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1912999082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9df0decc-e847-4e4f-8c17-93da8ac15baa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43e3700b8ce94de2bdf9794af8e25e16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:25Z,use_quota=True,user_id='d58b0898f78c4e8ebefbfa32260e6f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:25 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fe187678-f5c1-4757-a361-c54271e513e1 1073741824 Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4b76af4d-c587-4501-8346-ed62ad6f56d8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e3a9db7-10ae-4490-8a5e-341254c7a372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:25 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4b76af4d-c587-4501-8346-ed62ad6f56d8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e3a9db7-10ae-4490-8a5e-341254c7a372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4b76af4d-c587-4501-8346-ed62ad6f56d8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16764815-f9d5-489c-86d1-f7230df5ad78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4b76af4d-c587-4501-8346-ed62ad6f56d8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16764815-f9d5-489c-86d1-f7230df5ad78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9df0decc-e847-4e4f-8c17-93da8ac15baa', 'volume_name': 'volume-9df0decc-e847-4e4f-8c17-93da8ac15baa', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4b76af4d-c587-4501-8346-ed62ad6f56d8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (586eac5d-880a-4e86-aa67-73900ef8227f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4b76af4d-c587-4501-8346-ed62ad6f56d8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (586eac5d-880a-4e86-aa67-73900ef8227f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4b76af4d-c587-4501-8346-ed62ad6f56d8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (983d8068-97e9-40d0-b914-451b1075a432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:25 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-4b76af4d-c587-4501-8346-ed62ad6f56d8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Volume 9df0decc-e847-4e4f-8c17-93da8ac15baa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9df0decc-e847-4e4f-8c17-93da8ac15baa', 'volume_size': 1} Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4b76af4d-c587-4501-8346-ed62ad6f56d8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG cinder.volume.volume_utils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Attempting download of 5afb6044-0bab-4144-a061-659cb6d60cc9 ((None, [{'url': 'file:///opt/stack/data/glance/images/5afb6044-0bab-4144-a061-659cb6d60cc9', 'metadata': {}}])) to volume 961c3a51-e205-4b33-919e-69ca661bb445. {{(pid=86431) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[520e0c32-22a0-4906-84dd-f270ba371fe7]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5afb6044-0bab-4144-a061-659cb6d60cc9_7rp86guq {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:25 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5afb6044-0bab-4144-a061-659cb6d60cc9_7rp86guq Jun 02 03:37:25 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-85d33f65-ddc0-43eb-8ced-909d021dfc46 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:37:26 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-85d33f65-ddc0-43eb-8ced-909d021dfc46 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Flow 'volume_create_manager' (b84b069e-a8a8-4b0e-8c01-e3baa62558e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-85d33f65-ddc0-43eb-8ced-909d021dfc46 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78589f4f-a0a8-498d-899d-63ed83403a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5ad24aed-ba2b-402d-9bad-2d3f7087f879 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-2d0670d5-3922-4479-b27a-ff452673bb91" returned: 0 in 0.951s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-85d33f65-ddc0-43eb-8ced-909d021dfc46 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78589f4f-a0a8-498d-899d-63ed83403a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-449196482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1efa245-b905-4122-a1c4-6b9efd668314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43e3700b8ce94de2bdf9794af8e25e16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:26Z,use_quota=True,user_id='d58b0898f78c4e8ebefbfa32260e6f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-85d33f65-ddc0-43eb-8ced-909d021dfc46 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80f67bae-831c-4bf9-8921-382de24fff1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-85d33f65-ddc0-43eb-8ced-909d021dfc46 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80f67bae-831c-4bf9-8921-382de24fff1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-85d33f65-ddc0-43eb-8ced-909d021dfc46 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c71385-e091-4398-b8bc-386ed9bc04f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-85d33f65-ddc0-43eb-8ced-909d021dfc46 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c71385-e091-4398-b8bc-386ed9bc04f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1efa245-b905-4122-a1c4-6b9efd668314', 'volume_name': 'volume-e1efa245-b905-4122-a1c4-6b9efd668314', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-85d33f65-ddc0-43eb-8ced-909d021dfc46 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd6167c8-2a08-458a-b095-39ec4fa444a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-85d33f65-ddc0-43eb-8ced-909d021dfc46 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd6167c8-2a08-458a-b095-39ec4fa444a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-85d33f65-ddc0-43eb-8ced-909d021dfc46 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59195c16-53e0-4965-9771-d6f8b647533a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:26 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-85d33f65-ddc0-43eb-8ced-909d021dfc46 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Volume e1efa245-b905-4122-a1c4-6b9efd668314: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1efa245-b905-4122-a1c4-6b9efd668314', 'volume_size': 1} Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-85d33f65-ddc0-43eb-8ced-909d021dfc46 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5ad24aed-ba2b-402d-9bad-2d3f7087f879 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "cinder-quobyte-2d0670d5-3922-4479-b27a-ff452673bb91" released by "delete_volume" :: held 2.081s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-5ad24aed-ba2b-402d-9bad-2d3f7087f879 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Created reservations ['b53cdeca-f196-4d45-98c2-9fe14b21e6ee', 'c229f8c2-9e76-4949-a1bc-71a3dd14945d', '1dc5baf9-6afa-4b1d-95a9-da05fad617bd', 'baa079f7-70e8-444f-934b-f8a50bf3e890'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5ad24aed-ba2b-402d-9bad-2d3f7087f879 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5ad24aed-ba2b-402d-9bad-2d3f7087f879 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-5ad24aed-ba2b-402d-9bad-2d3f7087f879 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-5ad24aed-ba2b-402d-9bad-2d3f7087f879 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-5ad24aed-ba2b-402d-9bad-2d3f7087f879 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5ad24aed-ba2b-402d-9bad-2d3f7087f879 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:26 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:37:26 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-0250c3ed-8bbc-4bea-8380-6160d7a4b319 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0250c3ed-8bbc-4bea-8380-6160d7a4b319 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Flow 'volume_create_manager' (a81a7585-0e45-4c78-85d4-9178e5f4d164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0250c3ed-8bbc-4bea-8380-6160d7a4b319 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93a6063b-fe12-4c0e-84ed-c776596b8d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0250c3ed-8bbc-4bea-8380-6160d7a4b319 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93a6063b-fe12-4c0e-84ed-c776596b8d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-840505458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed9607be-4d96-48fb-8ee3-c1d50055c465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43e3700b8ce94de2bdf9794af8e25e16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:27Z,use_quota=True,user_id='d58b0898f78c4e8ebefbfa32260e6f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0250c3ed-8bbc-4bea-8380-6160d7a4b319 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc449a2b-f434-4015-af67-3617b2a559d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0250c3ed-8bbc-4bea-8380-6160d7a4b319 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc449a2b-f434-4015-af67-3617b2a559d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0250c3ed-8bbc-4bea-8380-6160d7a4b319 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f6eb225-60f0-4eb1-8837-cc34b3fa1112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0250c3ed-8bbc-4bea-8380-6160d7a4b319 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f6eb225-60f0-4eb1-8837-cc34b3fa1112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed9607be-4d96-48fb-8ee3-c1d50055c465', 'volume_name': 'volume-ed9607be-4d96-48fb-8ee3-c1d50055c465', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0250c3ed-8bbc-4bea-8380-6160d7a4b319 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b321df-68a9-4a97-8001-4d682741ce9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0250c3ed-8bbc-4bea-8380-6160d7a4b319 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b321df-68a9-4a97-8001-4d682741ce9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0250c3ed-8bbc-4bea-8380-6160d7a4b319 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75b915a5-2cec-49e9-892a-b4757960119b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:26 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-0250c3ed-8bbc-4bea-8380-6160d7a4b319 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Volume ed9607be-4d96-48fb-8ee3-c1d50055c465: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed9607be-4d96-48fb-8ee3-c1d50055c465', 'volume_size': 1} Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0250c3ed-8bbc-4bea-8380-6160d7a4b319 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:26 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2e51babf-be0b-48eb-9422-19192e1a4028 tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fe187678-f5c1-4757-a361-c54271e513e1 1073741824" returned: 0 in 1.289s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2e51babf-be0b-48eb-9422-19192e1a4028 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fe187678-f5c1-4757-a361-c54271e513e1 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:26 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5afb6044-0bab-4144-a061-659cb6d60cc9_7rp86guq" returned: 0 in 1.164s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5afb6044-0bab-4144-a061-659cb6d60cc9_7rp86guq {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:26 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fe187678-f5c1-4757-a361-c54271e513e1 Jun 02 03:37:26 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-18278b6b-03e7-4954-b0fb-6790af3d9143 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Acquiring lock "cinder-f618ba80-dd09-44f4-bb78-9a6ee6712933-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-18278b6b-03e7-4954-b0fb-6790af3d9143 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "cinder-f618ba80-dd09-44f4-bb78-9a6ee6712933-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:27 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5afb6044-0bab-4144-a061-659cb6d60cc9_7rp86guq Jun 02 03:37:27 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-18278b6b-03e7-4954-b0fb-6790af3d9143 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Acquiring lock "cinder-quobyte-f618ba80-dd09-44f4-bb78-9a6ee6712933" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-18278b6b-03e7-4954-b0fb-6790af3d9143 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "cinder-quobyte-f618ba80-dd09-44f4-bb78-9a6ee6712933" acquired by "delete_volume" :: waited 0.022s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f933ef-2aef-40d6-8f86-aa735c0eb003]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-18278b6b-03e7-4954-b0fb-6790af3d9143 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f618ba80-dd09-44f4-bb78-9a6ee6712933 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-85f1424c-742c-418d-ace9-b16626fdc89c tempest-VolumeDependencyTests-1086620720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-85f1424c-742c-418d-ace9-b16626fdc89c tempest-VolumeDependencyTests-1086620720 None] Flow 'volume_create_manager' (6cc73f39-ccd6-4a8e-8261-7c4843e844b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-85f1424c-742c-418d-ace9-b16626fdc89c tempest-VolumeDependencyTests-1086620720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13361828-2053-4496-b157-55db77288103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-71c69c3d-b389-48f3-89cf-676fd46248f6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-71c69c3d-b389-48f3-89cf-676fd46248f6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Flow 'volume_create_manager' (ed3da19a-a481-4c21-9210-f3d603b6792c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-71c69c3d-b389-48f3-89cf-676fd46248f6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4daf385-417e-4a9d-b234-4fb25e54263c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-71c69c3d-b389-48f3-89cf-676fd46248f6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4daf385-417e-4a9d-b234-4fb25e54263c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-253306154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ddbd417-3cdc-4f44-9886-683035ad1464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43e3700b8ce94de2bdf9794af8e25e16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:27Z,use_quota=True,user_id='d58b0898f78c4e8ebefbfa32260e6f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-71c69c3d-b389-48f3-89cf-676fd46248f6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b68e7498-4cb8-4646-b54f-fb5f7c8cc012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-71c69c3d-b389-48f3-89cf-676fd46248f6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b68e7498-4cb8-4646-b54f-fb5f7c8cc012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-71c69c3d-b389-48f3-89cf-676fd46248f6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9897b309-1792-4780-884e-ded164afc831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:27 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f618ba80-dd09-44f4-bb78-9a6ee6712933 Jun 02 03:37:27 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-71c69c3d-b389-48f3-89cf-676fd46248f6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9897b309-1792-4780-884e-ded164afc831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ddbd417-3cdc-4f44-9886-683035ad1464', 'volume_name': 'volume-1ddbd417-3cdc-4f44-9886-683035ad1464', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-71c69c3d-b389-48f3-89cf-676fd46248f6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5729e2a4-9bae-4f68-9c43-9e72543a5ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-71c69c3d-b389-48f3-89cf-676fd46248f6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5729e2a4-9bae-4f68-9c43-9e72543a5ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:27 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-71c69c3d-b389-48f3-89cf-676fd46248f6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f524dbec-cedd-48f4-aca0-4da72441efb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:27 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-71c69c3d-b389-48f3-89cf-676fd46248f6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Volume 1ddbd417-3cdc-4f44-9886-683035ad1464: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ddbd417-3cdc-4f44-9886-683035ad1464', 'volume_size': 1} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-71c69c3d-b389-48f3-89cf-676fd46248f6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-5ad24aed-ba2b-402d-9bad-2d3f7087f879 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 1.085s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-85f1424c-742c-418d-ace9-b16626fdc89c tempest-VolumeDependencyTests-1086620720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13361828-2053-4496-b157-55db77288103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-326934583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6429ffa8-3507-48e9-95dd-84238c785b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b823a1b60584e608ccb1a6ca536f52c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:27Z,use_quota=True,user_id='5b724b7c9a19488cba365cbcb18af258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-85f1424c-742c-418d-ace9-b16626fdc89c tempest-VolumeDependencyTests-1086620720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c36fd6fd-fa29-48e1-8b29-7fdfb844392a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-85f1424c-742c-418d-ace9-b16626fdc89c tempest-VolumeDependencyTests-1086620720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c36fd6fd-fa29-48e1-8b29-7fdfb844392a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-85f1424c-742c-418d-ace9-b16626fdc89c tempest-VolumeDependencyTests-1086620720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0afbaff-747a-4332-8f3e-ebe85354239b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-85f1424c-742c-418d-ace9-b16626fdc89c tempest-VolumeDependencyTests-1086620720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0afbaff-747a-4332-8f3e-ebe85354239b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6429ffa8-3507-48e9-95dd-84238c785b3b', 'volume_name': 'volume-6429ffa8-3507-48e9-95dd-84238c785b3b', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-85f1424c-742c-418d-ace9-b16626fdc89c tempest-VolumeDependencyTests-1086620720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3266736-7caa-4e3c-ac40-efcbb0e2b52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-85f1424c-742c-418d-ace9-b16626fdc89c tempest-VolumeDependencyTests-1086620720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3266736-7caa-4e3c-ac40-efcbb0e2b52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-85f1424c-742c-418d-ace9-b16626fdc89c tempest-VolumeDependencyTests-1086620720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2e912a-34b9-41e3-bb00-720ad20c0a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:27 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-85f1424c-742c-418d-ace9-b16626fdc89c tempest-VolumeDependencyTests-1086620720 None] Volume 6429ffa8-3507-48e9-95dd-84238c785b3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6429ffa8-3507-48e9-95dd-84238c785b3b', 'volume_size': 1} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-85f1424c-742c-418d-ace9-b16626fdc89c tempest-VolumeDependencyTests-1086620720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-5ad24aed-ba2b-402d-9bad-2d3f7087f879 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:37:27 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-5ad24aed-ba2b-402d-9bad-2d3f7087f879 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Deleted volume successfully. Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-5ad24aed-ba2b-402d-9bad-2d3f7087f879 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "cinder-2d0670d5-3922-4479-b27a-ff452673bb91-delete_volume" released by "delete_volume" :: held 3.480s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:27 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-2e51babf-be0b-48eb-9422-19192e1a4028 tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fe187678-f5c1-4757-a361-c54271e513e1" returned: 0 in 0.755s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-2e51babf-be0b-48eb-9422-19192e1a4028 tempest-CreateVolumesFromSnapshotTest-1597407613 None] <== create_volume: return (2100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-2e51babf-be0b-48eb-9422-19192e1a4028 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.105s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4b76af4d-c587-4501-8346-ed62ad6f56d8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-4b76af4d-c587-4501-8346-ed62ad6f56d8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1912999082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9df0decc-e847-4e4f-8c17-93da8ac15baa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43e3700b8ce94de2bdf9794af8e25e16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:25Z,use_quota=True,user_id='d58b0898f78c4e8ebefbfa32260e6f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-4b76af4d-c587-4501-8346-ed62ad6f56d8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Creating volume 9df0decc-e847-4e4f-8c17-93da8ac15baa {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4b76af4d-c587-4501-8346-ed62ad6f56d8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4b76af4d-c587-4501-8346-ed62ad6f56d8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-4b76af4d-c587-4501-8346-ed62ad6f56d8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-4b76af4d-c587-4501-8346-ed62ad6f56d8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4b76af4d-c587-4501-8346-ed62ad6f56d8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-4b76af4d-c587-4501-8346-ed62ad6f56d8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:37:27 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-4b76af4d-c587-4501-8346-ed62ad6f56d8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4b76af4d-c587-4501-8346-ed62ad6f56d8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9df0decc-e847-4e4f-8c17-93da8ac15baa 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2e51babf-be0b-48eb-9422-19192e1a4028 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b16a61-0d19-45a6-b675-94b44a28b1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe187678-f5c1-4757-a361-c54271e513e1', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:27 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9df0decc-e847-4e4f-8c17-93da8ac15baa 1073741824 Jun 02 03:37:27 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2e51babf-be0b-48eb-9422-19192e1a4028 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c555008-f6fc-4d46-b8d5-c24f69ccc299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:27 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-2e51babf-be0b-48eb-9422-19192e1a4028 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Volume volume-fe187678-f5c1-4757-a361-c54271e513e1 (fe187678-f5c1-4757-a361-c54271e513e1): created successfully Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2e51babf-be0b-48eb-9422-19192e1a4028 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c555008-f6fc-4d46-b8d5-c24f69ccc299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-2e51babf-be0b-48eb-9422-19192e1a4028 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Flow 'volume_create_manager' (aaa98ae6-6d19-4684-ba18-f13f20956033) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:27 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-2e51babf-be0b-48eb-9422-19192e1a4028 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Created volume successfully. Jun 02 03:37:27 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5afb6044-0bab-4144-a061-659cb6d60cc9_7rp86guq" returned: 1 in 1.051s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5afb6044-0bab-4144-a061-659cb6d60cc9_7rp86guq' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9716ebc-108f-46f7-b68d-79dde48a5373]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5afb6044-0bab-4144-a061-659cb6d60cc9_j758l1jqdevstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:28 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5afb6044-0bab-4144-a061-659cb6d60cc9_j758l1jqdevstack@QuobyteHD Jun 02 03:37:28 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:28 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-18278b6b-03e7-4954-b0fb-6790af3d9143 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f618ba80-dd09-44f4-bb78-9a6ee6712933" returned: 0 in 0.925s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-18278b6b-03e7-4954-b0fb-6790af3d9143 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f618ba80-dd09-44f4-bb78-9a6ee6712933 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:28 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f618ba80-dd09-44f4-bb78-9a6ee6712933 Jun 02 03:37:28 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:28 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4b76af4d-c587-4501-8346-ed62ad6f56d8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9df0decc-e847-4e4f-8c17-93da8ac15baa 1073741824" returned: 0 in 0.966s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4b76af4d-c587-4501-8346-ed62ad6f56d8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9df0decc-e847-4e4f-8c17-93da8ac15baa {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:28 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9df0decc-e847-4e4f-8c17-93da8ac15baa Jun 02 03:37:28 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:28 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5afb6044-0bab-4144-a061-659cb6d60cc9_j758l1jqdevstack@QuobyteHD" returned: 0 in 0.839s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5afb6044-0bab-4144-a061-659cb6d60cc9_j758l1jqdevstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:28 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5afb6044-0bab-4144-a061-659cb6d60cc9_j758l1jqdevstack@QuobyteHD Jun 02 03:37:28 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:28 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-18278b6b-03e7-4954-b0fb-6790af3d9143 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f618ba80-dd09-44f4-bb78-9a6ee6712933" returned: 0 in 0.711s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-18278b6b-03e7-4954-b0fb-6790af3d9143 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "cinder-quobyte-f618ba80-dd09-44f4-bb78-9a6ee6712933" released by "delete_volume" :: held 1.733s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-18278b6b-03e7-4954-b0fb-6790af3d9143 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Created reservations ['c87925e1-6148-42bc-95c3-bd5b9bd8d583', 'e784db7e-ae5e-4ba8-a9e7-461d23971d72', '5a6c4d97-cbe9-45ca-a1b1-ed8acbb321eb', 'f2b30f7f-cdda-4e59-b5be-8de1903a468b'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-18278b6b-03e7-4954-b0fb-6790af3d9143 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-18278b6b-03e7-4954-b0fb-6790af3d9143 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-18278b6b-03e7-4954-b0fb-6790af3d9143 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-18278b6b-03e7-4954-b0fb-6790af3d9143 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-18278b6b-03e7-4954-b0fb-6790af3d9143 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-18278b6b-03e7-4954-b0fb-6790af3d9143 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:29 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:37:29 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:29 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-4b76af4d-c587-4501-8346-ed62ad6f56d8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9df0decc-e847-4e4f-8c17-93da8ac15baa" returned: 0 in 0.657s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-4b76af4d-c587-4501-8346-ed62ad6f56d8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] <== create_volume: return (1695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-4b76af4d-c587-4501-8346-ed62ad6f56d8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-85d33f65-ddc0-43eb-8ced-909d021dfc46 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.044s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-85d33f65-ddc0-43eb-8ced-909d021dfc46 tempest-CreateVolumesFromSnapshotTest-1597407613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-449196482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1efa245-b905-4122-a1c4-6b9efd668314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43e3700b8ce94de2bdf9794af8e25e16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:26Z,use_quota=True,user_id='d58b0898f78c4e8ebefbfa32260e6f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-85d33f65-ddc0-43eb-8ced-909d021dfc46 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Creating volume e1efa245-b905-4122-a1c4-6b9efd668314 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-85d33f65-ddc0-43eb-8ced-909d021dfc46 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-85d33f65-ddc0-43eb-8ced-909d021dfc46 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-85d33f65-ddc0-43eb-8ced-909d021dfc46 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-85d33f65-ddc0-43eb-8ced-909d021dfc46 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-85d33f65-ddc0-43eb-8ced-909d021dfc46 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-85d33f65-ddc0-43eb-8ced-909d021dfc46 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:37:29 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-85d33f65-ddc0-43eb-8ced-909d021dfc46 tempest-CreateVolumesFromSnapshotTest-1597407613 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-85d33f65-ddc0-43eb-8ced-909d021dfc46 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e1efa245-b905-4122-a1c4-6b9efd668314 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4b76af4d-c587-4501-8346-ed62ad6f56d8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (983d8068-97e9-40d0-b914-451b1075a432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9df0decc-e847-4e4f-8c17-93da8ac15baa', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:29 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e1efa245-b905-4122-a1c4-6b9efd668314 1073741824 Jun 02 03:37:29 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4b76af4d-c587-4501-8346-ed62ad6f56d8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5efa80-6a75-41e7-9668-89deb863be30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:29 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-4b76af4d-c587-4501-8346-ed62ad6f56d8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Volume volume-9df0decc-e847-4e4f-8c17-93da8ac15baa (9df0decc-e847-4e4f-8c17-93da8ac15baa): created successfully Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4b76af4d-c587-4501-8346-ed62ad6f56d8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5efa80-6a75-41e7-9668-89deb863be30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-4b76af4d-c587-4501-8346-ed62ad6f56d8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Flow 'volume_create_manager' (e85a672e-52e3-4e11-983b-f41f74620c2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:29 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-4b76af4d-c587-4501-8346-ed62ad6f56d8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Created volume successfully. Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-94e3ee14-a114-4ff8-98ea-aab2b96e70be tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Acquiring lock "cinder-f457731a-a659-44b3-9771-a8a4ec8fc437-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:29 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5afb6044-0bab-4144-a061-659cb6d60cc9_j758l1jqdevstack@QuobyteHD" returned: 1 in 0.789s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5afb6044-0bab-4144-a061-659cb6d60cc9_j758l1jqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-94e3ee14-a114-4ff8-98ea-aab2b96e70be tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "cinder-f457731a-a659-44b3-9771-a8a4ec8fc437-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] 5afb6044-0bab-4144-a061-659cb6d60cc9 was raw, converting to raw {{(pid=86431) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5afb6044-0bab-4144-a061-659cb6d60cc9_j758l1jqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-961c3a51-e205-4b33-919e-69ca661bb445 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:29 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5afb6044-0bab-4144-a061-659cb6d60cc9_j758l1jqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-961c3a51-e205-4b33-919e-69ca661bb445 Jun 02 03:37:29 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-94e3ee14-a114-4ff8-98ea-aab2b96e70be tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Acquiring lock "cinder-quobyte-f457731a-a659-44b3-9771-a8a4ec8fc437" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-94e3ee14-a114-4ff8-98ea-aab2b96e70be tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "cinder-quobyte-f457731a-a659-44b3-9771-a8a4ec8fc437" acquired by "delete_volume" :: waited 0.017s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34a421a-87d5-453f-94a7-414d5ab6db84]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-94e3ee14-a114-4ff8-98ea-aab2b96e70be tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f457731a-a659-44b3-9771-a8a4ec8fc437 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:29 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-18278b6b-03e7-4954-b0fb-6790af3d9143 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.672s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-18278b6b-03e7-4954-b0fb-6790af3d9143 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:37:29 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-18278b6b-03e7-4954-b0fb-6790af3d9143 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Deleted volume successfully. Jun 02 03:37:29 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-18278b6b-03e7-4954-b0fb-6790af3d9143 tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "cinder-f618ba80-dd09-44f4-bb78-9a6ee6712933-delete_volume" released by "delete_volume" :: held 2.723s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:29 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f457731a-a659-44b3-9771-a8a4ec8fc437 Jun 02 03:37:29 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:30 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-85d33f65-ddc0-43eb-8ced-909d021dfc46 tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e1efa245-b905-4122-a1c4-6b9efd668314 1073741824" returned: 0 in 0.943s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:30 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-85d33f65-ddc0-43eb-8ced-909d021dfc46 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e1efa245-b905-4122-a1c4-6b9efd668314 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_5afb6044-0bab-4144-a061-659cb6d60cc9_j758l1jqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-961c3a51-e205-4b33-919e-69ca661bb445" returned: 0 in 0.750s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:30 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5afb6044-0bab-4144-a061-659cb6d60cc9_j758l1jqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-961c3a51-e205-4b33-919e-69ca661bb445 {{(pid=86431) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 02 03:37:30 devstack cinder-volume[86431]: INFO cinder.image.image_utils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Converted 0.00 MB image at 0.00 MB/s Jun 02 03:37:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-961c3a51-e205-4b33-919e-69ca661bb445 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:30 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-961c3a51-e205-4b33-919e-69ca661bb445 1G Jun 02 03:37:30 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:30 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e1efa245-b905-4122-a1c4-6b9efd668314 Jun 02 03:37:30 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:30 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-94e3ee14-a114-4ff8-98ea-aab2b96e70be tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f457731a-a659-44b3-9771-a8a4ec8fc437" returned: 0 in 0.789s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-94e3ee14-a114-4ff8-98ea-aab2b96e70be tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f457731a-a659-44b3-9771-a8a4ec8fc437 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:30 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f457731a-a659-44b3-9771-a8a4ec8fc437 Jun 02 03:37:30 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:30 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-85d33f65-ddc0-43eb-8ced-909d021dfc46 tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e1efa245-b905-4122-a1c4-6b9efd668314" returned: 0 in 0.610s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:30 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-85d33f65-ddc0-43eb-8ced-909d021dfc46 tempest-CreateVolumesFromSnapshotTest-1597407613 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:37:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-85d33f65-ddc0-43eb-8ced-909d021dfc46 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0250c3ed-8bbc-4bea-8380-6160d7a4b319 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.167s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:30 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0250c3ed-8bbc-4bea-8380-6160d7a4b319 tempest-CreateVolumesFromSnapshotTest-1597407613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-840505458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed9607be-4d96-48fb-8ee3-c1d50055c465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43e3700b8ce94de2bdf9794af8e25e16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:27Z,use_quota=True,user_id='d58b0898f78c4e8ebefbfa32260e6f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:37:30 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-0250c3ed-8bbc-4bea-8380-6160d7a4b319 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Creating volume ed9607be-4d96-48fb-8ee3-c1d50055c465 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:37:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0250c3ed-8bbc-4bea-8380-6160d7a4b319 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0250c3ed-8bbc-4bea-8380-6160d7a4b319 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:30 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0250c3ed-8bbc-4bea-8380-6160d7a4b319 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:30 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0250c3ed-8bbc-4bea-8380-6160d7a4b319 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0250c3ed-8bbc-4bea-8380-6160d7a4b319 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:30 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0250c3ed-8bbc-4bea-8380-6160d7a4b319 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:37:30 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-0250c3ed-8bbc-4bea-8380-6160d7a4b319 tempest-CreateVolumesFromSnapshotTest-1597407613 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:37:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0250c3ed-8bbc-4bea-8380-6160d7a4b319 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ed9607be-4d96-48fb-8ee3-c1d50055c465 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:31 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-961c3a51-e205-4b33-919e-69ca661bb445 1G" returned: 0 in 0.631s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:31 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ed9607be-4d96-48fb-8ee3-c1d50055c465 1073741824 Jun 02 03:37:31 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-85d33f65-ddc0-43eb-8ced-909d021dfc46 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59195c16-53e0-4965-9771-d6f8b647533a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1efa245-b905-4122-a1c4-6b9efd668314', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:31 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:31 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-85d33f65-ddc0-43eb-8ced-909d021dfc46 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da33b359-580f-4ddd-9d6a-f52a1b66f88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:31 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-85d33f65-ddc0-43eb-8ced-909d021dfc46 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Volume volume-e1efa245-b905-4122-a1c4-6b9efd668314 (e1efa245-b905-4122-a1c4-6b9efd668314): created successfully Jun 02 03:37:31 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-85d33f65-ddc0-43eb-8ced-909d021dfc46 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da33b359-580f-4ddd-9d6a-f52a1b66f88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:31 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-85d33f65-ddc0-43eb-8ced-909d021dfc46 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Flow 'volume_create_manager' (b84b069e-a8a8-4b0e-8c01-e3baa62558e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:31 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc77046-ee13-45b4-b2e3-f7e10a122c51]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-961c3a51-e205-4b33-919e-69ca661bb445 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:31 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-85d33f65-ddc0-43eb-8ced-909d021dfc46 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Created volume successfully. Jun 02 03:37:31 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-94e3ee14-a114-4ff8-98ea-aab2b96e70be tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f457731a-a659-44b3-9771-a8a4ec8fc437" returned: 0 in 0.639s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:31 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-94e3ee14-a114-4ff8-98ea-aab2b96e70be tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "cinder-quobyte-f457731a-a659-44b3-9771-a8a4ec8fc437" released by "delete_volume" :: held 1.479s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:31 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-961c3a51-e205-4b33-919e-69ca661bb445 Jun 02 03:37:31 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:31 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-94e3ee14-a114-4ff8-98ea-aab2b96e70be tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Created reservations ['c8aa222c-91a1-480b-a535-ec690000a634', 'dde6baed-418b-4717-a7e1-9e6be1566a31', '870eb8e7-22e3-4146-a788-d1b0cdc3ad63', 'a7bc9d3b-7467-45a3-bf73-365343b655f0'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:37:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-94e3ee14-a114-4ff8-98ea-aab2b96e70be tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-94e3ee14-a114-4ff8-98ea-aab2b96e70be tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:31 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-94e3ee14-a114-4ff8-98ea-aab2b96e70be tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:31 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-94e3ee14-a114-4ff8-98ea-aab2b96e70be tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-94e3ee14-a114-4ff8-98ea-aab2b96e70be tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-94e3ee14-a114-4ff8-98ea-aab2b96e70be tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:31 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:37:31 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:31 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0250c3ed-8bbc-4bea-8380-6160d7a4b319 tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ed9607be-4d96-48fb-8ee3-c1d50055c465 1073741824" returned: 0 in 0.777s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0250c3ed-8bbc-4bea-8380-6160d7a4b319 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ed9607be-4d96-48fb-8ee3-c1d50055c465 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:31 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ed9607be-4d96-48fb-8ee3-c1d50055c465 Jun 02 03:37:31 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:31 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-961c3a51-e205-4b33-919e-69ca661bb445" returned: 0 in 0.794s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-961c3a51-e205-4b33-919e-69ca661bb445 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:31 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-db73b36a-1422-435d-8d8e-1797de06059b tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Acquiring lock "cinder-3faca16b-db61-4915-a402-ab276a65cce9-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:31 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-db73b36a-1422-435d-8d8e-1797de06059b tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "cinder-3faca16b-db61-4915-a402-ab276a65cce9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:31 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-db73b36a-1422-435d-8d8e-1797de06059b tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Acquiring lock "cinder-quobyte-3faca16b-db61-4915-a402-ab276a65cce9" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:31 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-db73b36a-1422-435d-8d8e-1797de06059b tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "cinder-quobyte-3faca16b-db61-4915-a402-ab276a65cce9" acquired by "delete_volume" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:31 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-961c3a51-e205-4b33-919e-69ca661bb445 Jun 02 03:37:31 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:31 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-94e3ee14-a114-4ff8-98ea-aab2b96e70be tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.703s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:31 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-94e3ee14-a114-4ff8-98ea-aab2b96e70be tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:37:31 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-94e3ee14-a114-4ff8-98ea-aab2b96e70be tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Deleted volume successfully. Jun 02 03:37:32 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d7fdf7-662f-461d-89c3-c299a3fd9210]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-db73b36a-1422-435d-8d8e-1797de06059b tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3faca16b-db61-4915-a402-ab276a65cce9 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:32 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-94e3ee14-a114-4ff8-98ea-aab2b96e70be tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "cinder-f457731a-a659-44b3-9771-a8a4ec8fc437-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:32 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3faca16b-db61-4915-a402-ab276a65cce9 Jun 02 03:37:32 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:32 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0250c3ed-8bbc-4bea-8380-6160d7a4b319 tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ed9607be-4d96-48fb-8ee3-c1d50055c465" returned: 0 in 0.684s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:32 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0250c3ed-8bbc-4bea-8380-6160d7a4b319 tempest-CreateVolumesFromSnapshotTest-1597407613 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:37:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0250c3ed-8bbc-4bea-8380-6160d7a4b319 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-71c69c3d-b389-48f3-89cf-676fd46248f6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.932s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:32 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-71c69c3d-b389-48f3-89cf-676fd46248f6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-253306154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ddbd417-3cdc-4f44-9886-683035ad1464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43e3700b8ce94de2bdf9794af8e25e16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:27Z,use_quota=True,user_id='d58b0898f78c4e8ebefbfa32260e6f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:37:32 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-71c69c3d-b389-48f3-89cf-676fd46248f6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Creating volume 1ddbd417-3cdc-4f44-9886-683035ad1464 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:37:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-71c69c3d-b389-48f3-89cf-676fd46248f6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-71c69c3d-b389-48f3-89cf-676fd46248f6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:32 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-71c69c3d-b389-48f3-89cf-676fd46248f6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:32 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-71c69c3d-b389-48f3-89cf-676fd46248f6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-71c69c3d-b389-48f3-89cf-676fd46248f6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:32 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-71c69c3d-b389-48f3-89cf-676fd46248f6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:37:32 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-71c69c3d-b389-48f3-89cf-676fd46248f6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:37:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-71c69c3d-b389-48f3-89cf-676fd46248f6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1ddbd417-3cdc-4f44-9886-683035ad1464 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:32 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0250c3ed-8bbc-4bea-8380-6160d7a4b319 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75b915a5-2cec-49e9-892a-b4757960119b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed9607be-4d96-48fb-8ee3-c1d50055c465', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:32 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0250c3ed-8bbc-4bea-8380-6160d7a4b319 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e769256e-087d-4bad-a122-ced366cb8af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:32 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:32 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1ddbd417-3cdc-4f44-9886-683035ad1464 1073741824 Jun 02 03:37:32 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-961c3a51-e205-4b33-919e-69ca661bb445" returned: 1 in 0.737s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-961c3a51-e205-4b33-919e-69ca661bb445' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:37:32 devstack cinder-volume[86431]: DEBUG cinder.volume.volume_utils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Downloaded image 5afb6044-0bab-4144-a061-659cb6d60cc9 ((None, [{'url': 'file:///opt/stack/data/glance/images/5afb6044-0bab-4144-a061-659cb6d60cc9', 'metadata': {}}])) to volume 961c3a51-e205-4b33-919e-69ca661bb445 successfully. {{(pid=86431) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 02 03:37:32 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Temporary image 5afb6044-0bab-4144-a061-659cb6d60cc9 for user 4e03ea16cce04a47b034213af6d628bb is deleted. {{(pid=86431) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 02 03:37:32 devstack cinder-volume[86431]: DEBUG cinder.volume.volume_utils [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Marking volume 961c3a51-e205-4b33-919e-69ca661bb445 as bootable. {{(pid=86431) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 02 03:37:32 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-0250c3ed-8bbc-4bea-8380-6160d7a4b319 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Volume volume-ed9607be-4d96-48fb-8ee3-c1d50055c465 (ed9607be-4d96-48fb-8ee3-c1d50055c465): created successfully Jun 02 03:37:32 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0250c3ed-8bbc-4bea-8380-6160d7a4b319 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e769256e-087d-4bad-a122-ced366cb8af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:32 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-0250c3ed-8bbc-4bea-8380-6160d7a4b319 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Flow 'volume_create_manager' (a81a7585-0e45-4c78-85d4-9178e5f4d164) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:32 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Copying metadata from image 5afb6044-0bab-4144-a061-659cb6d60cc9 to 961c3a51-e205-4b33-919e-69ca661bb445. {{(pid=86431) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 02 03:37:32 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Creating volume glance metadata for volume 961c3a51-e205-4b33-919e-69ca661bb445 backed by image 5afb6044-0bab-4144-a061-659cb6d60cc9 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5afb6044-0bab-4144-a061-659cb6d60cc9', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '6a648ecd9a8993eb9b8dd21254e25174', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86431) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 02 03:37:32 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-0250c3ed-8bbc-4bea-8380-6160d7a4b319 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Created volume successfully. Jun 02 03:37:32 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d10c1ec-42be-4d6c-a0ac-0069b034a0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-961c3a51-e205-4b33-919e-69ca661bb445', 'volume_size': 1, 'image_id': '5afb6044-0bab-4144-a061-659cb6d60cc9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5afb6044-0bab-4144-a061-659cb6d60cc9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6a648ecd9a8993eb9b8dd21254e25174', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0bc04170f6f64b72ab18bc11c9d98cfc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a9f5cc40732a6cb2bed09a492ee51ab9030fa654e8fa6163a6142dcc122ee03ec5aee48086b29f1d99c70a3cf16e633c515fc8ba811f5899d6bd7546e1b2f2ff', 'id': '5afb6044-0bab-4144-a061-659cb6d60cc9', 'created_at': datetime.datetime(2026, 6, 2, 1, 37, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 1, 37, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5afb6044-0bab-4144-a061-659cb6d60cc9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:32 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a33b9bb-9cda-44ce-9955-58772e303871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:32 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Volume volume-961c3a51-e205-4b33-919e-69ca661bb445 (961c3a51-e205-4b33-919e-69ca661bb445): created successfully Jun 02 03:37:32 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a33b9bb-9cda-44ce-9955-58772e303871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:32 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Flow 'volume_create_manager' (c5257e24-4d9b-40a3-ae8b-e0f2136c5697) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:32 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-30913b27-3e06-471b-948e-e0fdf0f00239 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Created volume successfully. Jun 02 03:37:32 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-db73b36a-1422-435d-8d8e-1797de06059b tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3faca16b-db61-4915-a402-ab276a65cce9" returned: 0 in 0.727s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-db73b36a-1422-435d-8d8e-1797de06059b tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3faca16b-db61-4915-a402-ab276a65cce9 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:32 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3faca16b-db61-4915-a402-ab276a65cce9 Jun 02 03:37:32 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:33 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-db73b36a-1422-435d-8d8e-1797de06059b tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3faca16b-db61-4915-a402-ab276a65cce9" returned: 0 in 0.587s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:33 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-db73b36a-1422-435d-8d8e-1797de06059b tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "cinder-quobyte-3faca16b-db61-4915-a402-ab276a65cce9" released by "delete_volume" :: held 1.371s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:33 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-71c69c3d-b389-48f3-89cf-676fd46248f6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1ddbd417-3cdc-4f44-9886-683035ad1464 1073741824" returned: 0 in 0.840s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:33 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-db73b36a-1422-435d-8d8e-1797de06059b tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Created reservations ['8f544988-5862-4f9f-b8a3-d05479db7996', 'df97280d-806f-4825-96a3-e9074a55d4cc', '354d1ef9-3626-42c9-af4e-81711070ae10', '115b0523-b701-4abe-9cd0-969de1e0fc44'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:37:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-71c69c3d-b389-48f3-89cf-676fd46248f6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1ddbd417-3cdc-4f44-9886-683035ad1464 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:33 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1ddbd417-3cdc-4f44-9886-683035ad1464 Jun 02 03:37:33 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-db73b36a-1422-435d-8d8e-1797de06059b tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-db73b36a-1422-435d-8d8e-1797de06059b tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:33 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-db73b36a-1422-435d-8d8e-1797de06059b tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:33 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-db73b36a-1422-435d-8d8e-1797de06059b tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-db73b36a-1422-435d-8d8e-1797de06059b tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-db73b36a-1422-435d-8d8e-1797de06059b tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:33 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:37:33 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:33 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-c965d08e-aeaa-43ae-8923-f7afa409a5c0 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Acquiring lock "cinder-961c3a51-e205-4b33-919e-69ca661bb445-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:33 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-c965d08e-aeaa-43ae-8923-f7afa409a5c0 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Lock "cinder-961c3a51-e205-4b33-919e-69ca661bb445-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:33 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-c965d08e-aeaa-43ae-8923-f7afa409a5c0 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Acquiring lock "cinder-quobyte-961c3a51-e205-4b33-919e-69ca661bb445" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:33 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-c965d08e-aeaa-43ae-8923-f7afa409a5c0 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Lock "cinder-quobyte-961c3a51-e205-4b33-919e-69ca661bb445" acquired by "delete_volume" :: waited 0.020s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:33 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[5308e66d-a25e-49e5-960c-973170cb81b5]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c965d08e-aeaa-43ae-8923-f7afa409a5c0 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-961c3a51-e205-4b33-919e-69ca661bb445 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:33 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-961c3a51-e205-4b33-919e-69ca661bb445 Jun 02 03:37:33 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:34 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-71c69c3d-b389-48f3-89cf-676fd46248f6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1ddbd417-3cdc-4f44-9886-683035ad1464" returned: 0 in 0.630s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:34 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-71c69c3d-b389-48f3-89cf-676fd46248f6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:37:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-71c69c3d-b389-48f3-89cf-676fd46248f6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-85f1424c-742c-418d-ace9-b16626fdc89c tempest-VolumeDependencyTests-1086620720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.422s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:34 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-85f1424c-742c-418d-ace9-b16626fdc89c tempest-VolumeDependencyTests-1086620720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-326934583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6429ffa8-3507-48e9-95dd-84238c785b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b823a1b60584e608ccb1a6ca536f52c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:27Z,use_quota=True,user_id='5b724b7c9a19488cba365cbcb18af258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:37:34 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-85f1424c-742c-418d-ace9-b16626fdc89c tempest-VolumeDependencyTests-1086620720 None] Creating volume 6429ffa8-3507-48e9-95dd-84238c785b3b {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:37:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-85f1424c-742c-418d-ace9-b16626fdc89c tempest-VolumeDependencyTests-1086620720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-85f1424c-742c-418d-ace9-b16626fdc89c tempest-VolumeDependencyTests-1086620720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:34 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-85f1424c-742c-418d-ace9-b16626fdc89c tempest-VolumeDependencyTests-1086620720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:34 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-85f1424c-742c-418d-ace9-b16626fdc89c tempest-VolumeDependencyTests-1086620720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-85f1424c-742c-418d-ace9-b16626fdc89c tempest-VolumeDependencyTests-1086620720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:34 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-85f1424c-742c-418d-ace9-b16626fdc89c tempest-VolumeDependencyTests-1086620720 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:37:34 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-85f1424c-742c-418d-ace9-b16626fdc89c tempest-VolumeDependencyTests-1086620720 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:37:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-85f1424c-742c-418d-ace9-b16626fdc89c tempest-VolumeDependencyTests-1086620720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-71c69c3d-b389-48f3-89cf-676fd46248f6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f524dbec-cedd-48f4-aca0-4da72441efb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ddbd417-3cdc-4f44-9886-683035ad1464', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:34 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b 1073741824 Jun 02 03:37:34 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-71c69c3d-b389-48f3-89cf-676fd46248f6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14815266-52dd-496d-bb51-5f7e79ecff9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:34 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-db73b36a-1422-435d-8d8e-1797de06059b tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.646s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:34 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-71c69c3d-b389-48f3-89cf-676fd46248f6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Volume volume-1ddbd417-3cdc-4f44-9886-683035ad1464 (1ddbd417-3cdc-4f44-9886-683035ad1464): created successfully Jun 02 03:37:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-71c69c3d-b389-48f3-89cf-676fd46248f6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14815266-52dd-496d-bb51-5f7e79ecff9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:34 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-71c69c3d-b389-48f3-89cf-676fd46248f6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Flow 'volume_create_manager' (ed3da19a-a481-4c21-9210-f3d603b6792c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:34 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-db73b36a-1422-435d-8d8e-1797de06059b tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:37:34 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-db73b36a-1422-435d-8d8e-1797de06059b tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Deleted volume successfully. Jun 02 03:37:34 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-71c69c3d-b389-48f3-89cf-676fd46248f6 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Created volume successfully. Jun 02 03:37:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-db73b36a-1422-435d-8d8e-1797de06059b tempest-CreateVolumesFromSourceVolumeTest-2121680704 None] Lock "cinder-3faca16b-db61-4915-a402-ab276a65cce9-delete_volume" released by "delete_volume" :: held 2.270s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:34 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c965d08e-aeaa-43ae-8923-f7afa409a5c0 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-961c3a51-e205-4b33-919e-69ca661bb445" returned: 0 in 0.762s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c965d08e-aeaa-43ae-8923-f7afa409a5c0 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-961c3a51-e205-4b33-919e-69ca661bb445 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:34 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-961c3a51-e205-4b33-919e-69ca661bb445 Jun 02 03:37:34 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:34 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-85f1424c-742c-418d-ace9-b16626fdc89c tempest-VolumeDependencyTests-1086620720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b 1073741824" returned: 0 in 0.938s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-85f1424c-742c-418d-ace9-b16626fdc89c tempest-VolumeDependencyTests-1086620720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:35 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b Jun 02 03:37:35 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:35 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-02d50f39-f2cd-4b14-9de0-e9835830622f tempest-CreateVolumesFromSnapshotTest-1597407613 None] Acquiring lock "cinder-1ddbd417-3cdc-4f44-9886-683035ad1464-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:35 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-02d50f39-f2cd-4b14-9de0-e9835830622f tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "cinder-1ddbd417-3cdc-4f44-9886-683035ad1464-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:35 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-02d50f39-f2cd-4b14-9de0-e9835830622f tempest-CreateVolumesFromSnapshotTest-1597407613 None] Acquiring lock "cinder-quobyte-1ddbd417-3cdc-4f44-9886-683035ad1464" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:35 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-02d50f39-f2cd-4b14-9de0-e9835830622f tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "cinder-quobyte-1ddbd417-3cdc-4f44-9886-683035ad1464" acquired by "delete_volume" :: waited 0.020s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:35 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca424f2-4880-4a36-8c9d-8debe551f593]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-02d50f39-f2cd-4b14-9de0-e9835830622f tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1ddbd417-3cdc-4f44-9886-683035ad1464 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:35 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1ddbd417-3cdc-4f44-9886-683035ad1464 Jun 02 03:37:35 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:35 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c965d08e-aeaa-43ae-8923-f7afa409a5c0 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-961c3a51-e205-4b33-919e-69ca661bb445" returned: 1 in 0.928s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c965d08e-aeaa-43ae-8923-f7afa409a5c0 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-961c3a51-e205-4b33-919e-69ca661bb445' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:37:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c965d08e-aeaa-43ae-8923-f7afa409a5c0 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-961c3a51-e205-4b33-919e-69ca661bb445 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:35 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-961c3a51-e205-4b33-919e-69ca661bb445 Jun 02 03:37:35 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:35 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-85f1424c-742c-418d-ace9-b16626fdc89c tempest-VolumeDependencyTests-1086620720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b" returned: 0 in 0.699s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:35 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-85f1424c-742c-418d-ace9-b16626fdc89c tempest-VolumeDependencyTests-1086620720 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:37:35 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-85f1424c-742c-418d-ace9-b16626fdc89c tempest-VolumeDependencyTests-1086620720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:35 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-85f1424c-742c-418d-ace9-b16626fdc89c tempest-VolumeDependencyTests-1086620720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2e912a-34b9-41e3-bb00-720ad20c0a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6429ffa8-3507-48e9-95dd-84238c785b3b', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:35 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-85f1424c-742c-418d-ace9-b16626fdc89c tempest-VolumeDependencyTests-1086620720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e441daaf-a690-43c6-afc0-d94b0339f10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:35 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-85f1424c-742c-418d-ace9-b16626fdc89c tempest-VolumeDependencyTests-1086620720 None] Volume volume-6429ffa8-3507-48e9-95dd-84238c785b3b (6429ffa8-3507-48e9-95dd-84238c785b3b): created successfully Jun 02 03:37:35 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-85f1424c-742c-418d-ace9-b16626fdc89c tempest-VolumeDependencyTests-1086620720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e441daaf-a690-43c6-afc0-d94b0339f10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:35 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-85f1424c-742c-418d-ace9-b16626fdc89c tempest-VolumeDependencyTests-1086620720 None] Flow 'volume_create_manager' (6cc73f39-ccd6-4a8e-8261-7c4843e844b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:35 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-85f1424c-742c-418d-ace9-b16626fdc89c tempest-VolumeDependencyTests-1086620720 None] Created volume successfully. Jun 02 03:37:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c3d04e46-5b80-4b34-86d3-e7fed7208ef6 tempest-VolumeDependencyTests-1086620720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c3d04e46-5b80-4b34-86d3-e7fed7208ef6 tempest-VolumeDependencyTests-1086620720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:36 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-c3d04e46-5b80-4b34-86d3-e7fed7208ef6 tempest-VolumeDependencyTests-1086620720 None] Creating offline snapshot fe918250-297c-4d36-b24d-9a1411ba1730 of volume 6429ffa8-3507-48e9-95dd-84238c785b3b {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:37:36 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[6781d0b0-49b6-4ed6-9e2d-5af1703b700f]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c3d04e46-5b80-4b34-86d3-e7fed7208ef6 tempest-VolumeDependencyTests-1086620720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:36 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-02d50f39-f2cd-4b14-9de0-e9835830622f tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1ddbd417-3cdc-4f44-9886-683035ad1464" returned: 0 in 0.961s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-02d50f39-f2cd-4b14-9de0-e9835830622f tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1ddbd417-3cdc-4f44-9886-683035ad1464 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:36 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1ddbd417-3cdc-4f44-9886-683035ad1464 Jun 02 03:37:36 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:36 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b Jun 02 03:37:36 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:36 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c965d08e-aeaa-43ae-8923-f7afa409a5c0 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-961c3a51-e205-4b33-919e-69ca661bb445" returned: 0 in 0.859s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:36 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-c965d08e-aeaa-43ae-8923-f7afa409a5c0 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Lock "cinder-quobyte-961c3a51-e205-4b33-919e-69ca661bb445" released by "delete_volume" :: held 2.624s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:36 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-c965d08e-aeaa-43ae-8923-f7afa409a5c0 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Created reservations ['78396cfc-707f-45b9-943e-fd79edbc5a1d', 'e67db9c1-d524-4a98-abb1-57727ea4dcd5', 'b7159954-4286-472a-951a-bef75534bcdd', '2a710669-f960-4f08-a12b-4772c2362ff2'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:37:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c965d08e-aeaa-43ae-8923-f7afa409a5c0 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c965d08e-aeaa-43ae-8923-f7afa409a5c0 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:36 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-c965d08e-aeaa-43ae-8923-f7afa409a5c0 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:36 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-c965d08e-aeaa-43ae-8923-f7afa409a5c0 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c965d08e-aeaa-43ae-8923-f7afa409a5c0 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:36 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c965d08e-aeaa-43ae-8923-f7afa409a5c0 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:36 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:37:36 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:37 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-02d50f39-f2cd-4b14-9de0-e9835830622f tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-1ddbd417-3cdc-4f44-9886-683035ad1464" returned: 0 in 0.783s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:37 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-02d50f39-f2cd-4b14-9de0-e9835830622f tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "cinder-quobyte-1ddbd417-3cdc-4f44-9886-683035ad1464" released by "delete_volume" :: held 1.813s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:37 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c3d04e46-5b80-4b34-86d3-e7fed7208ef6 tempest-VolumeDependencyTests-1086620720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b" returned: 0 in 0.864s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c3d04e46-5b80-4b34-86d3-e7fed7208ef6 tempest-VolumeDependencyTests-1086620720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b.fe918250-297c-4d36-b24d-9a1411ba1730 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:37 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b.fe918250-297c-4d36-b24d-9a1411ba1730 1G Jun 02 03:37:37 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:37 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-02d50f39-f2cd-4b14-9de0-e9835830622f tempest-CreateVolumesFromSnapshotTest-1597407613 None] Created reservations ['9f112937-48db-4d93-9781-351aba91f0cc', 'dd5050f3-9185-46bf-8ab8-073fc1f300ad', '102e268b-59b9-42bd-8b0e-2711ba11cc2c', 'd9ca4053-d0db-46cc-81ef-12688c6127e0'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:37:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-02d50f39-f2cd-4b14-9de0-e9835830622f tempest-CreateVolumesFromSnapshotTest-1597407613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-02d50f39-f2cd-4b14-9de0-e9835830622f tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:37 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-02d50f39-f2cd-4b14-9de0-e9835830622f tempest-CreateVolumesFromSnapshotTest-1597407613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:37 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-02d50f39-f2cd-4b14-9de0-e9835830622f tempest-CreateVolumesFromSnapshotTest-1597407613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-02d50f39-f2cd-4b14-9de0-e9835830622f tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-02d50f39-f2cd-4b14-9de0-e9835830622f tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:37 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:37:37 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:37 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c965d08e-aeaa-43ae-8923-f7afa409a5c0 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.893s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:37 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-c965d08e-aeaa-43ae-8923-f7afa409a5c0 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:37:37 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-c965d08e-aeaa-43ae-8923-f7afa409a5c0 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Deleted volume successfully. Jun 02 03:37:37 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-27522750-8d42-4384-ad97-9f8c6d8d88d3 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Acquiring lock "cinder-ed9607be-4d96-48fb-8ee3-c1d50055c465-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:37 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-c965d08e-aeaa-43ae-8923-f7afa409a5c0 tempest-VolumeAndVolumeTypeFromImageTest-477261958 None] Lock "cinder-961c3a51-e205-4b33-919e-69ca661bb445-delete_volume" released by "delete_volume" :: held 3.834s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:37 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-27522750-8d42-4384-ad97-9f8c6d8d88d3 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "cinder-ed9607be-4d96-48fb-8ee3-c1d50055c465-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:37 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-27522750-8d42-4384-ad97-9f8c6d8d88d3 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Acquiring lock "cinder-quobyte-ed9607be-4d96-48fb-8ee3-c1d50055c465" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:37 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-27522750-8d42-4384-ad97-9f8c6d8d88d3 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "cinder-quobyte-ed9607be-4d96-48fb-8ee3-c1d50055c465" acquired by "delete_volume" :: waited 0.024s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:37 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[426b654c-9377-4cc1-9aee-7aa01e7a2539]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:37 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-27522750-8d42-4384-ad97-9f8c6d8d88d3 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ed9607be-4d96-48fb-8ee3-c1d50055c465 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:37 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ed9607be-4d96-48fb-8ee3-c1d50055c465 Jun 02 03:37:37 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:38 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c3d04e46-5b80-4b34-86d3-e7fed7208ef6 tempest-VolumeDependencyTests-1086620720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b.fe918250-297c-4d36-b24d-9a1411ba1730 1G" returned: 0 in 1.247s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c3d04e46-5b80-4b34-86d3-e7fed7208ef6 tempest-VolumeDependencyTests-1086620720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6429ffa8-3507-48e9-95dd-84238c785b3b -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b.fe918250-297c-4d36-b24d-9a1411ba1730 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:38 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-02d50f39-f2cd-4b14-9de0-e9835830622f tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 1.084s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:38 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-02d50f39-f2cd-4b14-9de0-e9835830622f tempest-CreateVolumesFromSnapshotTest-1597407613 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:37:38 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-02d50f39-f2cd-4b14-9de0-e9835830622f tempest-CreateVolumesFromSnapshotTest-1597407613 None] Deleted volume successfully. Jun 02 03:37:38 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6429ffa8-3507-48e9-95dd-84238c785b3b -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b.fe918250-297c-4d36-b24d-9a1411ba1730 Jun 02 03:37:38 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:38 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-02d50f39-f2cd-4b14-9de0-e9835830622f tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "cinder-1ddbd417-3cdc-4f44-9886-683035ad1464-delete_volume" released by "delete_volume" :: held 3.267s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:38 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-27522750-8d42-4384-ad97-9f8c6d8d88d3 tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ed9607be-4d96-48fb-8ee3-c1d50055c465" returned: 0 in 1.017s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:38 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-27522750-8d42-4384-ad97-9f8c6d8d88d3 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ed9607be-4d96-48fb-8ee3-c1d50055c465 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:38 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ed9607be-4d96-48fb-8ee3-c1d50055c465 Jun 02 03:37:38 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:39 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c3d04e46-5b80-4b34-86d3-e7fed7208ef6 tempest-VolumeDependencyTests-1086620720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6429ffa8-3507-48e9-95dd-84238c785b3b -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b.fe918250-297c-4d36-b24d-9a1411ba1730" returned: 0 in 0.849s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:39 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-c3d04e46-5b80-4b34-86d3-e7fed7208ef6 tempest-VolumeDependencyTests-1086620720 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b.fe918250-297c-4d36-b24d-9a1411ba1730 is being set with open permissions: ugo+rw Jun 02 03:37:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c3d04e46-5b80-4b34-86d3-e7fed7208ef6 tempest-VolumeDependencyTests-1086620720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b.fe918250-297c-4d36-b24d-9a1411ba1730 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:39 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b.fe918250-297c-4d36-b24d-9a1411ba1730 Jun 02 03:37:39 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:39 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-27522750-8d42-4384-ad97-9f8c6d8d88d3 tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ed9607be-4d96-48fb-8ee3-c1d50055c465" returned: 0 in 0.762s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:39 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-27522750-8d42-4384-ad97-9f8c6d8d88d3 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "cinder-quobyte-ed9607be-4d96-48fb-8ee3-c1d50055c465" released by "delete_volume" :: held 1.832s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:39 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-27522750-8d42-4384-ad97-9f8c6d8d88d3 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Created reservations ['be0ec416-6072-46a9-8ef6-afb3fd002710', '9e368972-5084-4270-96a4-59c7c9c9527f', 'e925dcff-92eb-4fd8-8ceb-25ba7122fa05', 'eda1e40b-0b86-4ea6-a10a-386757795fe2'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:37:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-27522750-8d42-4384-ad97-9f8c6d8d88d3 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-27522750-8d42-4384-ad97-9f8c6d8d88d3 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:39 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-27522750-8d42-4384-ad97-9f8c6d8d88d3 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:39 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-27522750-8d42-4384-ad97-9f8c6d8d88d3 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-27522750-8d42-4384-ad97-9f8c6d8d88d3 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:39 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-27522750-8d42-4384-ad97-9f8c6d8d88d3 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:39 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:37:39 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:39 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1043f7d7-0ab2-4aab-8b29-dabc427c3bf8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Acquiring lock "cinder-e1efa245-b905-4122-a1c4-6b9efd668314-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:39 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1043f7d7-0ab2-4aab-8b29-dabc427c3bf8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "cinder-e1efa245-b905-4122-a1c4-6b9efd668314-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:39 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1043f7d7-0ab2-4aab-8b29-dabc427c3bf8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Acquiring lock "cinder-quobyte-e1efa245-b905-4122-a1c4-6b9efd668314" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1043f7d7-0ab2-4aab-8b29-dabc427c3bf8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "cinder-quobyte-e1efa245-b905-4122-a1c4-6b9efd668314" acquired by "delete_volume" :: waited 0.031s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:40 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e32a82c-00c2-4c36-838f-6bcb7429e2cc]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1043f7d7-0ab2-4aab-8b29-dabc427c3bf8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e1efa245-b905-4122-a1c4-6b9efd668314 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:40 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c3d04e46-5b80-4b34-86d3-e7fed7208ef6 tempest-VolumeDependencyTests-1086620720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b.fe918250-297c-4d36-b24d-9a1411ba1730" returned: 0 in 0.864s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c3d04e46-5b80-4b34-86d3-e7fed7208ef6 tempest-VolumeDependencyTests-1086620720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:40 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b.info Jun 02 03:37:40 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:40 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e1efa245-b905-4122-a1c4-6b9efd668314 Jun 02 03:37:40 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:40 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-27522750-8d42-4384-ad97-9f8c6d8d88d3 tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.791s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:40 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-27522750-8d42-4384-ad97-9f8c6d8d88d3 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:37:40 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-27522750-8d42-4384-ad97-9f8c6d8d88d3 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Deleted volume successfully. Jun 02 03:37:40 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-27522750-8d42-4384-ad97-9f8c6d8d88d3 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "cinder-ed9607be-4d96-48fb-8ee3-c1d50055c465-delete_volume" released by "delete_volume" :: held 2.911s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:40 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c3d04e46-5b80-4b34-86d3-e7fed7208ef6 tempest-VolumeDependencyTests-1086620720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b.info" returned: 0 in 0.802s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:40 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-c3d04e46-5b80-4b34-86d3-e7fed7208ef6 tempest-VolumeDependencyTests-1086620720 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b.info is being set with open permissions: ugo+rw Jun 02 03:37:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c3d04e46-5b80-4b34-86d3-e7fed7208ef6 tempest-VolumeDependencyTests-1086620720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:40 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:40 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b.info Jun 02 03:37:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1043f7d7-0ab2-4aab-8b29-dabc427c3bf8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e1efa245-b905-4122-a1c4-6b9efd668314" returned: 0 in 0.930s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:40 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:40 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1043f7d7-0ab2-4aab-8b29-dabc427c3bf8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e1efa245-b905-4122-a1c4-6b9efd668314 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:41 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e1efa245-b905-4122-a1c4-6b9efd668314 Jun 02 03:37:41 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:41 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c3d04e46-5b80-4b34-86d3-e7fed7208ef6 tempest-VolumeDependencyTests-1086620720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b.info" returned: 0 in 0.686s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c3d04e46-5b80-4b34-86d3-e7fed7208ef6 tempest-VolumeDependencyTests-1086620720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.453s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:41 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-c3d04e46-5b80-4b34-86d3-e7fed7208ef6 tempest-VolumeDependencyTests-1086620720 None] Create snapshot completed successfully Jun 02 03:37:41 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1043f7d7-0ab2-4aab-8b29-dabc427c3bf8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-e1efa245-b905-4122-a1c4-6b9efd668314" returned: 0 in 0.779s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:41 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1043f7d7-0ab2-4aab-8b29-dabc427c3bf8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "cinder-quobyte-e1efa245-b905-4122-a1c4-6b9efd668314" released by "delete_volume" :: held 1.784s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:41 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-1043f7d7-0ab2-4aab-8b29-dabc427c3bf8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Created reservations ['5d2087cc-6323-4bb7-b1cf-bf2a86102eaa', 'a47b166c-6f99-476c-9e81-2a3ae0415900', '744f1a0e-f7d1-442c-b969-e4bb865609f6', '52319190-765a-44c4-a1e0-9ffb9badd07b'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:37:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1043f7d7-0ab2-4aab-8b29-dabc427c3bf8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1043f7d7-0ab2-4aab-8b29-dabc427c3bf8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:41 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-1043f7d7-0ab2-4aab-8b29-dabc427c3bf8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:41 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-1043f7d7-0ab2-4aab-8b29-dabc427c3bf8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1043f7d7-0ab2-4aab-8b29-dabc427c3bf8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:41 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1043f7d7-0ab2-4aab-8b29-dabc427c3bf8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:42 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:37:42 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:42 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e928e4dc-2696-4fff-8623-6ce5e3f84fae tempest-CreateVolumesFromSnapshotTest-1597407613 None] Acquiring lock "cinder-9df0decc-e847-4e4f-8c17-93da8ac15baa-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:42 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e928e4dc-2696-4fff-8623-6ce5e3f84fae tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "cinder-9df0decc-e847-4e4f-8c17-93da8ac15baa-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:42 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e928e4dc-2696-4fff-8623-6ce5e3f84fae tempest-CreateVolumesFromSnapshotTest-1597407613 None] Acquiring lock "cinder-quobyte-9df0decc-e847-4e4f-8c17-93da8ac15baa" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:42 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e928e4dc-2696-4fff-8623-6ce5e3f84fae tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "cinder-quobyte-9df0decc-e847-4e4f-8c17-93da8ac15baa" acquired by "delete_volume" :: waited 0.020s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:42 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5db3a9e-8d6c-49f9-99cd-20c5438b2cf7]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e928e4dc-2696-4fff-8623-6ce5e3f84fae tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9df0decc-e847-4e4f-8c17-93da8ac15baa {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:42 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9df0decc-e847-4e4f-8c17-93da8ac15baa Jun 02 03:37:42 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:42 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:42 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1043f7d7-0ab2-4aab-8b29-dabc427c3bf8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.769s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:42 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-1043f7d7-0ab2-4aab-8b29-dabc427c3bf8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:37:42 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-1043f7d7-0ab2-4aab-8b29-dabc427c3bf8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Deleted volume successfully. Jun 02 03:37:42 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1043f7d7-0ab2-4aab-8b29-dabc427c3bf8 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "cinder-e1efa245-b905-4122-a1c4-6b9efd668314-delete_volume" released by "delete_volume" :: held 2.925s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:43 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e928e4dc-2696-4fff-8623-6ce5e3f84fae tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9df0decc-e847-4e4f-8c17-93da8ac15baa" returned: 0 in 0.898s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e928e4dc-2696-4fff-8623-6ce5e3f84fae tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9df0decc-e847-4e4f-8c17-93da8ac15baa {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:43 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9df0decc-e847-4e4f-8c17-93da8ac15baa Jun 02 03:37:43 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:43 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:37:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Flow 'volume_create_manager' (d0fec033-282f-464c-9eeb-f6bae0ca0eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0ffb1b7-6779-430e-8e56-20ed0cc94be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0ffb1b7-6779-430e-8e56-20ed0cc94be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1330555668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea31c593-dc32-491e-aa2e-906370a02729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b823a1b60584e608ccb1a6ca536f52c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fe918250-297c-4d36-b24d-9a1411ba1730,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:43Z,use_quota=True,user_id='5b724b7c9a19488cba365cbcb18af258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a340f0fe-4d49-479c-b045-05a913c02a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a340f0fe-4d49-479c-b045-05a913c02a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3064256b-a069-4141-a49b-cd11b7b7705b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3064256b-a069-4141-a49b-cd11b7b7705b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ea31c593-dc32-491e-aa2e-906370a02729', 'volume_name': 'volume-ea31c593-dc32-491e-aa2e-906370a02729', 'volume_size': 1, 'snapshot_id': 'fe918250-297c-4d36-b24d-9a1411ba1730'}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (927aa3e8-a5c6-412a-b935-14e5c621aa56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (927aa3e8-a5c6-412a-b935-14e5c621aa56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:43 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1637854d-b931-4bfa-876e-c9138321f57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:43 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Volume ea31c593-dc32-491e-aa2e-906370a02729: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ea31c593-dc32-491e-aa2e-906370a02729', 'volume_size': 1, 'snapshot_id': 'fe918250-297c-4d36-b24d-9a1411ba1730'} Jun 02 03:37:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:43 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Acquiring lock "cinder-quobyte-fe918250-297c-4d36-b24d-9a1411ba1730-ea31c593-dc32-491e-aa2e-906370a02729" by "_create_volume_from_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:43 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Lock "cinder-quobyte-fe918250-297c-4d36-b24d-9a1411ba1730-ea31c593-dc32-491e-aa2e-906370a02729" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:43 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Creating volume ea31c593-dc32-491e-aa2e-906370a02729 from snapshot fe918250-297c-4d36-b24d-9a1411ba1730 {{(pid=86431) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 02 03:37:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:43 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:43 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:43 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:37:43 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Acquiring lock "cinder-quobyte-ea31c593-dc32-491e-aa2e-906370a02729" by "_copy_volume_from_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:43 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Lock "cinder-quobyte-ea31c593-dc32-491e-aa2e-906370a02729" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:43 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] snapshot: fe918250-297c-4d36-b24d-9a1411ba1730, volume: ea31c593-dc32-491e-aa2e-906370a02729, {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 03:37:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:43 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:43 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:43 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9892d1d-22ff-42a3-9cf2-656b50374173]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:43 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b.fe918250-297c-4d36-b24d-9a1411ba1730 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:43 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b.fe918250-297c-4d36-b24d-9a1411ba1730 Jun 02 03:37:43 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:44 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e928e4dc-2696-4fff-8623-6ce5e3f84fae tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-9df0decc-e847-4e4f-8c17-93da8ac15baa" returned: 0 in 0.915s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:44 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e928e4dc-2696-4fff-8623-6ce5e3f84fae tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "cinder-quobyte-9df0decc-e847-4e4f-8c17-93da8ac15baa" released by "delete_volume" :: held 1.875s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:44 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-e928e4dc-2696-4fff-8623-6ce5e3f84fae tempest-CreateVolumesFromSnapshotTest-1597407613 None] Created reservations ['a6d5cbbf-2c78-4e1a-a0dc-e679643fa796', 'f99a709b-3313-4f45-9384-6d3add335673', 'a0dc558e-2030-4062-8e91-80beb939545f', '561047e6-bca4-459d-9f32-0e622df554d9'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:37:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e928e4dc-2696-4fff-8623-6ce5e3f84fae tempest-CreateVolumesFromSnapshotTest-1597407613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e928e4dc-2696-4fff-8623-6ce5e3f84fae tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:44 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e928e4dc-2696-4fff-8623-6ce5e3f84fae tempest-CreateVolumesFromSnapshotTest-1597407613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:44 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-e928e4dc-2696-4fff-8623-6ce5e3f84fae tempest-CreateVolumesFromSnapshotTest-1597407613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-e928e4dc-2696-4fff-8623-6ce5e3f84fae tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e928e4dc-2696-4fff-8623-6ce5e3f84fae tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:44 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:37:44 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:44 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b4d857d4-e27d-4fc2-95de-5298c23f0be7 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Acquiring lock "cinder-fe187678-f5c1-4757-a361-c54271e513e1-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:44 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b4d857d4-e27d-4fc2-95de-5298c23f0be7 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "cinder-fe187678-f5c1-4757-a361-c54271e513e1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:44 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b4d857d4-e27d-4fc2-95de-5298c23f0be7 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Acquiring lock "cinder-quobyte-fe187678-f5c1-4757-a361-c54271e513e1" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:44 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b4d857d4-e27d-4fc2-95de-5298c23f0be7 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "cinder-quobyte-fe187678-f5c1-4757-a361-c54271e513e1" acquired by "delete_volume" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:44 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd606b0-dd44-4a69-b08b-39b604e032cb]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:44 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b4d857d4-e27d-4fc2-95de-5298c23f0be7 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fe187678-f5c1-4757-a361-c54271e513e1 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:44 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fe187678-f5c1-4757-a361-c54271e513e1 Jun 02 03:37:44 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:45 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b.fe918250-297c-4d36-b24d-9a1411ba1730" returned: 0 in 1.360s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:45 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6429ffa8-3507-48e9-95dd-84238c785b3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:37:45 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 03:37:45 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Creating direct copy from snapshot {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 03:37:45 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e9cccd-2915-40f6-b665-9e3afd24defd]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:45 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b Jun 02 03:37:45 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:45 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-e928e4dc-2696-4fff-8623-6ce5e3f84fae tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.928s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:45 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-e928e4dc-2696-4fff-8623-6ce5e3f84fae tempest-CreateVolumesFromSnapshotTest-1597407613 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:37:45 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-e928e4dc-2696-4fff-8623-6ce5e3f84fae tempest-CreateVolumesFromSnapshotTest-1597407613 None] Deleted volume successfully. Jun 02 03:37:45 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-e928e4dc-2696-4fff-8623-6ce5e3f84fae tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "cinder-9df0decc-e847-4e4f-8c17-93da8ac15baa-delete_volume" released by "delete_volume" :: held 3.171s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:45 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b4d857d4-e27d-4fc2-95de-5298c23f0be7 tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fe187678-f5c1-4757-a361-c54271e513e1" returned: 0 in 1.153s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:45 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b4d857d4-e27d-4fc2-95de-5298c23f0be7 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fe187678-f5c1-4757-a361-c54271e513e1 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:45 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fe187678-f5c1-4757-a361-c54271e513e1 Jun 02 03:37:45 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:46 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b" returned: 0 in 1.181s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:46 devstack cinder-volume[86431]: DEBUG cinder.utils [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Path /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ea31c593-dc32-491e-aa2e-906370a02729 not found in is_blk_device check {{(pid=86431) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 02 03:37:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ea31c593-dc32-491e-aa2e-906370a02729 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:46 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ea31c593-dc32-491e-aa2e-906370a02729 Jun 02 03:37:46 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:46 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:37:46 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Flow 'volume_create_manager' (dfb1ffa9-0d75-41b9-b4c1-d4bcef1f1ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:46 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e55bc2-ea59-4a0d-9f8d-2fa57039426d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:46 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e55bc2-ea59-4a0d-9f8d-2fa57039426d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b15685-2ffb-46cd-9c10-efc6423c79bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1c5046daa4d4b02996a3a2a70d89613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:46Z,use_quota=True,user_id='42596673d9a544d987051478c986e3af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:46 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (831c927d-5a7d-4148-b5ce-9efcfc7c2f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:46 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (831c927d-5a7d-4148-b5ce-9efcfc7c2f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:46 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed4c2c5f-2050-468b-a305-40a05a1e5bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:46 devstack cinder-volume[86431]: DEBUG cinder.image.glance [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Creating Keystone auth plugin from conf {{(pid=86431) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 02 03:37:46 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b4d857d4-e27d-4fc2-95de-5298c23f0be7 tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-fe187678-f5c1-4757-a361-c54271e513e1" returned: 0 in 0.843s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:46 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b4d857d4-e27d-4fc2-95de-5298c23f0be7 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "cinder-quobyte-fe187678-f5c1-4757-a361-c54271e513e1" released by "delete_volume" :: held 2.063s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:46 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-b4d857d4-e27d-4fc2-95de-5298c23f0be7 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Created reservations ['f846be00-d7a4-4765-9d2e-5967817bb34c', '7018824a-1486-4580-896e-5aa4ad336c56', '68d04afd-9e01-445b-aedf-e2c2665b4c93', '4d8948a4-0339-4005-b4df-dc63a5620abe'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:37:46 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed4c2c5f-2050-468b-a305-40a05a1e5bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '52b15685-2ffb-46cd-9c10-efc6423c79bd', 'volume_name': 'volume-52b15685-2ffb-46cd-9c10-efc6423c79bd', 'volume_size': 1, 'image_id': '8e561c46-96cd-4166-a47e-25e435b9255d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e561c46-96cd-4166-a47e-25e435b9255d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e85f4b7e9bcfaa9b43dcf2c6329931ab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a1c5046daa4d4b02996a3a2a70d89613', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b7aa43e4983bed66993018f57ab7bc1af5db904231828ae92b4a698c60472924cf6bebf6bdcc1eee63df55ccc39afd703f9a0dad0445e3a62d005a6112ad6ef2', 'id': '8e561c46-96cd-4166-a47e-25e435b9255d', 'created_at': datetime.datetime(2026, 6, 2, 1, 37, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 1, 37, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e561c46-96cd-4166-a47e-25e435b9255d/file', 'properties': {}}, 'image_service': }' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:46 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af944a92-677b-4d84-a204-f666b02d4a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:46 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af944a92-677b-4d84-a204-f666b02d4a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:46 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7340bd1-75bb-4029-a0e7-1645a98c9d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:46 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Volume 52b15685-2ffb-46cd-9c10-efc6423c79bd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-52b15685-2ffb-46cd-9c10-efc6423c79bd', 'volume_size': 1, 'image_id': '8e561c46-96cd-4166-a47e-25e435b9255d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e561c46-96cd-4166-a47e-25e435b9255d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e85f4b7e9bcfaa9b43dcf2c6329931ab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a1c5046daa4d4b02996a3a2a70d89613', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b7aa43e4983bed66993018f57ab7bc1af5db904231828ae92b4a698c60472924cf6bebf6bdcc1eee63df55ccc39afd703f9a0dad0445e3a62d005a6112ad6ef2', 'id': '8e561c46-96cd-4166-a47e-25e435b9255d', 'created_at': datetime.datetime(2026, 6, 2, 1, 37, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 1, 37, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e561c46-96cd-4166-a47e-25e435b9255d/file', 'properties': {}}, 'image_service': } Jun 02 03:37:46 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Trying to clone 52b15685-2ffb-46cd-9c10-efc6423c79bd from image 8e561c46-96cd-4166-a47e-25e435b9255d at location (None, [{'url': 'file:///opt/stack/data/glance/images/8e561c46-96cd-4166-a47e-25e435b9255d', 'metadata': {}}]). {{(pid=86431) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 02 03:37:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b4d857d4-e27d-4fc2-95de-5298c23f0be7 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b4d857d4-e27d-4fc2-95de-5298c23f0be7 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:46 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b4d857d4-e27d-4fc2-95de-5298c23f0be7 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:46 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b4d857d4-e27d-4fc2-95de-5298c23f0be7 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b4d857d4-e27d-4fc2-95de-5298c23f0be7 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:46 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b4d857d4-e27d-4fc2-95de-5298c23f0be7 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:47 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-8022c4fc-fd07-4ced-8aa7-7cd977e9fb3b tempest-CreateVolumesFromSnapshotTest-1597407613 None] Acquiring lock "cinder-ab63b105-b871-40fb-b916-a851b485f3bc-delete_snapshot" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:47 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:37:47 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:47 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-8022c4fc-fd07-4ced-8aa7-7cd977e9fb3b tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "cinder-ab63b105-b871-40fb-b916-a851b485f3bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:47 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-8022c4fc-fd07-4ced-8aa7-7cd977e9fb3b tempest-CreateVolumesFromSnapshotTest-1597407613 None] Acquiring lock "cinder-quobyte-59701368-9b63-4bf7-9773-da738bfe2c99" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:47 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-8022c4fc-fd07-4ced-8aa7-7cd977e9fb3b tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "cinder-quobyte-59701368-9b63-4bf7-9773-da738bfe2c99" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:47 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-8022c4fc-fd07-4ced-8aa7-7cd977e9fb3b tempest-CreateVolumesFromSnapshotTest-1597407613 None] Acquiring lock "cinder-quobyte-ab63b105-b871-40fb-b916-a851b485f3bc" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:47 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-8022c4fc-fd07-4ced-8aa7-7cd977e9fb3b tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "cinder-quobyte-ab63b105-b871-40fb-b916-a851b485f3bc" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-8022c4fc-fd07-4ced-8aa7-7cd977e9fb3b tempest-CreateVolumesFromSnapshotTest-1597407613 None] Deleting offline snapshot ab63b105-b871-40fb-b916-a851b485f3bc of volume 59701368-9b63-4bf7-9773-da738bfe2c99 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:37:47 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-8022c4fc-fd07-4ced-8aa7-7cd977e9fb3b tempest-CreateVolumesFromSnapshotTest-1597407613 None] snapshot_file for this snap is: volume-59701368-9b63-4bf7-9773-da738bfe2c99.ab63b105-b871-40fb-b916-a851b485f3bc {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:37:47 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8e561c46-96cd-4166-a47e-25e435b9255d_hkmb20pedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86431) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 02 03:37:47 devstack cinder-volume[86431]: INFO cinder.image.image_utils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Image download 0.00 MB at 0.00 MB/s Jun 02 03:37:47 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd5142b-d785-4736-9261-68375df3a04a]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8022c4fc-fd07-4ced-8aa7-7cd977e9fb3b tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99.ab63b105-b871-40fb-b916-a851b485f3bc {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:47 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b0a7a7-834d-439a-a615-0fb1a48f72ee]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:47 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e561c46-96cd-4166-a47e-25e435b9255d_hkmb20pedevstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:47 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99.ab63b105-b871-40fb-b916-a851b485f3bc Jun 02 03:37:47 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:47 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e561c46-96cd-4166-a47e-25e435b9255d_hkmb20pedevstack@QuobyteHD Jun 02 03:37:47 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:48 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b4d857d4-e27d-4fc2-95de-5298c23f0be7 tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 1.695s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:48 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-b4d857d4-e27d-4fc2-95de-5298c23f0be7 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:37:48 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-b4d857d4-e27d-4fc2-95de-5298c23f0be7 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Deleted volume successfully. Jun 02 03:37:48 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b4d857d4-e27d-4fc2-95de-5298c23f0be7 tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "cinder-fe187678-f5c1-4757-a361-c54271e513e1-delete_volume" released by "delete_volume" :: held 4.182s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:48 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8022c4fc-fd07-4ced-8aa7-7cd977e9fb3b tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99.ab63b105-b871-40fb-b916-a851b485f3bc" returned: 0 in 1.788s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:48 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-8022c4fc-fd07-4ced-8aa7-7cd977e9fb3b tempest-CreateVolumesFromSnapshotTest-1597407613 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59701368-9b63-4bf7-9773-da738bfe2c99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:37:48 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[378109ca-aa2e-49a7-8a0a-2276e53e3e41]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:48 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8022c4fc-fd07-4ced-8aa7-7cd977e9fb3b tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:49 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99 Jun 02 03:37:49 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:49 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e561c46-96cd-4166-a47e-25e435b9255d_hkmb20pedevstack@QuobyteHD" returned: 0 in 2.188s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:49 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e561c46-96cd-4166-a47e-25e435b9255d_hkmb20pedevstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:49 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e561c46-96cd-4166-a47e-25e435b9255d_hkmb20pedevstack@QuobyteHD Jun 02 03:37:49 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:50 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e561c46-96cd-4166-a47e-25e435b9255d_hkmb20pedevstack@QuobyteHD" returned: 1 in 1.465s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:50 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e561c46-96cd-4166-a47e-25e435b9255d_hkmb20pedevstack@QuobyteHD' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:37:50 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Temporary image 8e561c46-96cd-4166-a47e-25e435b9255d is fetched for user 42596673d9a544d987051478c986e3af. {{(pid=86431) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 02 03:37:51 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8022c4fc-fd07-4ced-8aa7-7cd977e9fb3b tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99" returned: 0 in 2.064s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8022c4fc-fd07-4ced-8aa7-7cd977e9fb3b tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99.ab63b105-b871-40fb-b916-a851b485f3bc {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:51 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99.ab63b105-b871-40fb-b916-a851b485f3bc Jun 02 03:37:51 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:51 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fadb2d-cea6-4bd5-af80-ee8b7c6f71ef]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:51 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e561c46-96cd-4166-a47e-25e435b9255d_hkmb20pedevstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:51 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e561c46-96cd-4166-a47e-25e435b9255d_hkmb20pedevstack@QuobyteHD Jun 02 03:37:51 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:52 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e561c46-96cd-4166-a47e-25e435b9255d_hkmb20pedevstack@QuobyteHD" returned: 0 in 1.284s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:52 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e561c46-96cd-4166-a47e-25e435b9255d_hkmb20pedevstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:52 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e561c46-96cd-4166-a47e-25e435b9255d_hkmb20pedevstack@QuobyteHD Jun 02 03:37:52 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:53 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8022c4fc-fd07-4ced-8aa7-7cd977e9fb3b tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99.ab63b105-b871-40fb-b916-a851b485f3bc" returned: 0 in 2.028s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8022c4fc-fd07-4ced-8aa7-7cd977e9fb3b tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99.ab63b105-b871-40fb-b916-a851b485f3bc {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:53 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ea31c593-dc32-491e-aa2e-906370a02729" returned: 0 in 6.782s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:53 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99.ab63b105-b871-40fb-b916-a851b485f3bc Jun 02 03:37:53 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:53 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff649a0e-6e43-434b-979a-128e245d6146]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:53 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b Jun 02 03:37:53 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:53 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e561c46-96cd-4166-a47e-25e435b9255d_hkmb20pedevstack@QuobyteHD" returned: 1 in 1.236s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e561c46-96cd-4166-a47e-25e435b9255d_hkmb20pedevstack@QuobyteHD' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:37:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:53 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:53 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8022c4fc-fd07-4ced-8aa7-7cd977e9fb3b tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99.ab63b105-b871-40fb-b916-a851b485f3bc" returned: 0 in 0.691s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:53 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-8022c4fc-fd07-4ced-8aa7-7cd977e9fb3b tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "cinder-quobyte-ab63b105-b871-40fb-b916-a851b485f3bc" released by "_delete_snapshot" :: held 6.769s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:53 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-8022c4fc-fd07-4ced-8aa7-7cd977e9fb3b tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "cinder-quobyte-59701368-9b63-4bf7-9773-da738bfe2c99" released by "delete_snapshot" :: held 6.802s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:53 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-8022c4fc-fd07-4ced-8aa7-7cd977e9fb3b tempest-CreateVolumesFromSnapshotTest-1597407613 None] Created reservations ['52161a81-0dd4-4d2c-a258-4ea3c66ad9c8', '62ea61db-edf1-4d83-9be6-018d58a85cb8', '2f549297-7207-404e-b4b6-c5fd336a8bf4', 'ebf98b92-d142-46f3-aea9-beeadfc7afc8'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:37:53 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-8022c4fc-fd07-4ced-8aa7-7cd977e9fb3b tempest-CreateVolumesFromSnapshotTest-1597407613 None] Delete snapshot completed successfully. Jun 02 03:37:53 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-8022c4fc-fd07-4ced-8aa7-7cd977e9fb3b tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "cinder-ab63b105-b871-40fb-b916-a851b485f3bc-delete_snapshot" released by "delete_snapshot" :: held 6.949s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:54 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b" returned: 0 in 0.980s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:54 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Image conversion details: src /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b, size 1024.00 MB, duration 6.78 sec, destination /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ea31c593-dc32-491e-aa2e-906370a02729 {{(pid=86431) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 02 03:37:54 devstack cinder-volume[86431]: INFO cinder.image.image_utils [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Converted 1024.00 MB image at 150.96 MB/s Jun 02 03:37:54 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ea31c593-dc32-491e-aa2e-906370a02729 is being set with open permissions: ugo+rw Jun 02 03:37:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ea31c593-dc32-491e-aa2e-906370a02729 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:54 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ea31c593-dc32-491e-aa2e-906370a02729 Jun 02 03:37:54 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:54 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ea31c593-dc32-491e-aa2e-906370a02729" returned: 0 in 0.623s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:54 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-9316e9cb-ed79-42aa-b313-195fa89fd9fd tempest-CreateVolumesFromSnapshotTest-1597407613 None] Acquiring lock "cinder-59701368-9b63-4bf7-9773-da738bfe2c99-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:54 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Lock "cinder-quobyte-ea31c593-dc32-491e-aa2e-906370a02729" released by "_copy_volume_from_snapshot" :: held 11.114s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:54 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Lock "cinder-quobyte-fe918250-297c-4d36-b24d-9a1411ba1730-ea31c593-dc32-491e-aa2e-906370a02729" released by "_create_volume_from_snapshot" :: held 11.174s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.202s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.158s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:54 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b15685-2ffb-46cd-9c10-efc6423c79bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1c5046daa4d4b02996a3a2a70d89613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:37:46Z,use_quota=True,user_id='42596673d9a544d987051478c986e3af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:37:54 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Creating volume 52b15685-2ffb-46cd-9c10-efc6423c79bd {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:37:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:54 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:54 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:54 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:37:54 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:37:54 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-52b15685-2ffb-46cd-9c10-efc6423c79bd 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:54 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-9316e9cb-ed79-42aa-b313-195fa89fd9fd tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "cinder-59701368-9b63-4bf7-9773-da738bfe2c99-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:54 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-52b15685-2ffb-46cd-9c10-efc6423c79bd 1073741824 Jun 02 03:37:54 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:54 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1637854d-b931-4bfa-876e-c9138321f57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea31c593-dc32-491e-aa2e-906370a02729', 'volume_size': 1, 'snapshot_id': 'fe918250-297c-4d36-b24d-9a1411ba1730'}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:54 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de50073-73ae-44cd-83cf-4f9258de66fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:37:54 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Volume volume-ea31c593-dc32-491e-aa2e-906370a02729 (ea31c593-dc32-491e-aa2e-906370a02729): created successfully Jun 02 03:37:54 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de50073-73ae-44cd-83cf-4f9258de66fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:37:54 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Flow 'volume_create_manager' (d0fec033-282f-464c-9eeb-f6bae0ca0eeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:37:54 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-9316e9cb-ed79-42aa-b313-195fa89fd9fd tempest-CreateVolumesFromSnapshotTest-1597407613 None] Acquiring lock "cinder-quobyte-59701368-9b63-4bf7-9773-da738bfe2c99" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:54 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-89ad03d0-00b2-4873-9385-33a6007ed539 tempest-VolumeDependencyTests-1086620720 None] Created volume successfully. Jun 02 03:37:54 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-9316e9cb-ed79-42aa-b313-195fa89fd9fd tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "cinder-quobyte-59701368-9b63-4bf7-9773-da738bfe2c99" acquired by "delete_volume" :: waited 0.028s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:55 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc1004d-3f93-4537-804b-ce42b9f565ed]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9316e9cb-ed79-42aa-b313-195fa89fd9fd tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:55 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99 Jun 02 03:37:55 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:55 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-52b15685-2ffb-46cd-9c10-efc6423c79bd 1073741824" returned: 0 in 0.929s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-52b15685-2ffb-46cd-9c10-efc6423c79bd {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:55 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-52b15685-2ffb-46cd-9c10-efc6423c79bd Jun 02 03:37:55 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:55 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9316e9cb-ed79-42aa-b313-195fa89fd9fd tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99" returned: 0 in 0.830s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:55 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9316e9cb-ed79-42aa-b313-195fa89fd9fd tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:55 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-46fa99b2-2ec6-486f-8751-785e1d27e9e5 tempest-VolumeDependencyTests-1086620720 None] Acquiring lock "cinder-fe918250-297c-4d36-b24d-9a1411ba1730-delete_snapshot" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:55 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99 Jun 02 03:37:55 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:55 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-46fa99b2-2ec6-486f-8751-785e1d27e9e5 tempest-VolumeDependencyTests-1086620720 None] Lock "cinder-fe918250-297c-4d36-b24d-9a1411ba1730-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:55 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-46fa99b2-2ec6-486f-8751-785e1d27e9e5 tempest-VolumeDependencyTests-1086620720 None] Acquiring lock "cinder-quobyte-6429ffa8-3507-48e9-95dd-84238c785b3b" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:55 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-46fa99b2-2ec6-486f-8751-785e1d27e9e5 tempest-VolumeDependencyTests-1086620720 None] Lock "cinder-quobyte-6429ffa8-3507-48e9-95dd-84238c785b3b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:55 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-46fa99b2-2ec6-486f-8751-785e1d27e9e5 tempest-VolumeDependencyTests-1086620720 None] Acquiring lock "cinder-quobyte-fe918250-297c-4d36-b24d-9a1411ba1730" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:37:55 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-46fa99b2-2ec6-486f-8751-785e1d27e9e5 tempest-VolumeDependencyTests-1086620720 None] Lock "cinder-quobyte-fe918250-297c-4d36-b24d-9a1411ba1730" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:37:55 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-46fa99b2-2ec6-486f-8751-785e1d27e9e5 tempest-VolumeDependencyTests-1086620720 None] Deleting offline snapshot fe918250-297c-4d36-b24d-9a1411ba1730 of volume 6429ffa8-3507-48e9-95dd-84238c785b3b {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:37:55 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-46fa99b2-2ec6-486f-8751-785e1d27e9e5 tempest-VolumeDependencyTests-1086620720 None] snapshot_file for this snap is: volume-6429ffa8-3507-48e9-95dd-84238c785b3b.fe918250-297c-4d36-b24d-9a1411ba1730 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:37:56 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[715d54a2-c887-4119-8c4c-088b307830e4]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-46fa99b2-2ec6-486f-8751-785e1d27e9e5 tempest-VolumeDependencyTests-1086620720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b.fe918250-297c-4d36-b24d-9a1411ba1730 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:56 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b.fe918250-297c-4d36-b24d-9a1411ba1730 Jun 02 03:37:56 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:56 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-52b15685-2ffb-46cd-9c10-efc6423c79bd" returned: 0 in 0.772s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:56 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:37:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:56 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9316e9cb-ed79-42aa-b313-195fa89fd9fd tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-59701368-9b63-4bf7-9773-da738bfe2c99" returned: 0 in 0.726s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:56 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-9316e9cb-ed79-42aa-b313-195fa89fd9fd tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "cinder-quobyte-59701368-9b63-4bf7-9773-da738bfe2c99" released by "delete_volume" :: held 1.628s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:56 devstack cinder-volume[86431]: DEBUG cinder.volume.volume_utils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Attempting download of 8e561c46-96cd-4166-a47e-25e435b9255d ((None, [{'url': 'file:///opt/stack/data/glance/images/8e561c46-96cd-4166-a47e-25e435b9255d', 'metadata': {}}])) to volume 52b15685-2ffb-46cd-9c10-efc6423c79bd. {{(pid=86431) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 02 03:37:56 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[0324888e-efc3-4af1-aebf-e5e21c9cba7d]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e561c46-96cd-4166-a47e-25e435b9255d_8m21239c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:56 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-9316e9cb-ed79-42aa-b313-195fa89fd9fd tempest-CreateVolumesFromSnapshotTest-1597407613 None] Created reservations ['762dfde8-89a1-4c5d-a77c-c0ee7c404137', 'da46dbe2-9fdd-4462-ba1a-656baba75059', '239d6f58-e7a2-444b-ab18-2ba1244aa0e0', '23378a02-decd-4b3e-8649-990fca88ef84'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:37:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9316e9cb-ed79-42aa-b313-195fa89fd9fd tempest-CreateVolumesFromSnapshotTest-1597407613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:37:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9316e9cb-ed79-42aa-b313-195fa89fd9fd tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:37:56 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9316e9cb-ed79-42aa-b313-195fa89fd9fd tempest-CreateVolumesFromSnapshotTest-1597407613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:37:56 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-9316e9cb-ed79-42aa-b313-195fa89fd9fd tempest-CreateVolumesFromSnapshotTest-1597407613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:37:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-9316e9cb-ed79-42aa-b313-195fa89fd9fd tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:37:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9316e9cb-ed79-42aa-b313-195fa89fd9fd tempest-CreateVolumesFromSnapshotTest-1597407613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:56 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e561c46-96cd-4166-a47e-25e435b9255d_8m21239c Jun 02 03:37:56 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:56 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:37:56 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:56 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-46fa99b2-2ec6-486f-8751-785e1d27e9e5 tempest-VolumeDependencyTests-1086620720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b.fe918250-297c-4d36-b24d-9a1411ba1730" returned: 0 in 0.836s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:56 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-46fa99b2-2ec6-486f-8751-785e1d27e9e5 tempest-VolumeDependencyTests-1086620720 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6429ffa8-3507-48e9-95dd-84238c785b3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:37:56 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb4c940-6bcb-49a9-b64e-ba314dfefede]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:56 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-46fa99b2-2ec6-486f-8751-785e1d27e9e5 tempest-VolumeDependencyTests-1086620720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:57 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b Jun 02 03:37:57 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:57 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8e561c46-96cd-4166-a47e-25e435b9255d_8m21239c" returned: 0 in 0.972s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e561c46-96cd-4166-a47e-25e435b9255d_8m21239c {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:57 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-9316e9cb-ed79-42aa-b313-195fa89fd9fd tempest-CreateVolumesFromSnapshotTest-1597407613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.960s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:57 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-9316e9cb-ed79-42aa-b313-195fa89fd9fd tempest-CreateVolumesFromSnapshotTest-1597407613 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:37:57 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-9316e9cb-ed79-42aa-b313-195fa89fd9fd tempest-CreateVolumesFromSnapshotTest-1597407613 None] Deleted volume successfully. Jun 02 03:37:57 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e561c46-96cd-4166-a47e-25e435b9255d_8m21239c Jun 02 03:37:57 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:57 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-9316e9cb-ed79-42aa-b313-195fa89fd9fd tempest-CreateVolumesFromSnapshotTest-1597407613 None] Lock "cinder-59701368-9b63-4bf7-9773-da738bfe2c99-delete_volume" released by "delete_volume" :: held 2.965s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:57 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-46fa99b2-2ec6-486f-8751-785e1d27e9e5 tempest-VolumeDependencyTests-1086620720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b" returned: 0 in 0.976s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:57 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-46fa99b2-2ec6-486f-8751-785e1d27e9e5 tempest-VolumeDependencyTests-1086620720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b.fe918250-297c-4d36-b24d-9a1411ba1730 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:57 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b.fe918250-297c-4d36-b24d-9a1411ba1730 Jun 02 03:37:57 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:58 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e561c46-96cd-4166-a47e-25e435b9255d_8m21239c" returned: 1 in 0.823s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8e561c46-96cd-4166-a47e-25e435b9255d_8m21239c' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:37:58 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9d9a85-d2d3-4057-bb26-223e89cb572e]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:37:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e561c46-96cd-4166-a47e-25e435b9255d_hkmb20pedevstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:58 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e561c46-96cd-4166-a47e-25e435b9255d_hkmb20pedevstack@QuobyteHD Jun 02 03:37:58 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:58 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-46fa99b2-2ec6-486f-8751-785e1d27e9e5 tempest-VolumeDependencyTests-1086620720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b.fe918250-297c-4d36-b24d-9a1411ba1730" returned: 0 in 0.930s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:58 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-46fa99b2-2ec6-486f-8751-785e1d27e9e5 tempest-VolumeDependencyTests-1086620720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b.fe918250-297c-4d36-b24d-9a1411ba1730 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:58 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b.fe918250-297c-4d36-b24d-9a1411ba1730 Jun 02 03:37:58 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:59 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8e561c46-96cd-4166-a47e-25e435b9255d_hkmb20pedevstack@QuobyteHD" returned: 0 in 1.101s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e561c46-96cd-4166-a47e-25e435b9255d_hkmb20pedevstack@QuobyteHD {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:37:59 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Jun 02 03:37:59 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-46fa99b2-2ec6-486f-8751-785e1d27e9e5 tempest-VolumeDependencyTests-1086620720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b.fe918250-297c-4d36-b24d-9a1411ba1730" returned: 0 in 0.820s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:37:59 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e561c46-96cd-4166-a47e-25e435b9255d_hkmb20pedevstack@QuobyteHD Jun 02 03:37:59 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:37:59 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-46fa99b2-2ec6-486f-8751-785e1d27e9e5 tempest-VolumeDependencyTests-1086620720 None] Lock "cinder-quobyte-fe918250-297c-4d36-b24d-9a1411ba1730" released by "_delete_snapshot" :: held 3.763s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:59 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-46fa99b2-2ec6-486f-8751-785e1d27e9e5 tempest-VolumeDependencyTests-1086620720 None] Lock "cinder-quobyte-6429ffa8-3507-48e9-95dd-84238c785b3b" released by "delete_snapshot" :: held 3.788s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:37:59 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-46fa99b2-2ec6-486f-8751-785e1d27e9e5 tempest-VolumeDependencyTests-1086620720 None] Created reservations ['35d79422-a882-46d0-9d78-bda3f5e98d36', 'f877dbbc-9fed-4a73-b05a-fd00799d65c9', '79ad03f5-1b5a-4e61-854b-d89be959a48d', '334594fe-4e5f-4c80-814a-173c8fedce99'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:37:59 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-46fa99b2-2ec6-486f-8751-785e1d27e9e5 tempest-VolumeDependencyTests-1086620720 None] Delete snapshot completed successfully. Jun 02 03:37:59 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-46fa99b2-2ec6-486f-8751-785e1d27e9e5 tempest-VolumeDependencyTests-1086620720 None] Lock "cinder-fe918250-297c-4d36-b24d-9a1411ba1730-delete_snapshot" released by "delete_snapshot" :: held 4.009s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:38:00 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b43256f2-60de-4643-a511-8014445d6e3b tempest-VolumeDependencyTests-1086620720 None] Acquiring lock "cinder-6429ffa8-3507-48e9-95dd-84238c785b3b-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:38:00 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b43256f2-60de-4643-a511-8014445d6e3b tempest-VolumeDependencyTests-1086620720 None] Lock "cinder-6429ffa8-3507-48e9-95dd-84238c785b3b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:38:00 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:UPDATE=227,cinder:SELECT=163,cinder:INSERT=64,cinder:DELETE=19 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:38:00 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b43256f2-60de-4643-a511-8014445d6e3b tempest-VolumeDependencyTests-1086620720 None] Acquiring lock "cinder-quobyte-6429ffa8-3507-48e9-95dd-84238c785b3b" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:38:00 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b43256f2-60de-4643-a511-8014445d6e3b tempest-VolumeDependencyTests-1086620720 None] Lock "cinder-quobyte-6429ffa8-3507-48e9-95dd-84238c785b3b" acquired by "delete_volume" :: waited 0.033s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:38:00 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e8347e-c72e-48c6-ab97-f108278035cf]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:38:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b43256f2-60de-4643-a511-8014445d6e3b tempest-VolumeDependencyTests-1086620720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:00 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e561c46-96cd-4166-a47e-25e435b9255d_hkmb20pedevstack@QuobyteHD" returned: 1 in 0.932s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8e561c46-96cd-4166-a47e-25e435b9255d_hkmb20pedevstack@QuobyteHD' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:38:00 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] 8e561c46-96cd-4166-a47e-25e435b9255d was raw, converting to raw {{(pid=86431) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 02 03:38:00 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8e561c46-96cd-4166-a47e-25e435b9255d_hkmb20pedevstack@QuobyteHD /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-52b15685-2ffb-46cd-9c10-efc6423c79bd {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:00 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8e561c46-96cd-4166-a47e-25e435b9255d_hkmb20pedevstack@QuobyteHD /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-52b15685-2ffb-46cd-9c10-efc6423c79bd Jun 02 03:38:00 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:00 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b Jun 02 03:38:00 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:01 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-489f4db5-51f8-4597-a190-b02d92d79222 tempest-CinderUnicodeTest-789823191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:38:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-489f4db5-51f8-4597-a190-b02d92d79222 tempest-CinderUnicodeTest-789823191 None] Flow 'volume_create_manager' (863ef416-dbfe-423d-83b2-6d5e15ef4828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:38:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-489f4db5-51f8-4597-a190-b02d92d79222 tempest-CinderUnicodeTest-789823191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d5fee3-69f9-4ad0-994b-ca29836882ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:38:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-489f4db5-51f8-4597-a190-b02d92d79222 tempest-CinderUnicodeTest-789823191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d5fee3-69f9-4ad0-994b-ca29836882ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b53877c9-fc73-4c2e-b28c-b3aa146787c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd4edd9f18b4e26bfe06a219746aad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:38:01Z,use_quota=True,user_id='f4f6815a117b4813ad0f5dd773dafc98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:38:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-489f4db5-51f8-4597-a190-b02d92d79222 tempest-CinderUnicodeTest-789823191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (742c17f0-80a4-4c18-b6fc-b7dd3db52ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:38:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-489f4db5-51f8-4597-a190-b02d92d79222 tempest-CinderUnicodeTest-789823191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (742c17f0-80a4-4c18-b6fc-b7dd3db52ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:38:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-489f4db5-51f8-4597-a190-b02d92d79222 tempest-CinderUnicodeTest-789823191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1827506-ebfc-4986-8f8f-7352af9d2a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:38:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-489f4db5-51f8-4597-a190-b02d92d79222 tempest-CinderUnicodeTest-789823191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1827506-ebfc-4986-8f8f-7352af9d2a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b53877c9-fc73-4c2e-b28c-b3aa146787c7', 'volume_name': 'volume-b53877c9-fc73-4c2e-b28c-b3aa146787c7', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:38:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-489f4db5-51f8-4597-a190-b02d92d79222 tempest-CinderUnicodeTest-789823191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8749e77f-6707-4607-938e-3f7cd56d5aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:38:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-489f4db5-51f8-4597-a190-b02d92d79222 tempest-CinderUnicodeTest-789823191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8749e77f-6707-4607-938e-3f7cd56d5aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:38:01 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-489f4db5-51f8-4597-a190-b02d92d79222 tempest-CinderUnicodeTest-789823191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c431f7e1-7b96-487d-9ca9-45b619c276a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:38:01 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-489f4db5-51f8-4597-a190-b02d92d79222 tempest-CinderUnicodeTest-789823191 None] Volume b53877c9-fc73-4c2e-b28c-b3aa146787c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b53877c9-fc73-4c2e-b28c-b3aa146787c7', 'volume_size': 1} Jun 02 03:38:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-489f4db5-51f8-4597-a190-b02d92d79222 tempest-CinderUnicodeTest-789823191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:38:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-489f4db5-51f8-4597-a190-b02d92d79222 tempest-CinderUnicodeTest-789823191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:38:01 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-489f4db5-51f8-4597-a190-b02d92d79222 tempest-CinderUnicodeTest-789823191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b53877c9-fc73-4c2e-b28c-b3aa146787c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd4edd9f18b4e26bfe06a219746aad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:38:01Z,use_quota=True,user_id='f4f6815a117b4813ad0f5dd773dafc98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:38:01 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-489f4db5-51f8-4597-a190-b02d92d79222 tempest-CinderUnicodeTest-789823191 None] Creating volume b53877c9-fc73-4c2e-b28c-b3aa146787c7 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:38:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-489f4db5-51f8-4597-a190-b02d92d79222 tempest-CinderUnicodeTest-789823191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:38:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-489f4db5-51f8-4597-a190-b02d92d79222 tempest-CinderUnicodeTest-789823191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:38:01 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-489f4db5-51f8-4597-a190-b02d92d79222 tempest-CinderUnicodeTest-789823191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:38:01 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-489f4db5-51f8-4597-a190-b02d92d79222 tempest-CinderUnicodeTest-789823191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:38:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-489f4db5-51f8-4597-a190-b02d92d79222 tempest-CinderUnicodeTest-789823191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:38:01 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-489f4db5-51f8-4597-a190-b02d92d79222 tempest-CinderUnicodeTest-789823191 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:38:01 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-489f4db5-51f8-4597-a190-b02d92d79222 tempest-CinderUnicodeTest-789823191 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:38:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-489f4db5-51f8-4597-a190-b02d92d79222 tempest-CinderUnicodeTest-789823191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b53877c9-fc73-4c2e-b28c-b3aa146787c7 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:01 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b53877c9-fc73-4c2e-b28c-b3aa146787c7 1073741824 Jun 02 03:38:01 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:01 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b43256f2-60de-4643-a511-8014445d6e3b tempest-VolumeDependencyTests-1086620720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b" returned: 0 in 1.061s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b43256f2-60de-4643-a511-8014445d6e3b tempest-VolumeDependencyTests-1086620720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:01 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b Jun 02 03:38:01 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:01 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8e561c46-96cd-4166-a47e-25e435b9255d_hkmb20pedevstack@QuobyteHD /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-52b15685-2ffb-46cd-9c10-efc6423c79bd" returned: 0 in 1.109s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:01 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8e561c46-96cd-4166-a47e-25e435b9255d_hkmb20pedevstack@QuobyteHD, size 0.00 MB, duration 1.11 sec, destination /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-52b15685-2ffb-46cd-9c10-efc6423c79bd {{(pid=86431) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 02 03:38:01 devstack cinder-volume[86431]: INFO cinder.image.image_utils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Converted 0.00 MB image at 0.00 MB/s Jun 02 03:38:01 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-52b15685-2ffb-46cd-9c10-efc6423c79bd 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:01 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-52b15685-2ffb-46cd-9c10-efc6423c79bd 1G Jun 02 03:38:01 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:02 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b43256f2-60de-4643-a511-8014445d6e3b tempest-VolumeDependencyTests-1086620720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-6429ffa8-3507-48e9-95dd-84238c785b3b" returned: 0 in 0.818s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:02 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b43256f2-60de-4643-a511-8014445d6e3b tempest-VolumeDependencyTests-1086620720 None] Lock "cinder-quobyte-6429ffa8-3507-48e9-95dd-84238c785b3b" released by "delete_volume" :: held 1.973s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:38:02 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-52b15685-2ffb-46cd-9c10-efc6423c79bd 1G" returned: 0 in 0.803s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:02 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-b43256f2-60de-4643-a511-8014445d6e3b tempest-VolumeDependencyTests-1086620720 None] Created reservations ['cb2f099f-638a-4886-b378-d81a329ad8d4', '54ebd106-ad14-43ab-aa66-6767183df66f', 'fb9f8226-f6d3-4f85-a378-4b8fb6a678a1', '03628c49-5fc8-471d-a51d-b6f020eca446'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:38:02 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[654d29f7-c064-4d5c-8594-c04e8e46194c]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:38:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-52b15685-2ffb-46cd-9c10-efc6423c79bd {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:02 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-489f4db5-51f8-4597-a190-b02d92d79222 tempest-CinderUnicodeTest-789823191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b53877c9-fc73-4c2e-b28c-b3aa146787c7 1073741824" returned: 0 in 1.156s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b43256f2-60de-4643-a511-8014445d6e3b tempest-VolumeDependencyTests-1086620720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:38:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b43256f2-60de-4643-a511-8014445d6e3b tempest-VolumeDependencyTests-1086620720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:38:02 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b43256f2-60de-4643-a511-8014445d6e3b tempest-VolumeDependencyTests-1086620720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:38:02 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b43256f2-60de-4643-a511-8014445d6e3b tempest-VolumeDependencyTests-1086620720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:38:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b43256f2-60de-4643-a511-8014445d6e3b tempest-VolumeDependencyTests-1086620720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:38:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b43256f2-60de-4643-a511-8014445d6e3b tempest-VolumeDependencyTests-1086620720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-489f4db5-51f8-4597-a190-b02d92d79222 tempest-CinderUnicodeTest-789823191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b53877c9-fc73-4c2e-b28c-b3aa146787c7 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:02 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:38:02 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:02 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b53877c9-fc73-4c2e-b28c-b3aa146787c7 Jun 02 03:38:02 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:02 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-52b15685-2ffb-46cd-9c10-efc6423c79bd Jun 02 03:38:02 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:02 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0b409d1b-c1e4-484b-9e91-06f07c7556cc tempest-VolumeDependencyTests-1086620720 None] Acquiring lock "cinder-ea31c593-dc32-491e-aa2e-906370a02729-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:38:02 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0b409d1b-c1e4-484b-9e91-06f07c7556cc tempest-VolumeDependencyTests-1086620720 None] Lock "cinder-ea31c593-dc32-491e-aa2e-906370a02729-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:38:02 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0b409d1b-c1e4-484b-9e91-06f07c7556cc tempest-VolumeDependencyTests-1086620720 None] Acquiring lock "cinder-quobyte-ea31c593-dc32-491e-aa2e-906370a02729" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:38:02 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0b409d1b-c1e4-484b-9e91-06f07c7556cc tempest-VolumeDependencyTests-1086620720 None] Lock "cinder-quobyte-ea31c593-dc32-491e-aa2e-906370a02729" acquired by "delete_volume" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:38:02 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b3ecbc-a820-4a4b-aaf7-bf043e2a3b2a]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:38:02 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0b409d1b-c1e4-484b-9e91-06f07c7556cc tempest-VolumeDependencyTests-1086620720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ea31c593-dc32-491e-aa2e-906370a02729 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:02 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ea31c593-dc32-491e-aa2e-906370a02729 Jun 02 03:38:02 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:03 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-489f4db5-51f8-4597-a190-b02d92d79222 tempest-CinderUnicodeTest-789823191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b53877c9-fc73-4c2e-b28c-b3aa146787c7" returned: 0 in 0.751s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:03 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-489f4db5-51f8-4597-a190-b02d92d79222 tempest-CinderUnicodeTest-789823191 None] <== create_volume: return (1989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:38:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-489f4db5-51f8-4597-a190-b02d92d79222 tempest-CinderUnicodeTest-789823191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.994s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:38:03 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-489f4db5-51f8-4597-a190-b02d92d79222 tempest-CinderUnicodeTest-789823191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c431f7e1-7b96-487d-9ca9-45b619c276a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b53877c9-fc73-4c2e-b28c-b3aa146787c7', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:38:03 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-489f4db5-51f8-4597-a190-b02d92d79222 tempest-CinderUnicodeTest-789823191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9d6e338-0e9c-48dd-ace8-d9bfcbe04b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:38:03 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-489f4db5-51f8-4597-a190-b02d92d79222 tempest-CinderUnicodeTest-789823191 None] Volume volume-b53877c9-fc73-4c2e-b28c-b3aa146787c7 (b53877c9-fc73-4c2e-b28c-b3aa146787c7): created successfully Jun 02 03:38:03 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-489f4db5-51f8-4597-a190-b02d92d79222 tempest-CinderUnicodeTest-789823191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9d6e338-0e9c-48dd-ace8-d9bfcbe04b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:38:03 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-489f4db5-51f8-4597-a190-b02d92d79222 tempest-CinderUnicodeTest-789823191 None] Flow 'volume_create_manager' (863ef416-dbfe-423d-83b2-6d5e15ef4828) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:38:03 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-489f4db5-51f8-4597-a190-b02d92d79222 tempest-CinderUnicodeTest-789823191 None] Created volume successfully. Jun 02 03:38:03 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-52b15685-2ffb-46cd-9c10-efc6423c79bd" returned: 0 in 0.963s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-52b15685-2ffb-46cd-9c10-efc6423c79bd {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:03 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b43256f2-60de-4643-a511-8014445d6e3b tempest-VolumeDependencyTests-1086620720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.935s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:03 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-b43256f2-60de-4643-a511-8014445d6e3b tempest-VolumeDependencyTests-1086620720 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:38:03 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-b43256f2-60de-4643-a511-8014445d6e3b tempest-VolumeDependencyTests-1086620720 None] Deleted volume successfully. Jun 02 03:38:03 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b43256f2-60de-4643-a511-8014445d6e3b tempest-VolumeDependencyTests-1086620720 None] Lock "cinder-6429ffa8-3507-48e9-95dd-84238c785b3b-delete_volume" released by "delete_volume" :: held 3.226s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:38:03 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-52b15685-2ffb-46cd-9c10-efc6423c79bd Jun 02 03:38:03 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:03 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0b409d1b-c1e4-484b-9e91-06f07c7556cc tempest-VolumeDependencyTests-1086620720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ea31c593-dc32-491e-aa2e-906370a02729" returned: 0 in 1.051s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:03 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0b409d1b-c1e4-484b-9e91-06f07c7556cc tempest-VolumeDependencyTests-1086620720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ea31c593-dc32-491e-aa2e-906370a02729 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:03 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ea31c593-dc32-491e-aa2e-906370a02729 Jun 02 03:38:03 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:04 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-52b15685-2ffb-46cd-9c10-efc6423c79bd" returned: 1 in 0.838s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-52b15685-2ffb-46cd-9c10-efc6423c79bd' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:38:04 devstack cinder-volume[86431]: DEBUG cinder.volume.volume_utils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Downloaded image 8e561c46-96cd-4166-a47e-25e435b9255d ((None, [{'url': 'file:///opt/stack/data/glance/images/8e561c46-96cd-4166-a47e-25e435b9255d', 'metadata': {}}])) to volume 52b15685-2ffb-46cd-9c10-efc6423c79bd successfully. {{(pid=86431) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 02 03:38:04 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Temporary image 8e561c46-96cd-4166-a47e-25e435b9255d for user 42596673d9a544d987051478c986e3af is deleted. {{(pid=86431) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 02 03:38:04 devstack cinder-volume[86431]: DEBUG cinder.volume.volume_utils [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Marking volume 52b15685-2ffb-46cd-9c10-efc6423c79bd as bootable. {{(pid=86431) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 02 03:38:04 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Copying metadata from image 8e561c46-96cd-4166-a47e-25e435b9255d to 52b15685-2ffb-46cd-9c10-efc6423c79bd. {{(pid=86431) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 02 03:38:04 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Creating volume glance metadata for volume 52b15685-2ffb-46cd-9c10-efc6423c79bd backed by image 8e561c46-96cd-4166-a47e-25e435b9255d with: {'image_id': '8e561c46-96cd-4166-a47e-25e435b9255d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e85f4b7e9bcfaa9b43dcf2c6329931ab', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86431) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 02 03:38:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7340bd1-75bb-4029-a0e7-1645a98c9d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52b15685-2ffb-46cd-9c10-efc6423c79bd', 'volume_size': 1, 'image_id': '8e561c46-96cd-4166-a47e-25e435b9255d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8e561c46-96cd-4166-a47e-25e435b9255d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e85f4b7e9bcfaa9b43dcf2c6329931ab', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a1c5046daa4d4b02996a3a2a70d89613', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b7aa43e4983bed66993018f57ab7bc1af5db904231828ae92b4a698c60472924cf6bebf6bdcc1eee63df55ccc39afd703f9a0dad0445e3a62d005a6112ad6ef2', 'id': '8e561c46-96cd-4166-a47e-25e435b9255d', 'created_at': datetime.datetime(2026, 6, 2, 1, 37, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 2, 1, 37, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8e561c46-96cd-4166-a47e-25e435b9255d/file', 'properties': {}}, 'image_service': }' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:38:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f7740cb-197f-4b70-a787-a1ba1c2559e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:38:04 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Volume volume-52b15685-2ffb-46cd-9c10-efc6423c79bd (52b15685-2ffb-46cd-9c10-efc6423c79bd): created successfully Jun 02 03:38:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f7740cb-197f-4b70-a787-a1ba1c2559e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:38:04 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Flow 'volume_create_manager' (dfb1ffa9-0d75-41b9-b4c1-d4bcef1f1ec1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:38:04 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-63236de9-7153-45be-adcd-1ec470573614 tempest-VolumeImageDependencyTests-1882876188 None] Created volume successfully. Jun 02 03:38:04 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0b409d1b-c1e4-484b-9e91-06f07c7556cc tempest-VolumeDependencyTests-1086620720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-ea31c593-dc32-491e-aa2e-906370a02729" returned: 0 in 0.745s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:04 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0b409d1b-c1e4-484b-9e91-06f07c7556cc tempest-VolumeDependencyTests-1086620720 None] Lock "cinder-quobyte-ea31c593-dc32-491e-aa2e-906370a02729" released by "delete_volume" :: held 1.857s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:38:04 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-0b409d1b-c1e4-484b-9e91-06f07c7556cc tempest-VolumeDependencyTests-1086620720 None] Created reservations ['e2ce699a-a8f9-4352-93a8-a21c5ef4e43c', '5c13524b-6e22-4f23-9818-51bf68ed5343', '4feea1ac-a340-455d-961c-a2b00b43dd9f', 'ca120323-e1a9-4ca7-b5fb-2b20183dc0ec'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:38:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0b409d1b-c1e4-484b-9e91-06f07c7556cc tempest-VolumeDependencyTests-1086620720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:38:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0b409d1b-c1e4-484b-9e91-06f07c7556cc tempest-VolumeDependencyTests-1086620720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:38:04 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0b409d1b-c1e4-484b-9e91-06f07c7556cc tempest-VolumeDependencyTests-1086620720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:38:04 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0b409d1b-c1e4-484b-9e91-06f07c7556cc tempest-VolumeDependencyTests-1086620720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:38:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0b409d1b-c1e4-484b-9e91-06f07c7556cc tempest-VolumeDependencyTests-1086620720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:38:04 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0b409d1b-c1e4-484b-9e91-06f07c7556cc tempest-VolumeDependencyTests-1086620720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:04 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:38:04 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:05 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-31d263b0-e017-4bd3-9ec7-60f5078a7268 tempest-CinderUnicodeTest-789823191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:38:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-31d263b0-e017-4bd3-9ec7-60f5078a7268 tempest-CinderUnicodeTest-789823191 None] Flow 'volume_create_manager' (2e93508e-5fb2-4fff-8b36-27b8de0dfa48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:38:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-31d263b0-e017-4bd3-9ec7-60f5078a7268 tempest-CinderUnicodeTest-789823191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cd062d0-0208-4378-8db6-c47abe64c169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:38:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-31d263b0-e017-4bd3-9ec7-60f5078a7268 tempest-CinderUnicodeTest-789823191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cd062d0-0208-4378-8db6-c47abe64c169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:38:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1999504788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7072bf2-1cdf-4797-b1dd-1d99beefaec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd4edd9f18b4e26bfe06a219746aad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:38:05Z,use_quota=True,user_id='f4f6815a117b4813ad0f5dd773dafc98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:38:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-31d263b0-e017-4bd3-9ec7-60f5078a7268 tempest-CinderUnicodeTest-789823191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (006910bb-c0e4-4a48-8b63-a34d279dd0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:38:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-31d263b0-e017-4bd3-9ec7-60f5078a7268 tempest-CinderUnicodeTest-789823191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (006910bb-c0e4-4a48-8b63-a34d279dd0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:38:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-31d263b0-e017-4bd3-9ec7-60f5078a7268 tempest-CinderUnicodeTest-789823191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8624fdb-bff8-4e2c-9573-ff3f6d3e79aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:38:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-31d263b0-e017-4bd3-9ec7-60f5078a7268 tempest-CinderUnicodeTest-789823191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8624fdb-bff8-4e2c-9573-ff3f6d3e79aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7072bf2-1cdf-4797-b1dd-1d99beefaec0', 'volume_name': 'volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:38:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-31d263b0-e017-4bd3-9ec7-60f5078a7268 tempest-CinderUnicodeTest-789823191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b9ac706-8a1b-43b3-9f3c-0a936457319f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:38:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-31d263b0-e017-4bd3-9ec7-60f5078a7268 tempest-CinderUnicodeTest-789823191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b9ac706-8a1b-43b3-9f3c-0a936457319f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:38:05 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-31d263b0-e017-4bd3-9ec7-60f5078a7268 tempest-CinderUnicodeTest-789823191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e28af2-8bf9-4fa8-8f0f-989c4d3d63df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:38:05 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-31d263b0-e017-4bd3-9ec7-60f5078a7268 tempest-CinderUnicodeTest-789823191 None] Volume f7072bf2-1cdf-4797-b1dd-1d99beefaec0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0', 'volume_size': 1} Jun 02 03:38:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-31d263b0-e017-4bd3-9ec7-60f5078a7268 tempest-CinderUnicodeTest-789823191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:38:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-31d263b0-e017-4bd3-9ec7-60f5078a7268 tempest-CinderUnicodeTest-789823191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:38:05 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-31d263b0-e017-4bd3-9ec7-60f5078a7268 tempest-CinderUnicodeTest-789823191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:38:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1999504788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7072bf2-1cdf-4797-b1dd-1d99beefaec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd4edd9f18b4e26bfe06a219746aad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:38:05Z,use_quota=True,user_id='f4f6815a117b4813ad0f5dd773dafc98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:38:05 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-31d263b0-e017-4bd3-9ec7-60f5078a7268 tempest-CinderUnicodeTest-789823191 None] Creating volume f7072bf2-1cdf-4797-b1dd-1d99beefaec0 {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:38:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-31d263b0-e017-4bd3-9ec7-60f5078a7268 tempest-CinderUnicodeTest-789823191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:38:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-31d263b0-e017-4bd3-9ec7-60f5078a7268 tempest-CinderUnicodeTest-789823191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:38:05 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-31d263b0-e017-4bd3-9ec7-60f5078a7268 tempest-CinderUnicodeTest-789823191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:38:05 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-31d263b0-e017-4bd3-9ec7-60f5078a7268 tempest-CinderUnicodeTest-789823191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:38:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-31d263b0-e017-4bd3-9ec7-60f5078a7268 tempest-CinderUnicodeTest-789823191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:38:05 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-31d263b0-e017-4bd3-9ec7-60f5078a7268 tempest-CinderUnicodeTest-789823191 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:38:05 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-31d263b0-e017-4bd3-9ec7-60f5078a7268 tempest-CinderUnicodeTest-789823191 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:38:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-31d263b0-e017-4bd3-9ec7-60f5078a7268 tempest-CinderUnicodeTest-789823191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:05 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0 1073741824 Jun 02 03:38:05 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:05 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0b409d1b-c1e4-484b-9e91-06f07c7556cc tempest-VolumeDependencyTests-1086620720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.909s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:05 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-0b409d1b-c1e4-484b-9e91-06f07c7556cc tempest-VolumeDependencyTests-1086620720 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:38:05 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-0b409d1b-c1e4-484b-9e91-06f07c7556cc tempest-VolumeDependencyTests-1086620720 None] Deleted volume successfully. Jun 02 03:38:05 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0b409d1b-c1e4-484b-9e91-06f07c7556cc tempest-VolumeDependencyTests-1086620720 None] Lock "cinder-ea31c593-dc32-491e-aa2e-906370a02729-delete_volume" released by "delete_volume" :: held 3.014s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:38:05 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-8bbc2052-422f-4b84-9831-55b632c64818 tempest-VolumeImageDependencyTests-1882876188 None] Acquiring lock "cinder-52b15685-2ffb-46cd-9c10-efc6423c79bd-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:38:05 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-8bbc2052-422f-4b84-9831-55b632c64818 tempest-VolumeImageDependencyTests-1882876188 None] Lock "cinder-52b15685-2ffb-46cd-9c10-efc6423c79bd-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:38:05 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-8bbc2052-422f-4b84-9831-55b632c64818 tempest-VolumeImageDependencyTests-1882876188 None] Acquiring lock "cinder-quobyte-52b15685-2ffb-46cd-9c10-efc6423c79bd" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:38:05 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-8bbc2052-422f-4b84-9831-55b632c64818 tempest-VolumeImageDependencyTests-1882876188 None] Lock "cinder-quobyte-52b15685-2ffb-46cd-9c10-efc6423c79bd" acquired by "delete_volume" :: waited 0.020s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:38:05 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c1ded3-5e17-4aa5-978f-99d84d5b31b4]: (4, 'raw') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:38:05 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8bbc2052-422f-4b84-9831-55b632c64818 tempest-VolumeImageDependencyTests-1882876188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-52b15685-2ffb-46cd-9c10-efc6423c79bd {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:06 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-52b15685-2ffb-46cd-9c10-efc6423c79bd Jun 02 03:38:06 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:06 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-31d263b0-e017-4bd3-9ec7-60f5078a7268 tempest-CinderUnicodeTest-789823191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0 1073741824" returned: 0 in 1.065s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-31d263b0-e017-4bd3-9ec7-60f5078a7268 tempest-CinderUnicodeTest-789823191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:06 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0 Jun 02 03:38:06 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:06 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8bbc2052-422f-4b84-9831-55b632c64818 tempest-VolumeImageDependencyTests-1882876188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-52b15685-2ffb-46cd-9c10-efc6423c79bd" returned: 0 in 0.900s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:06 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8bbc2052-422f-4b84-9831-55b632c64818 tempest-VolumeImageDependencyTests-1882876188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-52b15685-2ffb-46cd-9c10-efc6423c79bd {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:06 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-52b15685-2ffb-46cd-9c10-efc6423c79bd Jun 02 03:38:06 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:07 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-31d263b0-e017-4bd3-9ec7-60f5078a7268 tempest-CinderUnicodeTest-789823191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0" returned: 0 in 0.859s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:07 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-31d263b0-e017-4bd3-9ec7-60f5078a7268 tempest-CinderUnicodeTest-789823191 None] <== create_volume: return (1990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:38:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-31d263b0-e017-4bd3-9ec7-60f5078a7268 tempest-CinderUnicodeTest-789823191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.993s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:38:07 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-69fa7263-2b3d-4753-b92e-2c7be62db310 tempest-SnapshotDependencyTests-1311301795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:38:07 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-69fa7263-2b3d-4753-b92e-2c7be62db310 tempest-SnapshotDependencyTests-1311301795 None] Flow 'volume_create_manager' (46bde8e9-abcc-45e3-bde1-0b30fe29bd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:38:07 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-69fa7263-2b3d-4753-b92e-2c7be62db310 tempest-SnapshotDependencyTests-1311301795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d83017-0089-4b4d-8cdb-a0eded82e1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:38:07 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-31d263b0-e017-4bd3-9ec7-60f5078a7268 tempest-CinderUnicodeTest-789823191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e28af2-8bf9-4fa8-8f0f-989c4d3d63df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:38:07 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-31d263b0-e017-4bd3-9ec7-60f5078a7268 tempest-CinderUnicodeTest-789823191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (361b5f14-5d4e-49e9-82ba-8e584ed35d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:38:07 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-69fa7263-2b3d-4753-b92e-2c7be62db310 tempest-SnapshotDependencyTests-1311301795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d83017-0089-4b4d-8cdb-a0eded82e1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-427107006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73cab644-76e7-4af7-9604-0131f6f86b7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c041e8a0f4b94c9cb641dfc48d85884d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:38:07Z,use_quota=True,user_id='c901ea75ea7740058aa7bd2b082a0f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:38:07 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-69fa7263-2b3d-4753-b92e-2c7be62db310 tempest-SnapshotDependencyTests-1311301795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c703cc03-1c44-4228-881a-86958176f211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:38:07 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-69fa7263-2b3d-4753-b92e-2c7be62db310 tempest-SnapshotDependencyTests-1311301795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c703cc03-1c44-4228-881a-86958176f211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:38:07 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-69fa7263-2b3d-4753-b92e-2c7be62db310 tempest-SnapshotDependencyTests-1311301795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d1cb358-9788-4301-b789-8fe5fb977626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:38:07 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-69fa7263-2b3d-4753-b92e-2c7be62db310 tempest-SnapshotDependencyTests-1311301795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d1cb358-9788-4301-b789-8fe5fb977626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73cab644-76e7-4af7-9604-0131f6f86b7d', 'volume_name': 'volume-73cab644-76e7-4af7-9604-0131f6f86b7d', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:38:07 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-69fa7263-2b3d-4753-b92e-2c7be62db310 tempest-SnapshotDependencyTests-1311301795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64ce0050-5cff-49d6-be05-e8645fa1e1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:38:07 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-69fa7263-2b3d-4753-b92e-2c7be62db310 tempest-SnapshotDependencyTests-1311301795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64ce0050-5cff-49d6-be05-e8645fa1e1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:38:07 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-69fa7263-2b3d-4753-b92e-2c7be62db310 tempest-SnapshotDependencyTests-1311301795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (541f064a-c067-4b66-94c8-132229b83161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:38:07 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-69fa7263-2b3d-4753-b92e-2c7be62db310 tempest-SnapshotDependencyTests-1311301795 None] Volume 73cab644-76e7-4af7-9604-0131f6f86b7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73cab644-76e7-4af7-9604-0131f6f86b7d', 'volume_size': 1} Jun 02 03:38:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-69fa7263-2b3d-4753-b92e-2c7be62db310 tempest-SnapshotDependencyTests-1311301795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:38:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-69fa7263-2b3d-4753-b92e-2c7be62db310 tempest-SnapshotDependencyTests-1311301795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:38:07 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-69fa7263-2b3d-4753-b92e-2c7be62db310 tempest-SnapshotDependencyTests-1311301795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-427107006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73cab644-76e7-4af7-9604-0131f6f86b7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c041e8a0f4b94c9cb641dfc48d85884d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:38:07Z,use_quota=True,user_id='c901ea75ea7740058aa7bd2b082a0f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)}" {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 02 03:38:07 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-69fa7263-2b3d-4753-b92e-2c7be62db310 tempest-SnapshotDependencyTests-1311301795 None] Creating volume 73cab644-76e7-4af7-9604-0131f6f86b7d {{(pid=86431) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 02 03:38:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-69fa7263-2b3d-4753-b92e-2c7be62db310 tempest-SnapshotDependencyTests-1311301795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:38:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-69fa7263-2b3d-4753-b92e-2c7be62db310 tempest-SnapshotDependencyTests-1311301795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:38:07 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-69fa7263-2b3d-4753-b92e-2c7be62db310 tempest-SnapshotDependencyTests-1311301795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:38:07 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-69fa7263-2b3d-4753-b92e-2c7be62db310 tempest-SnapshotDependencyTests-1311301795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:38:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-69fa7263-2b3d-4753-b92e-2c7be62db310 tempest-SnapshotDependencyTests-1311301795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:38:07 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-69fa7263-2b3d-4753-b92e-2c7be62db310 tempest-SnapshotDependencyTests-1311301795 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:38:07 devstack cinder-volume[86431]: INFO cinder.volume.drivers.remotefs [None req-69fa7263-2b3d-4753-b92e-2c7be62db310 tempest-SnapshotDependencyTests-1311301795 None] casted to osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 Jun 02 03:38:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-69fa7263-2b3d-4753-b92e-2c7be62db310 tempest-SnapshotDependencyTests-1311301795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d 1073741824 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:07 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-31d263b0-e017-4bd3-9ec7-60f5078a7268 tempest-CinderUnicodeTest-789823191 None] Volume volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0 (f7072bf2-1cdf-4797-b1dd-1d99beefaec0): created successfully Jun 02 03:38:07 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-31d263b0-e017-4bd3-9ec7-60f5078a7268 tempest-CinderUnicodeTest-789823191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (361b5f14-5d4e-49e9-82ba-8e584ed35d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:38:07 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-31d263b0-e017-4bd3-9ec7-60f5078a7268 tempest-CinderUnicodeTest-789823191 None] Flow 'volume_create_manager' (2e93508e-5fb2-4fff-8b36-27b8de0dfa48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:38:07 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d 1073741824 Jun 02 03:38:07 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:07 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-31d263b0-e017-4bd3-9ec7-60f5078a7268 tempest-CinderUnicodeTest-789823191 None] Created volume successfully. Jun 02 03:38:07 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8bbc2052-422f-4b84-9831-55b632c64818 tempest-VolumeImageDependencyTests-1882876188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-52b15685-2ffb-46cd-9c10-efc6423c79bd" returned: 1 in 0.829s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8bbc2052-422f-4b84-9831-55b632c64818 tempest-VolumeImageDependencyTests-1882876188 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-52b15685-2ffb-46cd-9c10-efc6423c79bd' failed. Not Retrying. {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 02 03:38:07 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8bbc2052-422f-4b84-9831-55b632c64818 tempest-VolumeImageDependencyTests-1882876188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-52b15685-2ffb-46cd-9c10-efc6423c79bd {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:07 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-52b15685-2ffb-46cd-9c10-efc6423c79bd Jun 02 03:38:07 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:08 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-69fa7263-2b3d-4753-b92e-2c7be62db310 tempest-SnapshotDependencyTests-1311301795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d 1073741824" returned: 0 in 0.794s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-69fa7263-2b3d-4753-b92e-2c7be62db310 tempest-SnapshotDependencyTests-1311301795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:08 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d Jun 02 03:38:08 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:08 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8bbc2052-422f-4b84-9831-55b632c64818 tempest-VolumeImageDependencyTests-1882876188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-52b15685-2ffb-46cd-9c10-efc6423c79bd" returned: 0 in 0.618s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:08 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-8bbc2052-422f-4b84-9831-55b632c64818 tempest-VolumeImageDependencyTests-1882876188 None] Lock "cinder-quobyte-52b15685-2ffb-46cd-9c10-efc6423c79bd" released by "delete_volume" :: held 2.440s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:38:08 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-8bbc2052-422f-4b84-9831-55b632c64818 tempest-VolumeImageDependencyTests-1882876188 None] Created reservations ['7c7f3819-8eb1-494e-9122-5fd0aa5db8ba', 'a2ddc7bd-045c-4386-8582-03a8a75cfc2a', '27d295a7-4603-4449-921a-8dca7bc8e01a', 'bc3f4585-0002-468a-adcd-ae2c3c73401f'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:38:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8bbc2052-422f-4b84-9831-55b632c64818 tempest-VolumeImageDependencyTests-1882876188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:38:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8bbc2052-422f-4b84-9831-55b632c64818 tempest-VolumeImageDependencyTests-1882876188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:38:08 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-8bbc2052-422f-4b84-9831-55b632c64818 tempest-VolumeImageDependencyTests-1882876188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:38:08 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-8bbc2052-422f-4b84-9831-55b632c64818 tempest-VolumeImageDependencyTests-1882876188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:38:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-8bbc2052-422f-4b84-9831-55b632c64818 tempest-VolumeImageDependencyTests-1882876188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:38:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8bbc2052-422f-4b84-9831-55b632c64818 tempest-VolumeImageDependencyTests-1882876188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:08 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:38:08 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c78a62b3-469b-40c9-a928-2393ad503a8f tempest-CinderUnicodeTest-789823191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:38:08 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-69fa7263-2b3d-4753-b92e-2c7be62db310 tempest-SnapshotDependencyTests-1311301795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d" returned: 0 in 0.630s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:08 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-69fa7263-2b3d-4753-b92e-2c7be62db310 tempest-SnapshotDependencyTests-1311301795 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'} {{(pid=86431) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 02 03:38:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-69fa7263-2b3d-4753-b92e-2c7be62db310 tempest-SnapshotDependencyTests-1311301795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:38:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c78a62b3-469b-40c9-a928-2393ad503a8f tempest-CinderUnicodeTest-789823191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.206s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:38:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-69fa7263-2b3d-4753-b92e-2c7be62db310 tempest-SnapshotDependencyTests-1311301795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (541f064a-c067-4b66-94c8-132229b83161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73cab644-76e7-4af7-9604-0131f6f86b7d', 'volume_size': 1}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:38:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-69fa7263-2b3d-4753-b92e-2c7be62db310 tempest-SnapshotDependencyTests-1311301795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f68b12-c906-4fd8-9d12-93d36d5f45db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:38:08 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-c78a62b3-469b-40c9-a928-2393ad503a8f tempest-CinderUnicodeTest-789823191 None] Creating offline snapshot e805e7c9-710e-4874-b053-befc20a5041d of volume f7072bf2-1cdf-4797-b1dd-1d99beefaec0 {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:38:08 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-69fa7263-2b3d-4753-b92e-2c7be62db310 tempest-SnapshotDependencyTests-1311301795 None] Volume volume-73cab644-76e7-4af7-9604-0131f6f86b7d (73cab644-76e7-4af7-9604-0131f6f86b7d): created successfully Jun 02 03:38:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-69fa7263-2b3d-4753-b92e-2c7be62db310 tempest-SnapshotDependencyTests-1311301795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f68b12-c906-4fd8-9d12-93d36d5f45db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:38:08 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-69fa7263-2b3d-4753-b92e-2c7be62db310 tempest-SnapshotDependencyTests-1311301795 None] Flow 'volume_create_manager' (46bde8e9-abcc-45e3-bde1-0b30fe29bd24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:38:08 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[033a2c41-c713-43b6-a8ff-2d330e486005]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:38:08 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c78a62b3-469b-40c9-a928-2393ad503a8f tempest-CinderUnicodeTest-789823191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:08 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-69fa7263-2b3d-4753-b92e-2c7be62db310 tempest-SnapshotDependencyTests-1311301795 None] Created volume successfully. Jun 02 03:38:08 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0 Jun 02 03:38:08 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:09 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-8bbc2052-422f-4b84-9831-55b632c64818 tempest-VolumeImageDependencyTests-1882876188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.631s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:09 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-8bbc2052-422f-4b84-9831-55b632c64818 tempest-VolumeImageDependencyTests-1882876188 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:38:09 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-8bbc2052-422f-4b84-9831-55b632c64818 tempest-VolumeImageDependencyTests-1882876188 None] Deleted volume successfully. Jun 02 03:38:09 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-8bbc2052-422f-4b84-9831-55b632c64818 tempest-VolumeImageDependencyTests-1882876188 None] Lock "cinder-52b15685-2ffb-46cd-9c10-efc6423c79bd-delete_volume" released by "delete_volume" :: held 3.323s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:38:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1e3a7ebe-32b2-4e47-a605-f4b46acf7f35 tempest-SnapshotDependencyTests-1311301795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:38:09 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:38:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:38:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:38:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:38:09 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:38:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:38:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:09 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c78a62b3-469b-40c9-a928-2393ad503a8f tempest-CinderUnicodeTest-789823191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0" returned: 0 in 0.791s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:09 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c78a62b3-469b-40c9-a928-2393ad503a8f tempest-CinderUnicodeTest-789823191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0.e805e7c9-710e-4874-b053-befc20a5041d 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:09 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:38:09 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:09 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0.e805e7c9-710e-4874-b053-befc20a5041d 1G Jun 02 03:38:09 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:10 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.637s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:10 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:38:10 devstack cinder-volume[86431]: DEBUG oslo_service.periodic_task [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] Running periodic task VolumeManager._thread_info {{(pid=86431) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 02 03:38:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread count: 28 {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 02 03:38:10 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-03e4b9a3-ae3d-467e-b793-58ebd98e5072 None None] thread info: [<_MainThread(MainThread, started 138618128814208)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86431) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 02 03:38:10 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c78a62b3-469b-40c9-a928-2393ad503a8f tempest-CinderUnicodeTest-789823191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0.e805e7c9-710e-4874-b053-befc20a5041d 1G" returned: 0 in 0.798s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:10 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c78a62b3-469b-40c9-a928-2393ad503a8f tempest-CinderUnicodeTest-789823191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0.e805e7c9-710e-4874-b053-befc20a5041d {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:10 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0.e805e7c9-710e-4874-b053-befc20a5041d Jun 02 03:38:10 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:11 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c78a62b3-469b-40c9-a928-2393ad503a8f tempest-CinderUnicodeTest-789823191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0 -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0.e805e7c9-710e-4874-b053-befc20a5041d" returned: 0 in 0.706s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:11 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-c78a62b3-469b-40c9-a928-2393ad503a8f tempest-CinderUnicodeTest-789823191 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0.e805e7c9-710e-4874-b053-befc20a5041d is being set with open permissions: ugo+rw Jun 02 03:38:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c78a62b3-469b-40c9-a928-2393ad503a8f tempest-CinderUnicodeTest-789823191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0.e805e7c9-710e-4874-b053-befc20a5041d {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:11 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0.e805e7c9-710e-4874-b053-befc20a5041d Jun 02 03:38:11 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:11 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c78a62b3-469b-40c9-a928-2393ad503a8f tempest-CinderUnicodeTest-789823191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0.e805e7c9-710e-4874-b053-befc20a5041d" returned: 0 in 0.576s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:11 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c78a62b3-469b-40c9-a928-2393ad503a8f tempest-CinderUnicodeTest-789823191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:11 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0.info Jun 02 03:38:11 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:12 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c78a62b3-469b-40c9-a928-2393ad503a8f tempest-CinderUnicodeTest-789823191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0.info" returned: 0 in 0.597s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:12 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-c78a62b3-469b-40c9-a928-2393ad503a8f tempest-CinderUnicodeTest-789823191 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0.info is being set with open permissions: ugo+rw Jun 02 03:38:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c78a62b3-469b-40c9-a928-2393ad503a8f tempest-CinderUnicodeTest-789823191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:12 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0.info Jun 02 03:38:12 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:12 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-c78a62b3-469b-40c9-a928-2393ad503a8f tempest-CinderUnicodeTest-789823191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0.info" returned: 0 in 0.586s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-c78a62b3-469b-40c9-a928-2393ad503a8f tempest-CinderUnicodeTest-789823191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.169s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:38:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1e3a7ebe-32b2-4e47-a605-f4b46acf7f35 tempest-SnapshotDependencyTests-1311301795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.415s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:38:12 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-1e3a7ebe-32b2-4e47-a605-f4b46acf7f35 tempest-SnapshotDependencyTests-1311301795 None] Creating offline snapshot 24bfff23-452e-4b07-94c8-99c5bdf52951 of volume 73cab644-76e7-4af7-9604-0131f6f86b7d {{(pid=86431) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 02 03:38:12 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-c78a62b3-469b-40c9-a928-2393ad503a8f tempest-CinderUnicodeTest-789823191 None] Create snapshot completed successfully Jun 02 03:38:12 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c2f56c-a60b-4533-b13e-512d6f3e54ce]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:38:12 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1e3a7ebe-32b2-4e47-a605-f4b46acf7f35 tempest-SnapshotDependencyTests-1311301795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:13 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d Jun 02 03:38:13 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:13 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1e3a7ebe-32b2-4e47-a605-f4b46acf7f35 tempest-SnapshotDependencyTests-1311301795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d" returned: 0 in 0.700s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1e3a7ebe-32b2-4e47-a605-f4b46acf7f35 tempest-SnapshotDependencyTests-1311301795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d.24bfff23-452e-4b07-94c8-99c5bdf52951 1G {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:13 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d.24bfff23-452e-4b07-94c8-99c5bdf52951 1G Jun 02 03:38:13 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:13 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-575ed0f2-d0c6-4f50-ae4c-f4dcc8042c35 tempest-CinderUnicodeTest-789823191 None] Acquiring lock "cinder-e805e7c9-710e-4874-b053-befc20a5041d-delete_snapshot" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:38:13 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-575ed0f2-d0c6-4f50-ae4c-f4dcc8042c35 tempest-CinderUnicodeTest-789823191 None] Lock "cinder-e805e7c9-710e-4874-b053-befc20a5041d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:38:13 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-575ed0f2-d0c6-4f50-ae4c-f4dcc8042c35 tempest-CinderUnicodeTest-789823191 None] Acquiring lock "cinder-quobyte-f7072bf2-1cdf-4797-b1dd-1d99beefaec0" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:38:13 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-575ed0f2-d0c6-4f50-ae4c-f4dcc8042c35 tempest-CinderUnicodeTest-789823191 None] Lock "cinder-quobyte-f7072bf2-1cdf-4797-b1dd-1d99beefaec0" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:38:13 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-575ed0f2-d0c6-4f50-ae4c-f4dcc8042c35 tempest-CinderUnicodeTest-789823191 None] Acquiring lock "cinder-quobyte-e805e7c9-710e-4874-b053-befc20a5041d" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:38:13 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-575ed0f2-d0c6-4f50-ae4c-f4dcc8042c35 tempest-CinderUnicodeTest-789823191 None] Lock "cinder-quobyte-e805e7c9-710e-4874-b053-befc20a5041d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:38:13 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-575ed0f2-d0c6-4f50-ae4c-f4dcc8042c35 tempest-CinderUnicodeTest-789823191 None] Deleting offline snapshot e805e7c9-710e-4874-b053-befc20a5041d of volume f7072bf2-1cdf-4797-b1dd-1d99beefaec0 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:38:13 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-575ed0f2-d0c6-4f50-ae4c-f4dcc8042c35 tempest-CinderUnicodeTest-789823191 None] snapshot_file for this snap is: volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0.e805e7c9-710e-4874-b053-befc20a5041d {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:38:13 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[62eabcc5-b8bb-497b-aee3-be6ca6b59a04]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:38:13 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-575ed0f2-d0c6-4f50-ae4c-f4dcc8042c35 tempest-CinderUnicodeTest-789823191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0.e805e7c9-710e-4874-b053-befc20a5041d {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:13 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0.e805e7c9-710e-4874-b053-befc20a5041d Jun 02 03:38:13 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:14 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1e3a7ebe-32b2-4e47-a605-f4b46acf7f35 tempest-SnapshotDependencyTests-1311301795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d.24bfff23-452e-4b07-94c8-99c5bdf52951 1G" returned: 0 in 0.757s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1e3a7ebe-32b2-4e47-a605-f4b46acf7f35 tempest-SnapshotDependencyTests-1311301795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73cab644-76e7-4af7-9604-0131f6f86b7d -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d.24bfff23-452e-4b07-94c8-99c5bdf52951 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:14 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73cab644-76e7-4af7-9604-0131f6f86b7d -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d.24bfff23-452e-4b07-94c8-99c5bdf52951 Jun 02 03:38:14 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:14 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-575ed0f2-d0c6-4f50-ae4c-f4dcc8042c35 tempest-CinderUnicodeTest-789823191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0.e805e7c9-710e-4874-b053-befc20a5041d" returned: 0 in 0.738s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:14 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-575ed0f2-d0c6-4f50-ae4c-f4dcc8042c35 tempest-CinderUnicodeTest-789823191 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:38:14 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[343ca948-450d-42c2-9164-aab19a338510]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:38:14 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-575ed0f2-d0c6-4f50-ae4c-f4dcc8042c35 tempest-CinderUnicodeTest-789823191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:14 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0 Jun 02 03:38:14 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:15 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1e3a7ebe-32b2-4e47-a605-f4b46acf7f35 tempest-SnapshotDependencyTests-1311301795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73cab644-76e7-4af7-9604-0131f6f86b7d -F qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d.24bfff23-452e-4b07-94c8-99c5bdf52951" returned: 0 in 0.661s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:15 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-1e3a7ebe-32b2-4e47-a605-f4b46acf7f35 tempest-SnapshotDependencyTests-1311301795 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d.24bfff23-452e-4b07-94c8-99c5bdf52951 is being set with open permissions: ugo+rw Jun 02 03:38:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1e3a7ebe-32b2-4e47-a605-f4b46acf7f35 tempest-SnapshotDependencyTests-1311301795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d.24bfff23-452e-4b07-94c8-99c5bdf52951 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:15 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d.24bfff23-452e-4b07-94c8-99c5bdf52951 Jun 02 03:38:15 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:15 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-575ed0f2-d0c6-4f50-ae4c-f4dcc8042c35 tempest-CinderUnicodeTest-789823191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0" returned: 0 in 0.694s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-575ed0f2-d0c6-4f50-ae4c-f4dcc8042c35 tempest-CinderUnicodeTest-789823191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0.e805e7c9-710e-4874-b053-befc20a5041d {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:15 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0.e805e7c9-710e-4874-b053-befc20a5041d Jun 02 03:38:15 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:15 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1e3a7ebe-32b2-4e47-a605-f4b46acf7f35 tempest-SnapshotDependencyTests-1311301795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d.24bfff23-452e-4b07-94c8-99c5bdf52951" returned: 0 in 0.588s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:15 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:INSERT=54,cinder:UPDATE=221,cinder:SELECT=157,cinder:DELETE=21 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:38:15 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1e3a7ebe-32b2-4e47-a605-f4b46acf7f35 tempest-SnapshotDependencyTests-1311301795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:15 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d.info Jun 02 03:38:15 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:15 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-575ed0f2-d0c6-4f50-ae4c-f4dcc8042c35 tempest-CinderUnicodeTest-789823191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0.e805e7c9-710e-4874-b053-befc20a5041d" returned: 0 in 0.694s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-575ed0f2-d0c6-4f50-ae4c-f4dcc8042c35 tempest-CinderUnicodeTest-789823191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0.e805e7c9-710e-4874-b053-befc20a5041d {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:16 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0.e805e7c9-710e-4874-b053-befc20a5041d Jun 02 03:38:16 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:16 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1e3a7ebe-32b2-4e47-a605-f4b46acf7f35 tempest-SnapshotDependencyTests-1311301795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d.info" returned: 0 in 0.591s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:16 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-1e3a7ebe-32b2-4e47-a605-f4b46acf7f35 tempest-SnapshotDependencyTests-1311301795 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d.info is being set with open permissions: ugo+rw Jun 02 03:38:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1e3a7ebe-32b2-4e47-a605-f4b46acf7f35 tempest-SnapshotDependencyTests-1311301795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d.info {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:16 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d.info Jun 02 03:38:16 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:16 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-575ed0f2-d0c6-4f50-ae4c-f4dcc8042c35 tempest-CinderUnicodeTest-789823191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0.e805e7c9-710e-4874-b053-befc20a5041d" returned: 0 in 0.569s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:16 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-575ed0f2-d0c6-4f50-ae4c-f4dcc8042c35 tempest-CinderUnicodeTest-789823191 None] Lock "cinder-quobyte-e805e7c9-710e-4874-b053-befc20a5041d" released by "_delete_snapshot" :: held 2.814s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:38:16 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-575ed0f2-d0c6-4f50-ae4c-f4dcc8042c35 tempest-CinderUnicodeTest-789823191 None] Lock "cinder-quobyte-f7072bf2-1cdf-4797-b1dd-1d99beefaec0" released by "delete_snapshot" :: held 2.839s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:38:16 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-575ed0f2-d0c6-4f50-ae4c-f4dcc8042c35 tempest-CinderUnicodeTest-789823191 None] Created reservations ['3145cec9-d2de-45bd-9aa6-0c5f3bb30f91', '71b33cca-fce7-4cbc-b999-fb8d35e908c6', '0191a68d-a993-475b-a538-9b86ad2c1f09', '9efecf1d-9311-41bc-9dd5-733db01e0a7d'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:38:16 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-575ed0f2-d0c6-4f50-ae4c-f4dcc8042c35 tempest-CinderUnicodeTest-789823191 None] Delete snapshot completed successfully. Jun 02 03:38:16 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-575ed0f2-d0c6-4f50-ae4c-f4dcc8042c35 tempest-CinderUnicodeTest-789823191 None] Lock "cinder-e805e7c9-710e-4874-b053-befc20a5041d-delete_snapshot" released by "delete_snapshot" :: held 2.992s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:38:16 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1e3a7ebe-32b2-4e47-a605-f4b46acf7f35 tempest-SnapshotDependencyTests-1311301795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d.info" returned: 0 in 0.591s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:16 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-1e3a7ebe-32b2-4e47-a605-f4b46acf7f35 tempest-SnapshotDependencyTests-1311301795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.013s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:38:16 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-1e3a7ebe-32b2-4e47-a605-f4b46acf7f35 tempest-SnapshotDependencyTests-1311301795 None] Create snapshot completed successfully Jun 02 03:38:16 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0decf655-e429-4c3e-ad1a-7aa559d5d2f7 tempest-CinderUnicodeTest-789823191 None] Acquiring lock "cinder-f7072bf2-1cdf-4797-b1dd-1d99beefaec0-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:38:16 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0decf655-e429-4c3e-ad1a-7aa559d5d2f7 tempest-CinderUnicodeTest-789823191 None] Lock "cinder-f7072bf2-1cdf-4797-b1dd-1d99beefaec0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:38:16 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0decf655-e429-4c3e-ad1a-7aa559d5d2f7 tempest-CinderUnicodeTest-789823191 None] Acquiring lock "cinder-quobyte-f7072bf2-1cdf-4797-b1dd-1d99beefaec0" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:38:17 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0decf655-e429-4c3e-ad1a-7aa559d5d2f7 tempest-CinderUnicodeTest-789823191 None] Lock "cinder-quobyte-f7072bf2-1cdf-4797-b1dd-1d99beefaec0" acquired by "delete_volume" :: waited 0.016s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:38:17 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[da20d79e-13f0-4a09-882a-ef860e96673d]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:38:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0decf655-e429-4c3e-ad1a-7aa559d5d2f7 tempest-CinderUnicodeTest-789823191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:17 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0 Jun 02 03:38:17 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:17 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0decf655-e429-4c3e-ad1a-7aa559d5d2f7 tempest-CinderUnicodeTest-789823191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0" returned: 0 in 0.685s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:17 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0decf655-e429-4c3e-ad1a-7aa559d5d2f7 tempest-CinderUnicodeTest-789823191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:17 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0 Jun 02 03:38:17 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86431) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Flow 'volume_create_manager' (ccbb90f2-4ddb-42c2-9e1e-606da241ebc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b08ac33a-258e-4be9-9ef1-46bd4a277b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:38:18 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0decf655-e429-4c3e-ad1a-7aa559d5d2f7 tempest-CinderUnicodeTest-789823191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-f7072bf2-1cdf-4797-b1dd-1d99beefaec0" returned: 0 in 0.587s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b08ac33a-258e-4be9-9ef1-46bd4a277b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-02T01:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e2b5f3a-8311-459c-829a-1143b3a75cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c041e8a0f4b94c9cb641dfc48d85884d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-02T01:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=24bfff23-452e-4b07-94c8-99c5bdf52951,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-02T01:38:18Z,use_quota=True,user_id='c901ea75ea7740058aa7bd2b082a0f62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0ab9d5-de22-4645-b418-6e5b6586b511),volume_type_id=9b0ab9d5-de22-4645-b418-6e5b6586b511)' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b86291b-0365-4d15-83ba-fbcbb10b5c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b86291b-0365-4d15-83ba-fbcbb10b5c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a041278-495b-4886-bf5d-e16094af829d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a041278-495b-4886-bf5d-e16094af829d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3e2b5f3a-8311-459c-829a-1143b3a75cb1', 'volume_name': 'volume-3e2b5f3a-8311-459c-829a-1143b3a75cb1', 'volume_size': 1, 'snapshot_id': '24bfff23-452e-4b07-94c8-99c5bdf52951'}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a0843b-dcfd-4384-aecf-4f7a3c1c3bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a0843b-dcfd-4384-aecf-4f7a3c1c3bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f910d778-1b6a-4d18-a127-9545ec0ce2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:38:18 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Volume 3e2b5f3a-8311-459c-829a-1143b3a75cb1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3e2b5f3a-8311-459c-829a-1143b3a75cb1', 'volume_size': 1, 'snapshot_id': '24bfff23-452e-4b07-94c8-99c5bdf52951'} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0decf655-e429-4c3e-ad1a-7aa559d5d2f7 tempest-CinderUnicodeTest-789823191 None] Lock "cinder-quobyte-f7072bf2-1cdf-4797-b1dd-1d99beefaec0" released by "delete_volume" :: held 1.366s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Acquiring lock "cinder-quobyte-24bfff23-452e-4b07-94c8-99c5bdf52951-3e2b5f3a-8311-459c-829a-1143b3a75cb1" by "_create_volume_from_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Lock "cinder-quobyte-24bfff23-452e-4b07-94c8-99c5bdf52951-3e2b5f3a-8311-459c-829a-1143b3a75cb1" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Creating volume 3e2b5f3a-8311-459c-829a-1143b3a75cb1 from snapshot 24bfff23-452e-4b07-94c8-99c5bdf52951 {{(pid=86431) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Selected osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1 as target Quobyte volume. {{(pid=86431) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Acquiring lock "cinder-quobyte-3e2b5f3a-8311-459c-829a-1143b3a75cb1" by "_copy_volume_from_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Lock "cinder-quobyte-3e2b5f3a-8311-459c-829a-1143b3a75cb1" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] snapshot: 24bfff23-452e-4b07-94c8-99c5bdf52951, volume: 3e2b5f3a-8311-459c-829a-1143b3a75cb1, {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-0decf655-e429-4c3e-ad1a-7aa559d5d2f7 tempest-CinderUnicodeTest-789823191 None] Created reservations ['22a7cee5-4325-4a94-9839-928359087f90', '9f31654c-45d1-45ea-bfea-7e785c62d14e', 'd51d20b6-3291-4369-8ecc-be3ad0428214', '2aaa9da8-17a4-4912-991c-c64c782238ac'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ae10dd-850d-4e52-80f7-bee99cb0a7f3]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d.24bfff23-452e-4b07-94c8-99c5bdf52951 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0decf655-e429-4c3e-ad1a-7aa559d5d2f7 tempest-CinderUnicodeTest-789823191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0decf655-e429-4c3e-ad1a-7aa559d5d2f7 tempest-CinderUnicodeTest-789823191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0decf655-e429-4c3e-ad1a-7aa559d5d2f7 tempest-CinderUnicodeTest-789823191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-0decf655-e429-4c3e-ad1a-7aa559d5d2f7 tempest-CinderUnicodeTest-789823191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-0decf655-e429-4c3e-ad1a-7aa559d5d2f7 tempest-CinderUnicodeTest-789823191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:38:18 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0decf655-e429-4c3e-ad1a-7aa559d5d2f7 tempest-CinderUnicodeTest-789823191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:18 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:38:18 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:18 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d.24bfff23-452e-4b07-94c8-99c5bdf52951 Jun 02 03:38:18 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:19 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-0decf655-e429-4c3e-ad1a-7aa559d5d2f7 tempest-CinderUnicodeTest-789823191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.587s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:19 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-0decf655-e429-4c3e-ad1a-7aa559d5d2f7 tempest-CinderUnicodeTest-789823191 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:38:19 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-0decf655-e429-4c3e-ad1a-7aa559d5d2f7 tempest-CinderUnicodeTest-789823191 None] Deleted volume successfully. Jun 02 03:38:19 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-0decf655-e429-4c3e-ad1a-7aa559d5d2f7 tempest-CinderUnicodeTest-789823191 None] Lock "cinder-f7072bf2-1cdf-4797-b1dd-1d99beefaec0-delete_volume" released by "delete_volume" :: held 2.206s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:38:19 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b47e396d-2615-4e8d-b373-3bb14d9259c4 tempest-CinderUnicodeTest-789823191 None] Acquiring lock "cinder-b53877c9-fc73-4c2e-b28c-b3aa146787c7-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:38:19 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b47e396d-2615-4e8d-b373-3bb14d9259c4 tempest-CinderUnicodeTest-789823191 None] Lock "cinder-b53877c9-fc73-4c2e-b28c-b3aa146787c7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:38:19 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d.24bfff23-452e-4b07-94c8-99c5bdf52951" returned: 0 in 0.745s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:19 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73cab644-76e7-4af7-9604-0131f6f86b7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:38:19 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] will copy from snapshot at /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 02 03:38:19 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Creating direct copy from snapshot {{(pid=86431) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 02 03:38:19 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a3d72a-60b6-4f7b-8a3d-f137be9bfe06]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:38:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:19 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b47e396d-2615-4e8d-b373-3bb14d9259c4 tempest-CinderUnicodeTest-789823191 None] Acquiring lock "cinder-quobyte-b53877c9-fc73-4c2e-b28c-b3aa146787c7" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:38:19 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b47e396d-2615-4e8d-b373-3bb14d9259c4 tempest-CinderUnicodeTest-789823191 None] Lock "cinder-quobyte-b53877c9-fc73-4c2e-b28c-b3aa146787c7" acquired by "delete_volume" :: waited 0.024s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:38:19 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ea7546-f382-4092-b216-f660951472bc]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:38:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b47e396d-2615-4e8d-b373-3bb14d9259c4 tempest-CinderUnicodeTest-789823191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b53877c9-fc73-4c2e-b28c-b3aa146787c7 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:19 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d Jun 02 03:38:19 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:19 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b53877c9-fc73-4c2e-b28c-b3aa146787c7 Jun 02 03:38:19 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:19 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d" returned: 0 in 0.740s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:19 devstack cinder-volume[86431]: DEBUG cinder.utils [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Path /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3e2b5f3a-8311-459c-829a-1143b3a75cb1 not found in is_blk_device check {{(pid=86431) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 02 03:38:19 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3e2b5f3a-8311-459c-829a-1143b3a75cb1 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:20 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3e2b5f3a-8311-459c-829a-1143b3a75cb1 Jun 02 03:38:20 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:20 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b47e396d-2615-4e8d-b373-3bb14d9259c4 tempest-CinderUnicodeTest-789823191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b53877c9-fc73-4c2e-b28c-b3aa146787c7" returned: 0 in 0.713s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b47e396d-2615-4e8d-b373-3bb14d9259c4 tempest-CinderUnicodeTest-789823191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b53877c9-fc73-4c2e-b28c-b3aa146787c7 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:20 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b53877c9-fc73-4c2e-b28c-b3aa146787c7 Jun 02 03:38:20 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:20 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b47e396d-2615-4e8d-b373-3bb14d9259c4 tempest-CinderUnicodeTest-789823191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-b53877c9-fc73-4c2e-b28c-b3aa146787c7" returned: 0 in 0.618s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:20 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b47e396d-2615-4e8d-b373-3bb14d9259c4 tempest-CinderUnicodeTest-789823191 None] Lock "cinder-quobyte-b53877c9-fc73-4c2e-b28c-b3aa146787c7" released by "delete_volume" :: held 1.368s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:38:20 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-b47e396d-2615-4e8d-b373-3bb14d9259c4 tempest-CinderUnicodeTest-789823191 None] Created reservations ['d939b5ed-266c-48be-920a-9db5e0eed3b7', 'ba97599a-3d98-417e-88ca-ef574f3c4e00', '6255c56f-0b78-44ca-aa6f-e41a0aafca57', 'a99a99a2-a4bc-4955-b426-61947b0dd172'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:38:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b47e396d-2615-4e8d-b373-3bb14d9259c4 tempest-CinderUnicodeTest-789823191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:38:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b47e396d-2615-4e8d-b373-3bb14d9259c4 tempest-CinderUnicodeTest-789823191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:38:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b47e396d-2615-4e8d-b373-3bb14d9259c4 tempest-CinderUnicodeTest-789823191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:38:20 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-b47e396d-2615-4e8d-b373-3bb14d9259c4 tempest-CinderUnicodeTest-789823191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:38:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b47e396d-2615-4e8d-b373-3bb14d9259c4 tempest-CinderUnicodeTest-789823191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:38:20 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b47e396d-2615-4e8d-b373-3bb14d9259c4 tempest-CinderUnicodeTest-789823191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:20 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:38:20 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:22 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:22 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b47e396d-2615-4e8d-b373-3bb14d9259c4 tempest-CinderUnicodeTest-789823191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 1.274s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:22 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-b47e396d-2615-4e8d-b373-3bb14d9259c4 tempest-CinderUnicodeTest-789823191 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:38:22 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-b47e396d-2615-4e8d-b373-3bb14d9259c4 tempest-CinderUnicodeTest-789823191 None] Deleted volume successfully. Jun 02 03:38:22 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b47e396d-2615-4e8d-b373-3bb14d9259c4 tempest-CinderUnicodeTest-789823191 None] Lock "cinder-b53877c9-fc73-4c2e-b28c-b3aa146787c7-delete_volume" released by "delete_volume" :: held 3.028s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:38:25 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3e2b5f3a-8311-459c-829a-1143b3a75cb1" returned: 0 in 5.266s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:25 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e93d32-d4f9-42ff-9ab7-1aad4f564a87]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:38:25 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:25 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d Jun 02 03:38:25 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:26 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d" returned: 0 in 0.868s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:26 devstack cinder-volume[86431]: DEBUG cinder.image.image_utils [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Image conversion details: src /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d, size 1024.00 MB, duration 5.27 sec, destination /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3e2b5f3a-8311-459c-829a-1143b3a75cb1 {{(pid=86431) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 02 03:38:26 devstack cinder-volume[86431]: INFO cinder.image.image_utils [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Converted 1024.00 MB image at 194.42 MB/s Jun 02 03:38:26 devstack cinder-volume[86431]: WARNING cinder.volume.drivers.remotefs [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3e2b5f3a-8311-459c-829a-1143b3a75cb1 is being set with open permissions: ugo+rw Jun 02 03:38:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3e2b5f3a-8311-459c-829a-1143b3a75cb1 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:26 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3e2b5f3a-8311-459c-829a-1143b3a75cb1 Jun 02 03:38:26 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:26 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3e2b5f3a-8311-459c-829a-1143b3a75cb1" returned: 0 in 0.567s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:26 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Lock "cinder-quobyte-3e2b5f3a-8311-459c-829a-1143b3a75cb1" released by "_copy_volume_from_snapshot" :: held 8.285s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:38:26 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Lock "cinder-quobyte-24bfff23-452e-4b07-94c8-99c5bdf52951-3e2b5f3a-8311-459c-829a-1143b3a75cb1" released by "_create_volume_from_snapshot" :: held 8.316s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:38:26 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.336s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:38:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f910d778-1b6a-4d18-a127-9545ec0ce2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e2b5f3a-8311-459c-829a-1143b3a75cb1', 'volume_size': 1, 'snapshot_id': '24bfff23-452e-4b07-94c8-99c5bdf52951'}' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:38:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb0bbbbd-8dd7-4b09-a702-fddc663c781c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 02 03:38:26 devstack cinder-volume[86431]: INFO cinder.volume.flows.manager.create_volume [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Volume volume-3e2b5f3a-8311-459c-829a-1143b3a75cb1 (3e2b5f3a-8311-459c-829a-1143b3a75cb1): created successfully Jun 02 03:38:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb0bbbbd-8dd7-4b09-a702-fddc663c781c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86431) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 02 03:38:26 devstack cinder-volume[86431]: DEBUG cinder.volume.manager [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Flow 'volume_create_manager' (ccbb90f2-4ddb-42c2-9e1e-606da241ebc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86431) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 02 03:38:26 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-b2620fe2-264d-44fd-acfe-da0c72199ce6 tempest-SnapshotDependencyTests-1311301795 None] Created volume successfully. Jun 02 03:38:27 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1d52015c-ed32-4209-9584-54576c475761 tempest-SnapshotDependencyTests-1311301795 None] Acquiring lock "cinder-24bfff23-452e-4b07-94c8-99c5bdf52951-delete_snapshot" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:38:27 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1d52015c-ed32-4209-9584-54576c475761 tempest-SnapshotDependencyTests-1311301795 None] Lock "cinder-24bfff23-452e-4b07-94c8-99c5bdf52951-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:38:27 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1d52015c-ed32-4209-9584-54576c475761 tempest-SnapshotDependencyTests-1311301795 None] Acquiring lock "cinder-quobyte-73cab644-76e7-4af7-9604-0131f6f86b7d" by "delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:38:27 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1d52015c-ed32-4209-9584-54576c475761 tempest-SnapshotDependencyTests-1311301795 None] Lock "cinder-quobyte-73cab644-76e7-4af7-9604-0131f6f86b7d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:38:27 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1d52015c-ed32-4209-9584-54576c475761 tempest-SnapshotDependencyTests-1311301795 None] Acquiring lock "cinder-quobyte-24bfff23-452e-4b07-94c8-99c5bdf52951" by "_delete_snapshot" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:38:27 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1d52015c-ed32-4209-9584-54576c475761 tempest-SnapshotDependencyTests-1311301795 None] Lock "cinder-quobyte-24bfff23-452e-4b07-94c8-99c5bdf52951" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:38:27 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-1d52015c-ed32-4209-9584-54576c475761 tempest-SnapshotDependencyTests-1311301795 None] Deleting offline snapshot 24bfff23-452e-4b07-94c8-99c5bdf52951 of volume 73cab644-76e7-4af7-9604-0131f6f86b7d {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 02 03:38:27 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-1d52015c-ed32-4209-9584-54576c475761 tempest-SnapshotDependencyTests-1311301795 None] snapshot_file for this snap is: volume-73cab644-76e7-4af7-9604-0131f6f86b7d.24bfff23-452e-4b07-94c8-99c5bdf52951 {{(pid=86431) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 02 03:38:27 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[07afc6eb-202e-4544-80fd-2f999d094ec5]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:38:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1d52015c-ed32-4209-9584-54576c475761 tempest-SnapshotDependencyTests-1311301795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d.24bfff23-452e-4b07-94c8-99c5bdf52951 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:27 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d.24bfff23-452e-4b07-94c8-99c5bdf52951 Jun 02 03:38:27 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:27 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1d52015c-ed32-4209-9584-54576c475761 tempest-SnapshotDependencyTests-1311301795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d.24bfff23-452e-4b07-94c8-99c5bdf52951" returned: 0 in 0.685s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:27 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.remotefs [None req-1d52015c-ed32-4209-9584-54576c475761 tempest-SnapshotDependencyTests-1311301795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73cab644-76e7-4af7-9604-0131f6f86b7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86431) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 02 03:38:27 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[8faffae8-fc79-48e7-9446-fc9890b1b4be]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:38:27 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1d52015c-ed32-4209-9584-54576c475761 tempest-SnapshotDependencyTests-1311301795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:28 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d Jun 02 03:38:28 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:28 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1d52015c-ed32-4209-9584-54576c475761 tempest-SnapshotDependencyTests-1311301795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d" returned: 0 in 0.714s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:28 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1d52015c-ed32-4209-9584-54576c475761 tempest-SnapshotDependencyTests-1311301795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d.24bfff23-452e-4b07-94c8-99c5bdf52951 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:28 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d.24bfff23-452e-4b07-94c8-99c5bdf52951 Jun 02 03:38:28 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:29 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1d52015c-ed32-4209-9584-54576c475761 tempest-SnapshotDependencyTests-1311301795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d.24bfff23-452e-4b07-94c8-99c5bdf52951" returned: 0 in 0.669s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1d52015c-ed32-4209-9584-54576c475761 tempest-SnapshotDependencyTests-1311301795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d.24bfff23-452e-4b07-94c8-99c5bdf52951 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:29 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d.24bfff23-452e-4b07-94c8-99c5bdf52951 Jun 02 03:38:29 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:29 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:29 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-1d52015c-ed32-4209-9584-54576c475761 tempest-SnapshotDependencyTests-1311301795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d.24bfff23-452e-4b07-94c8-99c5bdf52951" returned: 0 in 0.581s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:29 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1d52015c-ed32-4209-9584-54576c475761 tempest-SnapshotDependencyTests-1311301795 None] Lock "cinder-quobyte-24bfff23-452e-4b07-94c8-99c5bdf52951" released by "_delete_snapshot" :: held 2.746s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:38:29 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1d52015c-ed32-4209-9584-54576c475761 tempest-SnapshotDependencyTests-1311301795 None] Lock "cinder-quobyte-73cab644-76e7-4af7-9604-0131f6f86b7d" released by "delete_snapshot" :: held 2.778s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:38:29 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-1d52015c-ed32-4209-9584-54576c475761 tempest-SnapshotDependencyTests-1311301795 None] Created reservations ['5a47b283-2dc6-4368-aee9-988cea45cf17', '33e41761-d373-43b5-956b-92e24276a8fc', '49d89c48-0662-40fb-a528-efb19acb5159', 'b52bf71c-5193-4b1b-91bc-634700226c09'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:38:30 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-1d52015c-ed32-4209-9584-54576c475761 tempest-SnapshotDependencyTests-1311301795 None] Delete snapshot completed successfully. Jun 02 03:38:30 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-1d52015c-ed32-4209-9584-54576c475761 tempest-SnapshotDependencyTests-1311301795 None] Lock "cinder-24bfff23-452e-4b07-94c8-99c5bdf52951-delete_snapshot" released by "delete_snapshot" :: held 2.896s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:38:30 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6f48ae18-aae1-401a-9b96-b18ee5533cca tempest-SnapshotDependencyTests-1311301795 None] Acquiring lock "cinder-73cab644-76e7-4af7-9604-0131f6f86b7d-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:38:30 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6f48ae18-aae1-401a-9b96-b18ee5533cca tempest-SnapshotDependencyTests-1311301795 None] Lock "cinder-73cab644-76e7-4af7-9604-0131f6f86b7d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:38:30 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6f48ae18-aae1-401a-9b96-b18ee5533cca tempest-SnapshotDependencyTests-1311301795 None] Acquiring lock "cinder-quobyte-73cab644-76e7-4af7-9604-0131f6f86b7d" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:38:30 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6f48ae18-aae1-401a-9b96-b18ee5533cca tempest-SnapshotDependencyTests-1311301795 None] Lock "cinder-quobyte-73cab644-76e7-4af7-9604-0131f6f86b7d" acquired by "delete_volume" :: waited 0.015s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:38:30 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7b4c98-fe15-4973-b79a-9d4d1056c925]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:38:30 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6f48ae18-aae1-401a-9b96-b18ee5533cca tempest-SnapshotDependencyTests-1311301795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:30 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d Jun 02 03:38:30 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:31 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6f48ae18-aae1-401a-9b96-b18ee5533cca tempest-SnapshotDependencyTests-1311301795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d" returned: 0 in 0.683s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6f48ae18-aae1-401a-9b96-b18ee5533cca tempest-SnapshotDependencyTests-1311301795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:31 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d Jun 02 03:38:31 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:31 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6f48ae18-aae1-401a-9b96-b18ee5533cca tempest-SnapshotDependencyTests-1311301795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-73cab644-76e7-4af7-9604-0131f6f86b7d" returned: 0 in 0.581s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:31 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6f48ae18-aae1-401a-9b96-b18ee5533cca tempest-SnapshotDependencyTests-1311301795 None] Lock "cinder-quobyte-73cab644-76e7-4af7-9604-0131f6f86b7d" released by "delete_volume" :: held 1.315s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:38:31 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-6f48ae18-aae1-401a-9b96-b18ee5533cca tempest-SnapshotDependencyTests-1311301795 None] Created reservations ['f0dc2c3a-c08f-40dc-9238-10fb0f936993', '9e224be2-13da-4356-9127-e8f6ae964e3d', '79683fa6-4e07-4264-90c1-4d98370d0003', '32398327-2f25-4bf5-a721-98c0ad6505b3'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:38:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6f48ae18-aae1-401a-9b96-b18ee5533cca tempest-SnapshotDependencyTests-1311301795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:38:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6f48ae18-aae1-401a-9b96-b18ee5533cca tempest-SnapshotDependencyTests-1311301795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:38:31 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6f48ae18-aae1-401a-9b96-b18ee5533cca tempest-SnapshotDependencyTests-1311301795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:38:31 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-6f48ae18-aae1-401a-9b96-b18ee5533cca tempest-SnapshotDependencyTests-1311301795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:38:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-6f48ae18-aae1-401a-9b96-b18ee5533cca tempest-SnapshotDependencyTests-1311301795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:38:31 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6f48ae18-aae1-401a-9b96-b18ee5533cca tempest-SnapshotDependencyTests-1311301795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:31 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:38:31 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:32 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-6f48ae18-aae1-401a-9b96-b18ee5533cca tempest-SnapshotDependencyTests-1311301795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.574s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:32 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-6f48ae18-aae1-401a-9b96-b18ee5533cca tempest-SnapshotDependencyTests-1311301795 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:38:32 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-6f48ae18-aae1-401a-9b96-b18ee5533cca tempest-SnapshotDependencyTests-1311301795 None] Deleted volume successfully. Jun 02 03:38:32 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-6f48ae18-aae1-401a-9b96-b18ee5533cca tempest-SnapshotDependencyTests-1311301795 None] Lock "cinder-73cab644-76e7-4af7-9604-0131f6f86b7d-delete_volume" released by "delete_volume" :: held 2.059s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:38:32 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-388eb7d3-1fbc-4350-8645-6395cb8dfd25 tempest-SnapshotDependencyTests-1311301795 None] Acquiring lock "cinder-3e2b5f3a-8311-459c-829a-1143b3a75cb1-delete_volume" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:38:32 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-388eb7d3-1fbc-4350-8645-6395cb8dfd25 tempest-SnapshotDependencyTests-1311301795 None] Lock "cinder-3e2b5f3a-8311-459c-829a-1143b3a75cb1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:38:32 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-388eb7d3-1fbc-4350-8645-6395cb8dfd25 tempest-SnapshotDependencyTests-1311301795 None] Acquiring lock "cinder-quobyte-3e2b5f3a-8311-459c-829a-1143b3a75cb1" by "delete_volume" {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 02 03:38:32 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-388eb7d3-1fbc-4350-8645-6395cb8dfd25 tempest-SnapshotDependencyTests-1311301795 None] Lock "cinder-quobyte-3e2b5f3a-8311-459c-829a-1143b3a75cb1" acquired by "delete_volume" :: waited 0.015s {{(pid=86431) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 02 03:38:32 devstack cinder-volume[86431]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c86704-070f-49d2-850f-13437461274e]: (4, 'qcow2') {{(pid=87444) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 02 03:38:32 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-388eb7d3-1fbc-4350-8645-6395cb8dfd25 tempest-SnapshotDependencyTests-1311301795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3e2b5f3a-8311-459c-829a-1143b3a75cb1 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:32 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3e2b5f3a-8311-459c-829a-1143b3a75cb1 Jun 02 03:38:32 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:33 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-388eb7d3-1fbc-4350-8645-6395cb8dfd25 tempest-SnapshotDependencyTests-1311301795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3e2b5f3a-8311-459c-829a-1143b3a75cb1" returned: 0 in 0.677s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-388eb7d3-1fbc-4350-8645-6395cb8dfd25 tempest-SnapshotDependencyTests-1311301795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3e2b5f3a-8311-459c-829a-1143b3a75cb1 {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:33 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3e2b5f3a-8311-459c-829a-1143b3a75cb1 Jun 02 03:38:33 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:33 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-388eb7d3-1fbc-4350-8645-6395cb8dfd25 tempest-SnapshotDependencyTests-1311301795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f/volume-3e2b5f3a-8311-459c-829a-1143b3a75cb1" returned: 0 in 0.598s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:33 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-388eb7d3-1fbc-4350-8645-6395cb8dfd25 tempest-SnapshotDependencyTests-1311301795 None] Lock "cinder-quobyte-3e2b5f3a-8311-459c-829a-1143b3a75cb1" released by "delete_volume" :: held 1.310s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:38:33 devstack cinder-volume[86431]: DEBUG cinder.quota [None req-388eb7d3-1fbc-4350-8645-6395cb8dfd25 tempest-SnapshotDependencyTests-1311301795 None] Created reservations ['b4ea66b3-8200-443f-896f-de4d39998b9f', '47cd8c1f-2da7-4d80-bc57-9a1356f5e4f5', 'b71f0788-355b-44d1-82de-41b82f2b48d3', '0aceef8c-c97a-4177-8072-2bb62f164f46'] {{(pid=86431) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 02 03:38:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-388eb7d3-1fbc-4350-8645-6395cb8dfd25 tempest-SnapshotDependencyTests-1311301795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 02 03:38:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-388eb7d3-1fbc-4350-8645-6395cb8dfd25 tempest-SnapshotDependencyTests-1311301795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 02 03:38:33 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-388eb7d3-1fbc-4350-8645-6395cb8dfd25 tempest-SnapshotDependencyTests-1311301795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1': None} {{(pid=86431) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 02 03:38:33 devstack cinder-volume[86431]: DEBUG cinder.volume.drivers.quobyte [None req-388eb7d3-1fbc-4350-8645-6395cb8dfd25 tempest-SnapshotDependencyTests-1311301795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-daa37c63-3079-4d03-83f1-05713f3127d1'] {{(pid=86431) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 02 03:38:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.lockutils [None req-388eb7d3-1fbc-4350-8645-6395cb8dfd25 tempest-SnapshotDependencyTests-1311301795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86431) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 02 03:38:33 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-388eb7d3-1fbc-4350-8645-6395cb8dfd25 tempest-SnapshotDependencyTests-1311301795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 02 03:38:34 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f Jun 02 03:38:34 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 02 03:38:34 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Jun 02 03:38:34 devstack cinder-volume[86431]: DEBUG oslo_concurrency.processutils [None req-388eb7d3-1fbc-4350-8645-6395cb8dfd25 tempest-SnapshotDependencyTests-1311301795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/25ec2d6f131e287f8d3aa27a6495131f" returned: 0 in 0.578s {{(pid=86431) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 02 03:38:34 devstack cinder-volume[86431]: DEBUG cinder.manager [None req-388eb7d3-1fbc-4350-8645-6395cb8dfd25 tempest-SnapshotDependencyTests-1311301795 None] Notifying Schedulers of capabilities ... {{(pid=86431) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 02 03:38:34 devstack cinder-volume[86431]: INFO cinder.volume.manager [None req-388eb7d3-1fbc-4350-8645-6395cb8dfd25 tempest-SnapshotDependencyTests-1311301795 None] Deleted volume successfully. Jun 02 03:38:34 devstack cinder-volume[86431]: DEBUG cinder.coordination [None req-388eb7d3-1fbc-4350-8645-6395cb8dfd25 tempest-SnapshotDependencyTests-1311301795 None] Lock "cinder-3e2b5f3a-8311-459c-829a-1143b3a75cb1-delete_volume" released by "delete_volume" :: held 2.070s {{(pid=86431) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 02 03:38:43 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:UPDATE=83,cinder:SELECT=65,cinder:INSERT=26,cinder:DELETE=8 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 02 03:38:44 devstack cinder-volume[86431]: DEBUG dbcounter [-] [86431] Writing DB stats cinder:SELECT=31,cinder:INSERT=13,cinder:UPDATE=49,cinder:DELETE=3 {{(pid=86431) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}